[Open PR] llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp
英文标题:[Open PR] llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp
PR by u/Stainless-Bacon 👍 It would be handy & awesome to have options --n-cpu-ffn / --cpu-ffn for Dense models like how we have --n-cpu-moe / --cpu-moe for MOE models. Also check his threads: On PR : llama.cpp CPU offload optimizations On Running Qwen3.8-27B with above optimization : Guide f
打开原文相关 2 · 机会 0
中文
PR by u/Stainless-Bacon 👍 It would be handy & awesome to have options --n-cpu-ffn / --cpu-ffn for Dense models like how we have --n-cpu-moe / --cpu-moe for MOE models. Also check his threads: On PR : llama.cpp CPU offload optimizations On Running Qwen3.8-27B with above optimization : Guide f
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
PR by u/Stainless-Bacon 👍 It would be handy & awesome to have options --n-cpu-ffn / --cpu-ffn for Dense models like how we have --n-cpu-moe / --cpu-moe for MOE models. Also check his threads: On PR : llama.cpp CPU offload optimizations On Running Qwen3.8-27B with above optimization : Guide f