Update your chat template for dsv4 if you're using llama.cpp
英文标题：Update your chat template for dsv4 if you're using llama.cpp
Following some recent commits in llama.cpp, preserve_thinking behavior for chat templates included in older DSV4 ggufs got broken. This makes the model pretty dumb in a coding agent context. Adding kwargs won't fix it. Just add: --chat-template-file /path/to/llama.cpp/models/templates/deepseek-ai-De
打开原文相关 8 · 机会 1
中文
Following some recent commits in llama.cpp, preserve_thinking behavior for chat templates included in older DSV4 ggufs got broken. This makes the model pretty dumb in a coding agent context. Adding kwargs won't fix it. Just add: --chat-template-file /path/to/llama.cpp/models/templates/deepseek-ai-De
中文全文翻译正在补齐，可先查看下方英文原文。
English / 原文
Following some recent commits in llama.cpp, preserve_thinking behavior for chat templates included in older DSV4 ggufs got broken. This makes the model pretty dumb in a coding agent context. Adding kwargs won't fix it. Just add: --chat-template-file /path/to/llama.cpp/models/templates/deepseek-ai-De