OpenCode overrides the samplers for Qwen models to the wrong values
英文标题:OpenCode overrides the samplers for Qwen models to the wrong values
This is invisible with llama.cpp or derivatives, but ninfer helpfully logs the sampler settings on each request and auto-configures the correct ones for the model. Basically, OpenCode will always send top-p=1.0 (which means there is no filtering of low-probability tokens except with top-k) instead o
打开原文相关 2 · 机会 2
中文
This is invisible with llama.cpp or derivatives, but ninfer helpfully logs the sampler settings on each request and auto-configures the correct ones for the model. Basically, OpenCode will always send top-p=1.0 (which means there is no filtering of low-probability tokens except with top-k) instead o
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
This is invisible with llama.cpp or derivatives, but ninfer helpfully logs the sampler settings on each request and auto-configures the correct ones for the model. Basically, OpenCode will always send top-p=1.0 (which means there is no filtering of low-probability tokens except with top-k) instead o