CTX: How far can you reasonably go with Qwen 3.6 27B?
英文标题:CTX: How far can you reasonably go with Qwen 3.6 27B?
How far can i stretch the context window with Qwen 3.6 27B (using Q8_0) before it gets too unreliable? I am at 100k right now and i am not quite statisfied. Other than not quantizing KV cache, is there anything else that can be done to make the model more stable over longer CTX? submitted by /
打开原文相关 2 · 机会 0
中文
How far can i stretch the context window with Qwen 3.6 27B (using Q8_0) before it gets too unreliable? I am at 100k right now and i am not quite statisfied. Other than not quantizing KV cache, is there anything else that can be done to make the model more stable over longer CTX? submitted by /
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
How far can i stretch the context window with Qwen 3.6 27B (using Q8_0) before it gets too unreliable? I am at 100k right now and i am not quite statisfied. Other than not quantizing KV cache, is there anything else that can be done to make the model more stable over longer CTX? submitted by /