community Reddit LocalLLaMA 2026-08-27T12:34 正文 thin 0 words

Qwen3.8-Flash-Next: Time to Update Those Benchmarks

英文标题:Qwen3.8-Flash-Next: Time to Update Those Benchmarks

specs hardware: M4 Max 128GB Studio inference engine: oMLX & lllama.cpp insights it still very early, so had to disable oMLX K/V caching, qwen4_exp architectureis not yet supported + the obvious n-grams with which the whole 4 bit quant takes ~100G, so pretty tight nevertheless, this is the fir
打开原文相关 4 · 机会 0

中文

specs hardware: M4 Max 128GB Studio inference engine: oMLX & lllama.cpp insights it still very early, so had to disable oMLX K/V caching, qwen4_exp architectureis not yet supported + the obvious n-grams with which the whole 4 bit quant takes ~100G, so pretty tight nevertheless, this is the fir

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

specs hardware: M4 Max 128GB Studio inference engine: oMLX & lllama.cpp insights it still very early, so had to disable oMLX K/V caching, qwen4_exp architectureis not yet supported + the obvious n-grams with which the whole 4 bit quant takes ~100G, so pretty tight nevertheless, this is the fir