community Reddit LocalLLaMA 2026-07-11T13:52

Why are MoE models so belittled?

英文标题:Why are MoE models so belittled?

E.g "Qwen 3.5 122B is just 10B active, so it's no where close to the dense 27B model" That is the main sentiment around here and it puzzles me. If a 122B is just worth 10B, then why does model providers bother creating an MoE model when they could've just released a dense 10B model? Heck the 10B den
打开原文相关 2 · 机会 0

中文

E.g "Qwen 3.5 122B is just 10B active, so it's no where close to the dense 27B model" That is the main sentiment around here and it puzzles me. If a 122B is just worth 10B, then why does model providers bother creating an MoE model when they could've just released a dense 10B model? Heck the 10B den

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

E.g "Qwen 3.5 122B is just 10B active, so it's no where close to the dense 27B model" That is the main sentiment around here and it puzzles me. If a 122B is just worth 10B, then why does model providers bother creating an MoE model when they could've just released a dense 10B model? Heck the 10B den