community Reddit LocalLLaMA 2026-08-06T13:21 正文 thin 0 words

How come artificialanalysis.ai ranks Gemma4 above Qwen3.6 27b in SciCode

英文标题:How come artificialanalysis.ai ranks Gemma4 above Qwen3.6 27b in SciCode

Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? EDIT: The contribution of this benchmark to the Intelligence index of arti
打开原文相关 2 · 机会 0

中文

Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? EDIT: The contribution of this benchmark to the Intelligence index of arti

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? EDIT: The contribution of this benchmark to the Intelligence index of arti