How come artificialanalysis.ai ranks Gemma4 above Qwen3.6 27b in SciCode
英文标题:How come artificialanalysis.ai ranks Gemma4 above Qwen3.6 27b in SciCode
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? EDIT: The contribution of this benchmark to the Intelligence index of arti
打开原文相关 2 · 机会 0
中文
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? EDIT: The contribution of this benchmark to the Intelligence index of arti
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? EDIT: The contribution of this benchmark to the Intelligence index of arti