community Reddit LocalLLaMA 2026-07-09T23:50 正文 thin 0 words

Has anyone tested how quantization hits different capabilities separately? My results are surprising.

英文标题:Has anyone tested how quantization hits different capabilities separately? My results are surprising.

I've been running some systematic tests on a few models comparing FP16 vs various GGUF quant levels, and instead of looking at one aggregate benchmark score, I broke it down by capability: math (GSM8K), code (HumanEval), reasoning (ARC-Challenge), and knowledge recall (MMLU-Pro). The results are way
打开原文相关 2 · 机会 0

中文

I've been running some systematic tests on a few models comparing FP16 vs various GGUF quant levels, and instead of looking at one aggregate benchmark score, I broke it down by capability: math (GSM8K), code (HumanEval), reasoning (ARC-Challenge), and knowledge recall (MMLU-Pro). The results are way

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

I've been running some systematic tests on a few models comparing FP16 vs various GGUF quant levels, and instead of looking at one aggregate benchmark score, I broke it down by capability: math (GSM8K), code (HumanEval), reasoning (ARC-Challenge), and knowledge recall (MMLU-Pro). The results are way