community Reddit LocalLLaMA 2026-10-18T13:05 正文 thin 0 words

What quant do you actually use day to day? Anyone happy with 2-bit or 3-bit?

英文标题:What quant do you actually use day to day? Anyone happy with 2-bit or 3-bit?

Curious what everyone runs in practice: - What quant do you use most, and for what (chat, coding, agents)? - 2-bit: do you use it? Is it actually usable or too broken? - 3-bit: good enough for coding and more complex stuff, or do you go back to 4-bit? - If you look at KLD: what number do you call "b
打开原文相关 4 · 机会 1

中文

Curious what everyone runs in practice: - What quant do you use most, and for what (chat, coding, agents)? - 2-bit: do you use it? Is it actually usable or too broken? - 3-bit: good enough for coding and more complex stuff, or do you go back to 4-bit? - If you look at KLD: what number do you call "b

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

Curious what everyone runs in practice: - What quant do you use most, and for what (chat, coding, agents)? - 2-bit: do you use it? Is it actually usable or too broken? - 3-bit: good enough for coding and more complex stuff, or do you go back to 4-bit? - If you look at KLD: what number do you call "b