community Reddit LocalLLaMA 2026-07-12T23:54 正文 thin 0 words

Why do people keep fine-tuning on summarized/censored SOTA CoT traces?

英文标题:Why do people keep fine-tuning on summarized/censored SOTA CoT traces?

Am I missing something? It seems like some people think distillation is magic and will raise the quality of output above what the base model is actually capable of. It's especially weird to me to see all these Fable fine-tunes, because as far as I understand it, they miss the fact that the reasoning
打开原文相关 4 · 机会 0

中文

Am I missing something? It seems like some people think distillation is magic and will raise the quality of output above what the base model is actually capable of. It's especially weird to me to see all these Fable fine-tunes, because as far as I understand it, they miss the fact that the reasoning

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

Am I missing something? It seems like some people think distillation is magic and will raise the quality of output above what the base model is actually capable of. It's especially weird to me to see all these Fable fine-tunes, because as far as I understand it, they miss the fact that the reasoning