Towards Understanding Pause Token Fine-Tuning Dynamics: A Mode Retention Perspective
英文标题:Towards Understanding Pause Token Fine-Tuning Dynamics: A Mode Retention Perspective
arXiv:2609.04489v1 Announce Type: new Abstract: Pause-token methods improve LLM reasoning by inserting special tokens into sequences. Prior work explains these gains through computational expressivity. However, there is relatively little investigation into the training dynamics of pause tokens. We
打开原文相关 2.4 · 机会 0
612 B
380 B
9.1 KB
32.7 KB
22.8 KB
24.2 KB
34.7 KB
中文
arXiv:2609.04489v1 Announce Type: new Abstract: Pause-token methods improve LLM reasoning by inserting special tokens into sequences. Prior work explains these gains through computational expressivity. However, there is relatively little investigation into the training dynamics of pause tokens. We
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
BibTeX formatted citation
×