1
Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?
揭秘自蒸馏为何会损害LLM的数学推理能力,并指出抑制关键探索过程是背后原因。
arXiv:2603.24472v3 Announce Type: replace-cross Abstract: Self-distillation has emerged as an effective post-training paradigm for LLMs, often improvi…