探索将自蒸馏技术从自回归模型迁移至扩散LLM，突破传统方法限制，为后训练提供新思路。
arXiv:2606.18195v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) has proven effective for post-training large language models (LLMs)…
用特权信息生成密集token级监督，提升LLM推理能力的新蒸馏方法。
arXiv:2605.28791v1 Announce Type: cross Abstract: On-policy self-distillation (SD) improves LLM reasoning by using teacher-side privileged information…
新框架PIQL利用特权信息同时加速表格基础模型训练并提升泛化能力。
arXiv:2605.07799v2 Announce Type: replace-cross Abstract: Training foundation models is computationally intensive and often slow to converge. We intro…