1
AsyncOPD: How Stale Can On-Policy Distillation Be?
On-policy蒸馏中旧数据的容忍度如何？这篇论文挑战了传统认知，给出定量分析框架。
arXiv:2606.24143v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student on its own rollouts guided by teacher feedback and is be…