1
The Bridge-Garden Dilemma in LLM Distillation: Why Mixing Hard and Soft Labels Works
揭秘LLM蒸馏中混合硬软标签优于纯软标签的深层原因，实验与理论兼备。
arXiv:2605.26246v1 Announce Type: new Abstract: Knowledge distillation (KD) transfers knowledge from a large teacher model to a smaller student. In la…