1
The Distributional View of Knowledge Distillation
用分布视角重新拆解知识蒸馏，带你理解模型压缩背后的数学本质，适合深度学习进阶读者。
arXiv:2608.15215v1 Announce Type: cross Abstract: Token-level knowledge distillation (KD) matches two conditional distributions per position, yet the …