Token-level Response-visual Attention Guidance for Multimodal LLMs Knowledge Distillation
针对多模态大语言模型压缩难题,提出Token级响应-视觉注意力引导,提升蒸馏效果
arXiv:2607.02593v1 Announce Type: cross Abstract: While knowledge distillation (KD) is widely adopted for training lightweight models by leveraging su…