Stepwise Token Selection for Efficient Multimodal Large Language Models
多模态大模型推理成本主要来自视觉token,提出逐步选择方法大幅降低计算量,实现高效生成。
arXiv:2606.16067v1 Announce Type: new Abstract: In multimodal large language models (MLLMs), inference cost is largely dominated by the visual token p…