1
ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference
轻量可插拔框架ChunkLLM，通过块选择与压缩突破Transformer自注意力二次复杂度瓶颈，显著加速大模型推理
arXiv:2510.02361v2 Announce Type: replace-cross Abstract: Transformer-based large models excel in natural language processing and computer vision, but…