PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs
针对长思维链大语言模型的KV缓存量化新突破,渐进混合精度方案,已被ICLR 2026接收,代码已开源。
arXiv:2505.18610v2 Announce Type: replace Abstract: Recently, significant progress has been made in developing reasoning-capable Large Language Models…