1
Multi-Bitwidth Quantization for LLMs Using Additive Codebooks
加法码本搭配多比特宽度量化方案,为LLM推理加速与压缩提供新思路。
arXiv:2606.12876v1 Announce Type: cross Abstract: As large language models (LLMs) are increasingly deployed across heterogeneous hardware with varying…