1
Channel-Wise Mixed-Precision Quantization for Large Language Models
大语言模型量化新突破：通道级混合精度策略如何在保持性能同时压缩模型？
arXiv:2410.13056v4 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated remarkable success across a wide range of lan…