1
WINDQuant: Weight-Informed Neural Decision-Making for Global Mixed-Precision LLM Quantization
权重指导神经决策，实现大模型全局混合精度量化，性能与效率的新平衡。
arXiv:2605.26660v1 Announce Type: new Abstract: Quantization is an effective approach to reduce the memory footprint and inference cost of large langu…