1
LFQ: Logit-aware Final-block Quantization for Boosting the Generation Quality of Low-Bit Quantized LLMs
LFQ方法通过关注logit感知的最终块量化,显著提升低比特LLM生成质量,已被ICML 2026接收。
arXiv:2605.29756v1 Announce Type: new Abstract: As large language models continue to scale, low-bit weight-only post-training quantization (PTQ) offer…