W4A4 Quantization for Inference on Wan2.2-I2V-A14B
提出W4A4量化方案,在Wan2.2视频生成模型上实现高效推理,挑战低比特大模型量化极限
arXiv:2606.29337v1 Announce Type: new Abstract: We summarize our submission to Sub-Challenge 1: W4A4 Quantization for Inference (HiF4 / MXFP4) of the …
提出W4A4量化方案,在Wan2.2视频生成模型上实现高效推理,挑战低比特大模型量化极限
arXiv:2606.29337v1 Announce Type: new Abstract: We summarize our submission to Sub-Challenge 1: W4A4 Quantization for Inference (HiF4 / MXFP4) of the …
ICML 2026收录,提出NeUQI量化参数初始化方法,实现低比特LLM接近最优的均匀量化,兼顾压缩与精度。
arXiv:2505.17595v4 Announce Type: replace Abstract: Large language models (LLMs) achieve impressive performance across domains but face significant ch…
LFQ方法通过关注logit感知的最终块量化,显著提升低比特LLM生成质量,已被ICML 2026接收。
arXiv:2605.29756v1 Announce Type: new Abstract: As large language models continue to scale, low-bit weight-only post-training quantization (PTQ) offer…
低比特LLM量化新突破:通过重塑激活分布提升精度,值得AI从业者关注。
arXiv:2605.26175v1 Announce Type: cross Abstract: Low-bit activation quantization remains a major bottleneck in efficient large language model (LLM) d…
权重指导神经决策,实现大模型全局混合精度量化,性能与效率的新平衡。
arXiv:2605.26660v1 Announce Type: new Abstract: Quantization is an effective approach to reduce the memory footprint and inference cost of large langu…
LLM极低比特量化新突破:SignRoundV2大幅缩小性能差距,实现高效训练后量化
arXiv:2512.04746v2 Announce Type: replace Abstract: Extremely low-bit quantization is critical for efficiently deploying Large Language Models (LLMs),…
揭秘开源LLM激活动态范围新发现,挑战旧有量化认知,影响推理效率优化。
arXiv:2605.15572v1 Announce Type: new Abstract: The dynamic range of activations is a first-order constraint for low-bit quantization, activation scal…