Fair-GPTQ: Bias-Aware Quantization for Large Language Models
新方法Fair-GPTQ实现大模型量化时兼顾效率与公平性,减少偏差
arXiv:2509.15206v3 Announce Type: replace Abstract: The high memory demands of generative language models have drawn attention to quantization, which …
新方法Fair-GPTQ实现大模型量化时兼顾效率与公平性,减少偏差
arXiv:2509.15206v3 Announce Type: replace Abstract: The high memory demands of generative language models have drawn attention to quantization, which …
量化检查点常先用质量指标筛选,但论文揭示36组质量-安全配对均不一致,安全检测不可跳过
arXiv:2606.10154v1 Announce Type: new Abstract: Quantized checkpoints are often screened first with quality metrics and only later, if at all, with di…
一文讲清GGUF、GPTQ、AWQ三种主流LLM量化格式的区别,帮你选对压缩方式省显存。
Article URL: https://vettedconsumer.com/gguf-vs-gptq-vs-awq-the-plain-english-guide-to-llm-quantization-and-which-one-to-pick/ Comments URL: https://n…
提出时间步感知的W4A4量化方案,攻克视频扩散Transformer的激活异常与分布依赖难题,内存省出新高。
arXiv:2605.27003v1 Announce Type: cross Abstract: W4A4 quantization of large video diffusion Transformers offers substantial memory savings but is hin…