1
High-Rate Quantized Matrix Multiplication II
水填充理论指导LLM权重量化中的比特分配，揭示经典源编码方案的实际改进效果。
arXiv:2605.13768v2 Announce Type: replace Abstract: This is the second part of the work investigating quantized matrix multiplication (MatMul). In par…
2
AAAC: Activation-Aware Adaptive Codebooks for 4-bit LLM Weight Quantization
提出AAAC方法，通过激活感知自适应码本，在保持4比特精度的同时进一步降低LLM权重量化误差
arXiv:2605.08692v2 Announce Type: replace Abstract: Post-training weight-only quantization to 4 bits is widely used to reduce the memory and compute c…
3
Show HN: Glq LLM quantization using E8 lattice
基于E8晶格的新型LLM量化方法GLQ，8权重一组映射为16位索引，精度2-8 bpw，开源有代码。
I have with the help of AI create an open source method of E8 LLM code book quantization library called glq. I was interested in creating Glq as a PC …