1
Attend to Your Own Thoughts: Breaking the Barrier for Post-Training Quantization of Reasoning LLMs through the Lens of 1.58-Bit Quantization
1.58比特量化新框架ScaleQ-1.58,专治推理大模型量化掉点,用三元PTQ保住思维链能力,硬核干货。
arXiv:2608.01078v1 Announce Type: cross Abstract: We propose ScaleQ-1.58, a scalable ternary post-training quantization (PTQ) framework for reasoning …