1
MoBiQuant: Mixture-of-Bits Quantization for Token-Adaptive Any-Precision LLM
MoBiQuant通过混合位数量化实现token自适应任意精度,大幅降低大模型内存与计算开销,推理更高效。
arXiv:2602.20191v2 Announce Type: replace-cross Abstract: Dynamic runtime latency and memory constraints necessitate flexible large language model (LL…