1
The Curse and Blessing of Mean Bias in FP4-Quantized LLM Training
FP4训练中均值偏差的双重效应,揭示极端激活值如何破坏长尾信号,提出关键改进方向
arXiv:2603.10444v2 Announce Type: replace-cross Abstract: FP4 training promises substantial memory and compute savings for large language models, but …