1
MONA: Muon Optimizer with Nesterov Acceleration for Scalable Language Model Training
Muon优化器新升级MONA,融合Nesterov加速突破局部极小,提升大模型训练效率
arXiv:2605.26842v1 Announce Type: new Abstract: The Muon optimizer has recently offered a promising alternative to AdamW for large language model trai…