1
How Much Orthogonalization Does Muon Need?
Muon优化器正交化程度对训练效果的影响研究,给出放松的立方Newton-Schulz调度方案
arXiv:2606.00371v1 Announce Type: new Abstract: Muon optimizers improve neural-network training by replacing ill-conditioned momentum updates with app…