1
Muon Learns More Robust and Transferable Features than Adam
Muon优化器比Adam学习到更鲁棒和可迁移的特征,为深度学习训练提供新选择。
arXiv:2606.09658v1 Announce Type: new Abstract: Muon has recently emerged as a state-of-the-art optimizer for pretraining Large Language Models (LLMs)…