1
(How) Learning Rates Regulate Catastrophic Overtraining
学习率如何抑制灾难性过训练?这项研究揭示关键调节机制,为深度学习训练提供全新视角。
arXiv:2604.13627v2 Announce Type: replace Abstract: Supervised fine-tuning (SFT) is a common first stage of LLM post-training, teaching the model to f…