1
RanSOM: Second-Order Momentum with Randomized Scaling for Constrained and Unconstrained Optimization
提出RanSOM方法,用随机缩放解决动量方法在随机优化中的曲率偏差,无需昂贵辅助采样,实现高效收敛。
arXiv:2602.06824v2 Announce Type: replace-cross Abstract: Momentum methods, such as Polyak's Heavy Ball, are the standard for training deep networks b…