1
What Does the Weight Norm Control in Grokking? Logit-Scale Mediation under Cross-Entropy
揭示Grokking中权重范数如何通过交叉熵下的logit尺度中介作用控制延迟泛化，为理解神经网络泛化机制提供新视角。
arXiv:2606.18465v1 Announce Type: new Abstract: Grokking, the delayed jump from memorization to generalization, is usually tied to the weight norm: a …