1
Residual Stream Duality in Modern Transformer Architectures
揭示Transformer残差流不仅是优化通道，更是模型表示核心——两轴视角（序列位置×层深度）重构设计空间，自注意力与残差路径协同新理解。
arXiv:2603.16039v2 Announce Type: replace-cross Abstract: Recent work has made clear that the residual pathway is not mere optimization plumbing; it i…