1
Exact Linear Attention
线性注意力机制迎来精确化突破，三大工程创新解决梯度退化与特征流动难题
arXiv:2605.18848v1 Announce Type: new Abstract: This paper introduces Exact Linear Attention (ELA), a mechanism that achieves linear computational com…
2
Higher-order Linear Attention
突破二次复杂度瓶颈，高阶线性注意力HLA以线性时间实现更强交互，为长上下文模型提供新方向。
arXiv:2510.27258v3 Announce Type: replace-cross Abstract: The quadratic cost of scaled dot-product attention is a central obstacle to scaling autoregr…