1
Dynamic Linear Attention
揭秘新型注意力机制：动态线性注意力，同时提升效率与精度，ICML 2026录用论文。
arXiv:2606.10650v1 Announce Type: cross Abstract: The scalability of Large Language Models (LLMs) to long contexts is fundamentally constrained by the…
2
Parallax: Parameterized Local Linear Attention for Language Modeling
提出参数化局部线性注意力机制，在语言建模中兼顾效率与性能，为Transformer改进提供新思路。
arXiv:2605.29157v1 Announce Type: cross Abstract: Large Language Models (LLMs) have become the central paradigm in artificial intelligence, yet the co…
3
Exact Linear Attention
线性注意力机制迎来精确化突破，三大工程创新解决梯度退化与特征流动难题
arXiv:2605.18848v1 Announce Type: new Abstract: This paper introduces Exact Linear Attention (ELA), a mechanism that achieves linear computational com…
4
Higher-order Linear Attention
突破二次复杂度瓶颈，高阶线性注意力HLA以线性时间实现更强交互，为长上下文模型提供新方向。
arXiv:2510.27258v3 Announce Type: replace-cross Abstract: The quadratic cost of scaled dot-product attention is a central obstacle to scaling autoregr…