1
Approaching I/O-optimality for Approximate Attention
从理论层面逼近近似注意力机制的I/O最优性,为高效Transformer推理提供新视角。
arXiv:2605.23751v1 Announce Type: new Abstract: We revisit the I/O complexity of attention in large language models. Given query-key-value matrices $Q…