1
COBS: Cumulant Order Block Sparse Attention
块稀疏注意力硬件友好却未被主流LLM采用？本文剖析原因并提出新型COBS注意力机制。
arXiv:2607.09052v1 Announce Type: new Abstract: Block sparse attention is a hardware friendly way to alleviate the key-value (KV) cache read bottlenec…