1
Operator Fusion for LLM Inference on the Tensix Architecture
聚焦Tenstorrent Tensix架构的LLM推理瓶颈,提出RMSNorm与矩阵乘融合的算子优化策略,提升数据局部性。
arXiv:2606.09879v1 Announce Type: new Abstract: This study addresses on-device inference bottlenecks of Transformer models on Tenstorrent's Tensix arc…