1
TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference
TELLER提出非侵入式跨层根因分析方法，精准定位LLM推理性能瓶颈，值得关注。
arXiv:2608.01975v1 Announce Type: cross Abstract: Large language model (LLM) inference has evolved from an offline workload into a continuously operat…