1
Human-Less LLM Serving: Quantifying the Human Tax on Throughput
量化人类参与对LLM服务吞吐量的隐性成本，揭示人工干预如何拖累系统效率。
arXiv:2606.20577v1 Announce Type: cross Abstract: Every major LLM serving system is designed to meet TTFT and TPOT SLOs. These metrics capture latency…