1
Request-Level Energy Attribution for Batched LLM Serving
批处理LLM服务能耗如何精确到每个请求？这篇论文提出请求级能量归因方法，为绿色AI提供量化新工具。
arXiv:2608.00026v1 Announce Type: new Abstract: Batched LLM serving improves throughput but complicates energy accounting. GPU power telemetry is aggr…