WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs
新方法预测任意GPU运行LLM的功耗与延迟,助力数据中心高效部署。
arXiv:2607.02391v1 Announce Type: cross Abstract: Large Language Model (LLM) inference workloads are a rapidly growing contributor to data center ener…