1
LLM Inference Under Bursty Workload Distribution: Modifying the WAIT Algorithm
应对突发推理负载，改进WAIT调度算法，提升LLM服务稳定性与吞吐量。
arXiv:2608.06135v1 Announce Type: new Abstract: Large Language Models (LLMs) such as ChatGPT and Claude are widely used for information retrieval and …