1
Towards Load-Aware Prefill Deflection for Disaggregated LLM Serving
负载感知的预填偏转设计，破解分离式LLM服务的时延难题
arXiv:2607.02043v1 Announce Type: cross Abstract: Disaggregated LLM serving runs prefill and decode on separate GPU pools to keep the two phases from …