1
Scheduling LLM Inference with Uncertainty-Aware Output Length Predictions
用不确定性感知的动态预测优化LLM推理调度，打破传统单点估计瓶颈，显著提升SJF效率
arXiv:2604.00499v2 Announce Type: replace Abstract: To schedule LLM inference, the \textit{shortest job first} (SJF) principle is favorable by priorit…