1
SAGA: Workflow-Atomic Scheduling for AI Agent Inference on GPU Clusters
AI Agent任务中LLM调用链被阶梯式中断，3-8倍延迟竟源于调度器无视中间状态
arXiv:2605.00528v2 Announce Type: replace-cross Abstract: AI agents execute tens to hundreds of chained LLM calls per task, yet GPU schedulers treat e…