针对大模型推理的尾部延迟问题，提出超越预测的尾感知调度方法，兼顾效率与公平。
arXiv:2606.18431v1 Announce Type: new Abstract: LLM serving exhibits extreme length variability, making size-based scheduling difficult in practice. R…
面向Superchip的LLM推理优化，提出SLO感知的旋转调度与内存管理方案，已被MLSys '26接收。
arXiv:2601.20309v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) serving faces a fundamental tension between stringent latency Ser…
从排队论视角揭秘LLM推理的吞吐最优调度算法，为系统优化提供数学根基
arXiv:2504.07347v3 Announce Type: replace-cross Abstract: As demand for Large Language Models (LLMs) and AI agents grows rapidly, optimizing systems f…