1
Online Linear Programming for Multi-Objective Routing in LLM Serving
用在线线性规划算法优化LLM服务的多目标路由，兼顾效率与资源均衡
arXiv:2607.03948v1 Announce Type: new Abstract: We study the online routing problem in large language model serving, where requests arrive sequentiall…