1
Online LLM Selection via Constrained Bandits with Time-Varying Demand
挑战在线LLM选择中的时变需求?这篇论文提出约束赌博机框架,动态平衡性能与成本。
arXiv:2606.17489v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly deployed in edge-cloud inference systems to handle div…