1
ContinuityBench: A Benchmark and Systems Study of Stateful Failover in Multi-Provider LLM Routing
首个针对多提供商LLM路由中状态故障转移的基准研究与系统评估,揭示服务可靠性关键挑战。
arXiv:2607.15899v1 Announce Type: new Abstract: In production large language model (LLM) deployments, high API availability guarantees do not equate t…