Most of the LLM routing gap is task type
揭秘LLM路由差距的根源:任务类型比模型选择更关键,实测14模型两次运行结果并不完全一致。
arXiv:2608.23023v1 Announce Type: new Abstract: An LLM router picks which model should answer each query. The appeal is that models fail on different …
揭秘LLM路由差距的根源:任务类型比模型选择更关键,实测14模型两次运行结果并不完全一致。
arXiv:2608.23023v1 Announce Type: new Abstract: An LLM router picks which model should answer each query. The appeal is that models fail on different …
从2021年萌芽到2024年成型,LLM路由器正从小众技巧跃升为主流服务,一文看懂其演进与工程价值。
Article URL: https://techstrong.ai/articles/llm-routers-have-become-a-service-category-of-their-own/ Comments URL: https://news.ycombinator.com/item?i…
新论文提出WISERouter,在预算约束下智能路由LLM请求,兼顾成本与性能。
arXiv:2607.23765v1 Announce Type: new Abstract: Large language models (LLMs) achieve impressive performance across multiple domains, but using the mos…
自托管LLM路由利器,Rust实现支持请求分类与模型选择,轻量高效。
Hey HN, With the news of OpenRouter possibly being acquired and proliferation of hosted LLM routers (i.e. Ramp Router, Vercel’s AI Gateway), I saw the…
用自训练路由代理,低成本享受前沿模型输出质量,零延迟。
Article URL: https://github.com/numinous-technology/open-ultra Comments URL: https://news.ycombinator.com/item?id=48993540 Points: 2 # Comments: 0
确定性LLM路由+加密审计,确保可追溯且防篡改的决策记录
Article URL: https://github.com/felippebarcelos/teia-omega-awakening Comments URL: https://news.ycombinator.com/item?id=48978938 Points: 2 # Comments:…
首个针对多提供商LLM路由中状态故障转移的基准研究与系统评估,揭示服务可靠性关键挑战。
arXiv:2607.15899v1 Announce Type: new Abstract: In production large language model (LLM) deployments, high API availability guarantees do not equate t…
本地LLM优先、云端突发兜底的智能路由,端到端加密让连服务商都读不到你的AI对话。
Article URL: https://github.com/Lore-Hex/BurstyRouter Comments URL: https://news.ycombinator.com/item?id=48804448 Points: 1 # Comments: 0
面向受监管行业,用分类器门控智能路由多档大模型,在合规与推理成本间取得平衡。
arXiv:2606.31163v1 Announce Type: cross Abstract: Large language models deployed in regulated industries operate under two constraints: compliance enf…
针对不同文章类型自动切换最优LLM模型,并集成80+正则清洗反AI痕迹,提升内容真实感。
I've been quietly running a small network of niche content sites for a few weeks. Two are live on real domains: afixu.com - home improvement and DIY t…
将LLM提示智能路由到最便宜且能胜任的模型,大幅降低AI API调用成本。
Article URL: https://github.com/Reactance0083/pydantic-ai-multi-llm-cost-optimizer Comments URL: https://news.ycombinator.com/item?id=48644688 Points:…
RouteJudge平台让LLM路由可复现且感知用户偏好,有助于精准高效地选择模型,已被ICML 2026研讨接收。
arXiv:2606.18774v1 Announce Type: new Abstract: We present RouteJudge, an online pairwise preference evaluation framework for LLM routing systems, wit…
工厂自动选模型,降本提效高达25%,让LLM路由像呼吸一样简单
Article URL: https://factory.ai/product/router Comments URL: https://news.ycombinator.com/item?id=48575781 Points: 1 # Comments: 0
LLM路由技术遭遇精度瓶颈?21种方法深度研究揭示突破之道。
arXiv:2606.07587v1 Announce Type: new Abstract: LLM routing has become a popular approach to improve the cost-quality trade-off of LLM services by dyn…
重新思考LLM路由的监督范式,从采样结果转向能力分布,为模型选择提供新视角。
arXiv:2606.06924v1 Announce Type: new Abstract: Existing LLM routing methods typically treat a model's single response to a query as its capability la…
用元学习隐式平衡成本与性能,自动选择最佳LLM,降本增效新范式。
arXiv:2606.06178v1 Announce Type: cross Abstract: Large language models (LLMs) present a trade-off between performance and cost, where more powerful m…
混合离线-在线学习的LLM路由器,用LinUCB上下文强盗算法智能选择模型,兼顾性能与成本
arXiv:2605.30736v1 Announce Type: cross Abstract: The rapid development of large language models, each with distinct capabilities and inference costs,…
AI模型路由新突破:用图画像解决冷启动难题,精准匹配LLM性能。
arXiv:2605.00180v2 Announce Type: replace-cross Abstract: LLM routing is increasingly important for selecting suitable models under diverse user needs…
用离线强化学习实现全局预算感知的LLM顺序路由,解决多模型调用成本与性能平衡难题。
arXiv:2605.25424v1 Announce Type: cross Abstract: Existing LLM routing frameworks treat queries as independent events, neglecting the sequential natur…
生产日志问答新方案:LogRouter实现自适应双层LLM路由,降低资源消耗。
arXiv:2605.18015v1 Announce Type: new Abstract: Production log analytics in self-hosted, resource-constrained environments requires natural-language a…