1
Rethinking Predictive Modeling for LLM Routing: When Simple kNN Beats Complex Learned Routers
简单kNN方法竟击败复杂学习路由器,重新思考LLM路由预测建模的惊人发现!
arXiv:2505.12601v2 Announce Type: replace Abstract: As large language models (LLMs) grow in scale and specialization, routing--selecting the best mode…