What Aggregate Scores Miss: Measuring Item-Level Regressions in Commercial LLM API Migrations
聚合分数掩盖了模型升级中的细节退化,逐项回归分析才是迁移评估的关键。
arXiv:2608.17719v1 Announce Type: cross Abstract: Context: Software systems that depend on commercial large language model APIs must migrate to succes…