1
Agreement Metrics for LLM-as-Judge Evaluation: What to Report and Why
剖析LLM裁判评估中的协议度量选择，揭示准确性、Kappa等统计量与判断尺度的复杂关联，为报告提供指导。
arXiv:2606.00093v1 Announce Type: new Abstract: Validating an LLM judge against human annotations usually means reporting several agreement statistics…