1
Show HN: Referee.Chat - Set the goal. An AI panel works. Referee clears it done
设定目标，AI评审团分工协作，实时查证文献并核对数字，让结果可追溯、可验证。
Article URL: https://referee.chat/ Comments URL: https://news.ycombinator.com/item?id=49293191 Points: 3 # Comments: 0
2
No Free Labels: Limitations of LLM-as-a-Judge Without Human Grounding
LLM当裁判不靠谱？这项研究揭示无人类标注时AI评分的致命盲区，做评估必看。
arXiv:2503.05061v3 Announce Type: replace Abstract: Reliable evaluation of large language models (LLMs) is critical as their deployment rapidly expand…
3
Show HN: Debategle – ranked 1v1 debates judged by an LLM
和观点相左的陌生人辩论，由大模型裁判实时打分，刺激又有趣的AI社交新玩法。
I built Debategle, a platform for live 1v1 debates. You get matched with a random opponent (ranked matching is based on topics you’re interested in, c…
4
Towards Reliable Multilingual LLMs-as-a-Judge: An Empirical Study
多语言LLM评判可靠性实证研究：探索如何确保AI裁判在不同语言下的公正与准确
arXiv:2605.28710v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used for the automatic evaluation of generated text, y…