牛哥精选 · 半年

📋 全部 🤖 AI·大模型 ⚡ 效率工具 📝 深度技术 🚀 产品观察 💰 商业科技 🔓 开源项目 🎨 设计创意 📖 阅读推荐 🏷 资源合集 🌱 成长效率

🤖 AI·大模型 arXiv AI 2026-08-20

Decomposing Wrong-Consensus Agreement in LLM Self-Consistency: A GPT-4.1 Case Study

多数投票为何在难题上翻车？新指标Gamma精准拆解LLM自洽性失效机制

arXiv:2608.18795v1 Announce Type: cross Abstract: Majority voting over multiple LLM samples is widely used to raise answer accuracy, yet its gain vari…

llm自洽性多数投票一致性指标 gpt-4.1 错误共识

📝 深度技术 Hacker News AI 2026-08-02

MUD as AI Evaluation and LLM-judge distortion in ways aggregate κ misses

用MUD搭建AI评估场，揭露LLM裁判在聚合kappa指标下隐藏的失真，挑战传统评估框架的盲区。

Article URL: https://www.lesswrong.com/posts/GPbWyHgx9hCLMdAjc/mud-as-ai-evaluation-and-llm-judge-distortion-in-ways Comments URL: https://news.ycombi…

mud ai评估 llm评判一致性指标聚合偏差

📅 日期

2026-05-20 2026-05-19

🐂 牛哥精选

Decomposing Wrong-Consensus Agreement in LLM Self-Consistency: A GPT-4.1 Case Study

MUD as AI Evaluation and LLM-judge distortion in ways aggregate κ misses

📅 日期