1
Benchmarking Agentic Review Systems
开源与专有AI代理评审系统对比评测，揭示AI辅助科研时代评审新挑战
arXiv:2606.19749v1 Announce Type: new Abstract: A new class of agentic review systems are emerging as a remedy to the pressure placed on peer review s…
2
Intelligence Is Not the Bottleneck: Validating an LLM First-Pass Manuscript Score Against Peer-Review Outcomes
验证LLM给学术手稿打分的可靠性，AIPR系统从五个维度评分，结果竟然与真实同行评审高度一致。
arXiv:2606.15887v1 Announce Type: cross Abstract: Large language model (LLM) systems are increasingly proposed to assist peer review, yet most evaluat…
3
Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Review
首项针对多模态同行评审的对抗攻击与防御研究，揭示AI审稿的脆弱性。
arXiv:2606.12716v1 Announce Type: new Abstract: The integration of Large Language Models (LLMs) and Multimodal LLMs (MLLMs) into scientific peer-revie…
4
Law Professors Prefer AI over Peer Answers
斯坦福法学院研究发现，法学教授更认可AI答案而非同行回答，揭示AI在专业领域的潜力与偏见。
Article URL: https://law.stanford.edu/publications/law-professors-prefer-ai-over-peer-answers/ Comments URL: https://news.ycombinator.com/item?id=4842…
5
PRAIB: Peer Review AI Benchmark of Behaviour of LLM-Assisted Reviewing
首个专门评估LLM辅助同行评审行为的基准，揭示AI评审的可靠性边界。
arXiv:2605.29815v1 Announce Type: new Abstract: The growing number of submitted papers has motivated the exploration of Large Language Models (LLMs) a…
6
FactReview: Evidence-Grounded Peer Review with Execution-Based Claim Verification
让AI学会同行评审：基于执行验证论文声明，用证据驱动事实核查。
arXiv:2604.04074v3 Announce Type: replace Abstract: LLM-based reviewing systems typically take only the manuscript as input, leaving literature and co…
7
PRISM: A Multi-Dimensional Benchmark for Evaluating LLM Peer Reviewers
新基准PRISM衡量LLM审稿能力，与人类评审对比发现科学漏洞的差距
arXiv:2605.26730v1 Announce Type: new Abstract: The rapid growth in submissions to machine learning venues has strained the scientific peer-review sys…
8
研究显示医学论文中的虚假参考文献数量激增，AI 难辞其咎
医学论文中虚假参考文献暴增，AI生成内容成学术造假新推手，数据触目惊心。
IT之家 5 月 26 日消息，一项针对 250 万篇生物医学论文的核查显示，同行评审研究中的虚假参考文献已演变为系统性问题。2023 年至今，虚假参考文献的出现率飙升至原先的十二倍以上。 哥伦比亚大学及多家机构的研究团队在《柳叶刀》期刊上发布了迄今为止规模最大的生物医学论文引文分析报告。该研究由马…
9
"This paper is LLM reviewed" > "this paper is peer-reviewed"
用LLM替代同行评审？视频探讨论文审稿新范式，效率与可信度之争。
Article URL: https://www.youtube.com/watch?v=m1ddx427bHI Comments URL: https://news.ycombinator.com/item?id=48210407 Points: 2 # Comments: 1
10
Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews
ICML '24重量级案例：通过大规模监测揭示ChatGPT对AI会议同行评审的渗透与影响
arXiv:2403.07183v4 Announce Type: replace-cross Abstract: We present an approach for estimating the fraction of text in a large corpus which is likely…