让AI Agent自动互相攻击，发现生产环境漏洞，这篇论文提出了全新的自动化红队测试框架。
arXiv:2607.11698v1 Announce Type: cross Abstract: Production LLM agents such as Claude Code and Codex operate over untrusted content, files, commands,…
深入探索Promptfoo工具，让QA工程师像测试传统软件一样高效测试LLM，附赠完整手册。
Want the full 46-page handbook? Promptfoo for QA: The Complete Engineer's Handbook (2026 Edition) by Himanshu Agarwal covers everything below in produ…
AI成本工具定价表仅依赖一个jq测试，历史价格被覆盖导致费用计算错误，点明数据管理隐患。
Most tools that tell you what your AI usage costs work the same way: count tokens locally, multiply by a shared price table. For most of the ecosystem…
用YAML脚本自动化测试MCP服务器，无需LLM参与，支持确定性回放和场景验证。
Hi all. As someone who has spent years working with Ansible and other automation frameworks, the recent MCP boom has me fascinated. People are creatin…
提出MORTAR框架，用蜕变测试自动化生成多轮对话用例，精准检测LLM对话系统的不一致行为。
arXiv:2412.15557v4 Announce Type: replace-cross Abstract: With the widespread application of LLM-based dialogue systems in daily life, quality assuran…
自动化诊断大模型失败原因的新框架，用原理性方法定位LLM错误根源。
arXiv:2602.12966v2 Announce Type: replace Abstract: Understanding how and why large language models (LLMs) fail is becoming a central challenge as mod…
HN社区热议CI管道中用于测试的临时邮箱方案，Mailhog、Mailtrap等工具优劣势对比
Testing auth flows (password resets, magic links, email verification) always requires a real inbox. Curious what the HN crowd is actually using. Mailh…
AI如何颠覆软件测试？揭秘自动化测试新纪元。
Article URL: https://antirez.com/news/168 Comments URL: https://news.ycombinator.com/item?id=48433351 Points: 9 # Comments: 3
零缺陷不是吹的！AI结对编程工具peers新版上线，50000随机测试无bug。
Article URL: https://github.com/c0decave/peers Comments URL: https://news.ycombinator.com/item?id=48422239 Points: 1 # Comments: 0
用AI模拟不同用户角色，在本地URL上自动跑UX测试，省时又高效
Article URL: https://smck.ai/ Comments URL: https://news.ycombinator.com/item?id=48425088 Points: 2 # Comments: 0
用LLM模拟真实用户评估UI/UX，自动生成人类对齐反馈，大幅降低人工测试成本。
arXiv:2606.05697v1 Announce Type: new Abstract: User interface (UI) and user experience (UX) evaluation is central to product development, yet reliabl…
主打真实可用的AI软件测试系统，一键自动化测试，提升开发效率。
Article URL: https://ytest.ai/ Comments URL: https://news.ycombinator.com/item?id=48360242 Points: 3 # Comments: 0
每份PR自动生成手动测试用例，安全轻量不泄露源码，免费每月5次
Article URL: https://qaonfire.dev Comments URL: https://news.ycombinator.com/item?id=48366770 Points: 1 # Comments: 0
Java程序的「无头浏览器」，支持自动化测试与网页抓取，即将添加HTTP/2支持，开源且稳定。
The biggest change: JDK 17 is now the minimum required version. Other highlights: JavaScript Engine got major improvements (e.g. RegExp; Scope handlin…
用自动化自测作为质量门控，实现LLM应用证据驱动的发布管理，论文提出系统方法与实证数据。
arXiv:2603.15676v2 Announce Type: replace-cross Abstract: LLM applications are AI systems whose nondeterministic outputs and evolving model behavior m…
用并行AI代理自动优化技术文档，让文档质量从“人能看懂”升级到“智障级代理也能完成任务”。
It’s well known at this point that documentation needs to be optimized for AI agents - we’re all pointing our Claude Code / Codex / Pi agents at docum…
OpenAI发布Codex系统卡附录，详解专为软件工程优化的o3变体，强化学习驱动自动化编码与测试。
Codex is a cloud-based coding agent. Codex is powered by codex-1, a version of OpenAI o3 optimized for software engineering. codex-1 was trained using…