A RAG evaluator that admits what it can't judge
RAG评估新思路:能用确定性检查就绝不用LLM判断,无法验证时大胆弃权,杜绝虚假引用蒙混过关。
Fail-closed groundedness, deterministic corroborators, and a self-test — because an evaluator should be more trustworthy than the thing it grades. The…
RAG评估新思路:能用确定性检查就绝不用LLM判断,无法验证时大胆弃权,杜绝虚假引用蒙混过关。
Fail-closed groundedness, deterministic corroborators, and a self-test — because an evaluator should be more trustworthy than the thing it grades. The…
仅凭两组结果集即可确定性判断是否引入回归,30 秒零配置接入 CI,拦截意外失败。
Article URL: https://github.com/tc7kxsszs5-cloud/avera Comments URL: https://news.ycombinator.com/item?id=48596140 Points: 1 # Comments: 0
AI编码代理生成PR时,LLM审查虽有用,但权限提升等关键检查仍需确定性规则,避免安全风险。
AI coding agents are getting better at opening pull requests. That changes the review problem. A normal review asks whether the code looks correct, wh…
一款针对AI生成PR的确定性CI防火墙,确保代码审查安全可靠
Article URL: https://github.com/sjh9714/Agent-Gate Comments URL: https://news.ycombinator.com/item?id=48524230 Points: 1 # Comments: 0
开源工具Equiv提供确定性字节级验证,确保AI重构不改变代码行为,拒绝模型主观判断。
Article URL: https://github.com/Neelagiri65/equiv Comments URL: https://news.ycombinator.com/item?id=48515830 Points: 1 # Comments: 0