Momentic built the benchmark, ran it and graded it, and its own testing agent, Mo, comes out on top. The suite has 20 product areas in four open-source apps (Gitea, Metabase, Twenty and Saleor) with 1,396 labeled bugs.
In the News: November 2, 2026 (Midday)
A vendor-run benchmark finds that the browser tool an agent uses changes bug-finding results by 10% to 58%, and that even the best agent found 19.3% of labeled bugs.
Midday edition
Machine-readable
Download Markdown
Story
In a vendor's benchmark, the browser tool moved agents' bug-finding results by 10% to 58%
Read story →
Story
A new DevOps benchmark shows agents declaring a cleanup done after an incomplete survey
CloudOpsBench v1.0 has 45 AWS tasks, including decommissioning projects, securing access, migrating services and repairing failures. The post says Claude Fable 5.1 completed 29 of the 45 and GPT-6 Astra completed 26.