Stripe ran 69 integration scenarios (one-time payments, subscriptions and Connect) on 14 model and harness pairs across Claude Code, Codex and OpenCode, each with and without its own agent plugin. A second agent plays the developer.
In the News: November 20, 2026 (Extra)
Stripe tested 14 coding agents on 69 integration tasks. Their 78.1% average score falls to 29.4% when every required criterion must pass.
Extra edition
Machine-readable
Download Markdown
Story
Stripe's coding-agent eval: 78.1% on average, 29.4% when every required check must pass
Read story →
Story
Architect Labs used a formal spec as the single source of truth for an agent swarm designing a CPU
Architect Labs says its agents iterated over the compiler, instruction set, microarchitecture, RTL, verification and final GDS layout of a new CPU built on interaction nets. The first specification was a 141-page PDF.