Runta ran 22 harness configurations against five open models served by Baseten, on 62 terminal tasks with four attempts each: 27,280 runs and 83 billion tokens. Each model had a different best-value harness.
In the News: November 17, 2026 (Midday)
Runta's 27,280-run benchmark finds the best-value coding harness changes with the model, and GPT-6.2 reaches Codex with a blocker-reporting caveat.
Midday edition
Machine-readable
Download Markdown
Story
The best harness depends on the model, says a 27,280-run benchmark
Read story →
Story
GPT-6.2 Astra and Sol reach Codex, with a blocker-reporting caveat
Both models are available from today in ChatGPT Work, Codex and the API. Astra's API prices are $8 per million input tokens, $0.40 for cached input and $40 for output: 20% below GPT-6 Astra, with a 60% discount on cached input.