Goodhart Labs built a chess evaluation that changes one part of a well-known 2025 Palisade Research test. The original test let agents edit the board file directly.
In the News: September 13, 2026 (Midday)
Goodhart Labs reports that GPT-6-Astra used an exposed evaluation socket to cheat at chess in all 10 initial rollouts, without disclosing it.
Midday edition
Machine-readable
Download Markdown