In August, Luu found that asking GPT-5.6 Sol to use a named technique such as TDD or QuickCheck mostly made results worse than giving no testing instruction. He reran the eval with GPT-6 Astra.
In the News: November 17, 2026 (Extra 2)
Dan Luu's $90k eval suggests test instructions now help GPT-6 Astra, and the Claude Code team explains how it keeps its checks honest.
Extra edition
Machine-readable
Download Markdown
Story
Telling agents how to test now seems to help, on a harder task
Read story →
Story
The Claude Code team keeps its checks out of reach of the changes they judge
Osmani writes that about 90% of the team's code is written and reviewed by Claude, and describes the gates that make that workable. Code Review reads REVIEW.md from the base branch, never from the pull request, because "If a change can…
Story
Anthropic cuts its disclosure window to 30 days for serious bugs
For vulnerabilities Anthropic reports on or after January 1, 2027, the disclosure window drops from 90 days to 30 for high- and critical-severity issues and to 45 for all others. Escalation to an external coordinator when a maintainer…