The post borrows from psychology's replication reforms and turns them into recommendations, illustrated with examples from Anthropic's system cards. Its central warning is about LLM graders, which it says "can fail without anyone noticing":…
In the News: November 16, 2026 (Extra)
Anthropic's guide to safety evals doubles as a checklist for LLM judges, and reports a 34-point score swing from configuration alone.
Extra edition
Machine-readable
Download Markdown