Everything We Got Wrong About Research-Plan-Implement · Dex Horthy, HumanLayer · Coding Agents Conference, recorded 3 March 2026, published 24 March 2026
Dex Horthy retracts Research-Plan-Implement
This item is sourced from an auto-generated caption transcript that the Dark Factory video monitor fetched on 6 August and that has not been checked against the audio, so everything below is paraphrase with timestamps rather than quotation. Horthy self-identifies at [1:02] and states at [1:22] that roughly 10,000 people have taken HumanLayer's open-source Research-Plan-Implement prompts, from small startups to enterprises. That figure is first-party and uncorroborated.
The retraction is at [9:18] and [9:26]: he says he was wrong to advise not reading the code, that they tried it for about six months, and that they had to rip out and replace large parts of the resulting system. The diagnosis is an instruction budget. At [7:49] he cites a 2025 paper for a ceiling of roughly 150 to 200 instructions before frontier models stop following them consistently, and notes the number is probably higher now; a single 85-instruction mega prompt plus a CLAUDE.md plus tools plus MCP overruns it, and the steps that made the workflow valuable are the ones silently skipped. His fix at [13:54] is to split one prompt into a sequence of smaller ones. The second reversal, at [8:29] to [9:04], is that reading the plan does not save reading the code: a thousand-line plan produces about a thousand lines of code, plans surprise you, and you read both. He replaces the eight-page plan with a two-page structure outline, compared at [17:38] to a C header file, signatures and new types only. Both the adoption figure and the six-month cost are logged as unverified first-party claims.
Why it matters: Having an author retract a widely-adopted published method, and name the mechanism that made it fail on teams while working for its inventor, is worth more than another argument about whether to read agent output. The instruction budget is a testable constraint: count what your harness actually loads before you add another skill file.