The authors built a measurement they call CTXGAP. For each coding task they ask the same questions about what happened (failed attempts, workarounds, residual risks) of a reader who sees only the agent's accumulated reports and of a…
In the News: October 17, 2026 (Midday)
A Tencent study finds coding-agent reports let a reader recover 52.0% of task state, against 92.7% from the full execution record.
Midday edition
Machine-readable
Download Markdown
Story
Coding-agent reports leave a 40.7-point gap in what a supervisor can recover
Read story →
Story
Across 40 matched setups, interventions changed speedup twice but token cost by up to 3.0 times
HPCAgent-Bench has 689 kernels for testing agents that optimize code for speed. An external judge checks correctness on hidden fuzzed inputs and times every submission, so an agent cannot report its own results.