Adaptive Graph Harness Optimization for LLM Agents
Writes a coding agent’s harness as a graph and finds that an enforced test check with feedback and bounded retries raises bug-repair rates by 14 to 24 points when tests are visible, while no graph helps when they are hidden. On 232 held-out tasks the check was confirmed (+6.5 points over the plain loop), and the graph returned by a search over 3,600 graphs showed no demonstrated additional benefit (+0.6 points, 95% interval −1.3 to 2.8). Next: graphs that write and enforce their own check when no tests are given.
