Agents Are Files
Like a game console with cartridges, one host runs different agents. Edit their files, turn failures into evals, and keep release checks with the host.
3 posts
Like a game console with cartridges, one host runs different agents. Edit their files, turn failures into evals, and keep release checks with the host.
A follow-up. The under-specification problem in coding agents does not close by writing better specs upfront. Models do not stick to instructions anyway. The gap closes by building better detection: catching deviation cheaply, often, and at the right level of abstraction. The lever is the loop, not the prompt.
Coding agents write impressive first drafts. But under the surface, corners are cut, details are missing, and technical debt accumulates with every change. The problem is not the model. It is that what we ask it to do is fundamentally under-specified.