
AI coding agents ace isolated tests but complete fewer than one in ten tasks in simulated workplace
A new experiment places AI coding agents in a simulated software company where they must handle messy, ongoing development work. Even advanced models such as Claude Opus 5.5 and GPT-6 Astra fully complete fewer than one in ten tasks, despite high scores on standard benchmarks.