'Debunking Devin': the demo doesn't survive scrutiny

In April 2024, engineer Carl Brown's frame-by-frame teardown shows Devin's flagship Upwork demo solved a task the client never asked for, partly fixing errors it created itself, in six hours versus 36 minutes by hand. The episode teaches practitioners to demand receipts from agent demos — a lesson the industry re-learns repeatedly.