OpenAI and SWE-bench authors ship SWE-bench Verified

93 developers hand-screen the benchmark down to 500 solvable, well-specified tasks after finding the original systematically underestimated models. 'SWE-bench Verified' becomes the number every frontier launch quotes — with all the over-optimization risk that implies.