SWE-bench Verified Stopped Being a Frontier Coding Metric

2026-02-24

SWE-bench Verified no longer reliably measures frontier coding progress because many tasks have flawed tests that rejected correct fixes and because benchmark contamination has made training exposure a significant factor in scores.