file2markdown
AI & LLMs

Why we no longer evaluate SWE-bench Verified

Feb 23, 2026OpenAI Blog

SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.

Read full article