New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
SWE-bench benchmark
AI model leaderboard for the SWE-bench benchmark. Compare how large language models score on SWE-bench, see the full ranking, and understand what this AI benchmark measures. Real GitHub issues from popular Python repos that the model must resolve with a multi-file patch.
Leaderboard
No model scores reported yet.
Frequently asked questions about SWE-bench
What is the SWE-bench benchmark?
Real GitHub issues from popular Python repos that the model must resolve with a multi-file patch.
How is the SWE-bench benchmark scored?
SWE-bench is scored using the resolved (%) metric, where a higher score is better. The maximum achievable score is 100.000. GenAIList aggregates reported scores from model providers and papers into a single ranked leaderboard.
Which AI model scores highest on SWE-bench?
No model scores have been reported for SWE-bench yet. Check back as the leaderboard is updated.
Is a higher SWE-bench score better?
Yes. On SWE-bench a higher score indicates better performance, so models near the top of the leaderboard are the strongest.