New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
A head-to-head benchmark comparison of o3 across 21 evaluations.
Today, we’re releasing OpenAI o3 and o4-mini, the latest in our o-series of models trained to think for longer before responding. These are the smartest models .
Full o3 specs →| Benchmark | o3 |
|---|---|
| agentic | |
| BrowseComp | 49.7% |
| BrowseComp-Zh | 58.1 |
| TAU-bench Airline | 52% |
| TAU-bench Retail | 70.4% |
| Terminal-Bench 2.0 | 30.2% |
| WebWalkerQA | 71.7 |
| xbench-DeepSearch | 67 |
| code | |
| LiveCodeBench | 78.4% |
| LiveCodeBench v5 | 73.3% |
| SWE-bench Verified | 69.1% |
| SciCode | 41% |
| general | |
| MMLU-Pro | 85.3% |
| long-context | |
| Frames | 84 |
| math | |
| AIME 2024 | 92.26% |
| AIME 2025 | 86.58% |
| HMMT February 2025 | 80.8% |
| MATH-500 | 99.2% |
| Omni-MATH-HARD | 59.39% |
| reasoning | |
| GPQA Diamond | 82.7% |
| Humanity's Last Exam | 24.9% |
| tool-use | |
| BFCL v3 | 72.4% |
Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.
o3 has the strongest result on LiveCodeBench among the models compared here. See the code-category rows in the table for the full picture.
This comparison covers 21 benchmarks on which at least one of the selected models has a published score.
Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.
Help us grow the database! Only the announcement link is required — we'll fetch the rest.
Missing a card? Drop the spec/announcement link — we'll verify the specs and add it. The link is the only required field.
Know an inference runtime we're missing (llama.cpp, vLLM, MLX, ComfyUI…)? Drop the link.
Spotted a wrong spec or an out-of-date price? Tell us and we'll verify it.
We'll send you a login code via email
