// COMPARISON

o1

A head-to-head benchmark comparison of o1 across 10 evaluations.

The models

Language Proprietary
Params
β€”
Context
β€”
Released
Dec 2024

We've developed a new series of AI models designed to spend more time thinking before they respond. They can reason through complex tasks and solve harder probl.

Full o1 specs β†’

Benchmark comparison

Benchmark o1
code
Codeforces Elo 1,891
LiveCodeBench v5 63.4%
math
AIME 2024 74.6%
AIME 2025 71.4%
HMMT February 2025 48.3%
MATH-500 94.8%
Omni-MATH 67.5
multimodal
MMMU 77.3%
MathVista 71%
reasoning
GPQA Diamond 77.3%

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

Which of these models is best for coding? β–Ά

o1 has the strongest result on Codeforces Elo among the models compared here. See the code-category rows in the table for the full picture.

How many benchmarks are compared? β–Ά

This comparison covers 10 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.