// BENCHMARK

MATH benchmark

AI model leaderboard for the MATH benchmark. Compare how large language models score on MATH, see the full ranking, and understand what this AI benchmark measures. DeepSeek-V3 currently leads with 89.7%. 12,500 high-school competition math problems with step-by-step solutions.

Leaderboard

# Model Organization Score Variant Source
#1 DeepSeek-V3 DeepSeek 89.7% EM official โ†—
#2 dots.llm1 Rednote 85% EM official โ†—
#3 DeepSeek-V3 DeepSeek 84.6% cited-minimax-text official โ†—
#4 Gemini 1.5 Pro Google DeepMind 84.6% 002-cited-minimax-text official โ†—
#5 Gemini 2.0 Flash Google DeepMind 83.9% exp-cited-minimax-text official โ†—
#6 Qwen2.5 Instruct (72B) Qwen 81.8% instruct-cited-minimax-text official โ†—
#7 MiniMax-Text-01 MiniMax 77.4% from-hf-readme official โ†—
#8 GPT-4o (Nov 2024) OpenAI 76.6% cited-minimax-text official โ†—
#9 GPT-4 (Jun 2023) OpenAI 76.6% cited-nvlm official โ†—
#10 Qwen2.5 Instruct (72B) Qwen 74.3% instruct-cited-tulu3 official โ†—
#11 Claude 3.5 Sonnet Anthropic 74.1% 1022-cited-minimax-text official โ†—
#12 Llama 3.1-405B Meta AI 73.8% instruct-cited-minimax-text official โ†—
#13 Gemma 4 31B Google DeepMind 73.8% official โ†—
#14 Llama 3.1-405B Meta AI 73.8% instruct-cited-nvlm official โ†—
#15 NVLM-D 72B NVIDIA 73.1% megatron-from-hf-readme official โ†—
#16 DeepSeek-V3 DeepSeek 72.5% cited-tulu3 official โ†—
#17 Claude 3.5 Sonnet Anthropic 71.1% cited-nvlm official โ†—
#18 GPT-4o mini OpenAI 70.2% cited-phi35moe official โ†—
#19 GPT-4o mini OpenAI 70.2% cited-aria official โ†—
#20 Mistral Small 3.2 Mistral AI 69.42% instruct-from-hf-readme official โ†—
#21 Mistral Small 3.1 Mistral AI 69.3% instruct-cited-msmall32 official โ†—
#22 GPT-4o (Nov 2024) OpenAI 68.8% cited-tulu3 official โ†—
#23 Llama 3.1-70B Meta AI 68% instruct-cited-nvlm official โ†—
#24 Gemini 1.5 Pro Google DeepMind 67.7% aug-2024-cited-nvlm official โ†—
#25 Tulu 3 405B Allen Institute for AI 67.3% instruct-4-shot-flex official โ†—
#26 Llama 3.1-405B Meta AI 66.6% instruct-cited-tulu3 official โ†—
#27 Phi-4 Mini Microsoft 64% instruct-0-shot-cot official โ†—
#28 Qwen2.5-3B Qwen 61.7% cited-phi4-mini official โ†—
#29 Qwen2.5-7B Qwen 60.4% cited-phi4-mini official โ†—
#30 Qwen-72B Qwen 59.7% instruct-cited-nvlm official โ†—
#31 Phi-3.5-MoE Microsoft 59.5% instruct-0-shot-cot official โ†—
#32 Nemotron-H 56B NVIDIA 59.42% base-4-shot-cot official โ†—
#33 Hermes 3 405B Nous Research 58.4% cited-tulu3 official โ†—
#34 Nemotron-H 47B NVIDIA 57.4% base-4-shot-cot official โ†—
#35 Llama 3.1-70B Meta AI 56.4% instruct-cited-tulu3 official โ†—
#36 Llama 3.2 11B Meta AI 51.9% cited-aria official โ†—
#37 Llama 3-70B Meta AI 51% instruct-cited-nvlm official โ†—
#38 Gemma 2 9B Google DeepMind 50.9% instruct-cited-phi35moe official โ†—
#39 Aria Rhymes AI 50.8% from-hf-readme official โ†—
#40 phi-3.5-mini Microsoft 49.8% cited-phi4-mini official โ†—
#41 Pixtral 12B Mistral AI 48.1% cited-aria official โ†—
#42 Llama 3.1-8B Meta AI 47.6% instruct-cited-phi35moe official โ†—
#43 Llama 3.2 3B Meta AI 46.7% cited-phi4-mini official โ†—
#44 Nemotron-H 8B NVIDIA 46.52% base-4-shot-cot official โ†—
#45 Qwen2-7B Qwen 44.2% base-from-hf-readme official โ†—
#46 Tulu 3 8B Allen Institute for AI 43.7% instruct-4-shot-cot-flex official โ†—
#47 Qwen2-57B-A14B Qwen 43% base-from-hf-readme official โ†—
#48 Llama 3.1-8B Meta AI 42.5% instruct-cited-tulu3 official โ†—
#49 Hermes 3 70B Nous Research 41.9% cited-tulu3 official โ†—
#50 Ministral 8B Mistral AI 41.8% cited-phi4-mini official โ†—
#51 Yi-1.5-34B 01.AI 41.7% cited-qwen2-57b official โ†—
#52 Gemini 1.5 Flash (Sep 2024) Google DeepMind 38% cited-phi35moe official โ†—
#53 Qwen1.5-32B Qwen 36.1% cited-qwen2-57b official โ†—
#54 Mistral NeMo Mistral AI 31.2% instruct-cited-phi35moe official โ†—
#55 Mixtral 8x7B Mistral AI 30.8% cited-qwen2-57b official โ†—
#56 Gemma 2 9B Google DeepMind 29.8% instruct-cited-tulu3 official โ†—
#57 Gemma 7B Google DeepMind 24.3% base-cited-qwen2-7b official โ†—
#58 Nous-Hermes-2-Yi-34B Nous Research 21.8% cited-nvlm official โ†—
#59 Qwen2-1.5B Qwen 21.7% base-from-hf-readme official โ†—
#60 Llama 3-8B Meta AI 20.5% base-cited-qwen2-7b official โ†—
#61 Qwen1.5-7B Qwen 20.3% base-cited-qwen2-7b official โ†—
#62 Mistral 7B Mistral AI 13.1% base-cited-qwen2-7b official โ†—
#63 Gemma 2B Google DeepMind 11.8% cited-qwen2 official โ†—
#64 Qwen2-0.5B Qwen 10.7% base-from-hf-readme official โ†—
#65 Phi-2 Microsoft 3.5% cited-qwen2 official โ†—

Frequently asked questions about MATH

What is the MATH benchmark?

12,500 high-school competition math problems with step-by-step solutions.

How is the MATH benchmark scored?

MATH is scored using the accuracy (%) metric, where a higher score is better. The maximum achievable score is 100.000. GenAIList aggregates reported scores from model providers and papers into a single ranked leaderboard.

Which AI model scores highest on MATH?

As of the latest reported scores on GenAIList, DeepSeek-V3 achieves the highest result on MATH with a score of 89.7%.

Is a higher MATH score better?

Yes. On MATH a higher score indicates better performance, so models near the top of the leaderboard are the strongest.