OpenAI
OpenAI
Language model · United States ·Jul 2024

GPT-4o mini

Language Proprietary
18
Benchmarks

About GPT-4o mini

GPT-4o mini is an AI model developed by OpenAI, in the language category, released in 2024, made available as a proprietary (API-only) model.

On this page you'll find GPT-4o mini's full specifications, including 18 benchmark results. Review provider pricing and benchmark scores below, or compare GPT-4o mini head-to-head with other language models.

Links

Community

Would you run GPT-4o mini again?
No votes yet — be the first.
Did it run? — community reports by hardware

No reports yet. Own this model on some hardware? Be the first to confirm it runs.

Discussion

No comments yet. Start the discussion.

GPT-4o mini benchmark scores
Benchmark Category Score Variant
HumanEval code 86.6% cited-phi35moe
MBPP code 84.1% cited-phi35moe
ArenaHard general 75% cited-phi35moe
MMLU general 77.2% cited-phi35moe
MMLU-Pro general 62.8% cited-phi35moe
MMMLU general 72.9% cited-phi35moe
ARC-Challenge knowledge 93.5 cited-phi35moe
GSM8K math 91.3% cited-phi35moe
MATH math 70.2% cited-aria
MATH math 70.2% cited-phi35moe
MGSM math 81.7 cited-phi35moe
MMMU multimodal 59.4% cited-aria
BIG-Bench Hard reasoning 80.4% cited-phi35moe
GPQA Diamond reasoning 41.1% cited-phi35moe
HellaSwag reasoning 87.1 cited-phi35moe
PIQA reasoning 88.7 cited-phi35moe
Winogrande reasoning 76.9 cited-phi35moe
TruthfulQA safety 78.2% cited-phi35moe

More models like GPT-4o mini

Frequently asked questions

What is GPT-4o mini?

GPT-4o mini is an AI model developed by OpenAI, in the language category, released in 2024. It is tracked on GenAIList with its specifications, benchmark scores and provider pricing.

Who created GPT-4o mini?

GPT-4o mini was developed by OpenAI and released in 2024.

Is GPT-4o mini open source or proprietary?

GPT-4o mini is a proprietary model. It is accessed through an API rather than by downloading the weights.

How much does GPT-4o mini cost?

Pricing for GPT-4o mini depends on the provider. See the providers table on this page for the latest API rates.

How does GPT-4o mini perform on benchmarks?

GPT-4o mini is benchmarked across 18 evaluations on GenAIList, including HumanEval (86.6%). See the full benchmark table below and compare it with other models.

No videos yet. Know a good one? Add it below.

Know a great video about GPT-4o mini?