New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
GPT-4o (Nov 2024)
About GPT-4o (Nov 2024)
GPT-4o (Nov 2024) is an AI model developed by OpenAI, in the multimodal category, released in 2024, made available as a proprietary (API-only) model.
On this page you'll find GPT-4o (Nov 2024)'s full specifications, including 22 benchmark results. Review provider pricing and benchmark scores below, or compare GPT-4o (Nov 2024) head-to-head with other multimodal models.
Links
Community
No reports yet. Own this model on some hardware? Be the first to confirm it runs.
No comments yet. Start the discussion.
GPT-4o (Nov 2024) benchmark scores▶
| Benchmark | Category | Score | Variant |
|---|---|---|---|
| HumanEval | code | 97% | pass@10-cited-tulu3 |
| HumanEval | code | 90.2% | cited-minimax-text |
| HumanEval+ | code | 92.7% | pass@10-cited-tulu3 |
| MBPP+ | code | 76.2% | plus-cited-minimax-text |
| AlpacaEval 2 | general | 65% | lc-win-cited-tulu3 |
| ArenaHard | general | 92.4% | cited-minimax-text |
| IFEval | general | 84.8% | cited-tulu3 |
| IFEval | general | 84.1% | avg-cited-minimax-text |
| MMLU | general | 87.9% | cited-tulu3 |
| MMLU | general | 85.7% | cited-minimax-text |
| MMLU-Pro | general | 74.4% | cited-minimax-text |
| AIME 2024 | math | 16.7% | cited-oreal |
| GSM8K | math | 95.6% | cited-minimax-text |
| GSM8K | math | 91.7% | cited-tulu3 |
| MATH | math | 76.6% | cited-minimax-text |
| MATH | math | 68.8% | cited-tulu3 |
| MATH-500 | math | 72.8% | cited-oreal |
| BIG-Bench Hard | reasoning | 83.3% | cited-tulu3 |
| DROP | reasoning | 89.2% | f1-cited-minimax-text |
| GPQA Diamond | reasoning | 46% | diamond-cited-minimax-text |
| C-SimpleQA | safety | 64.6% | cited-minimax-text |
| SimpleQA | safety | 39% | cited-minimax-text |
More models like GPT-4o (Nov 2024)
Frequently asked questions
What is GPT-4o (Nov 2024)? ▶
GPT-4o (Nov 2024) is an AI model developed by OpenAI, in the multimodal category, released in 2024. It is tracked on GenAIList with its specifications, benchmark scores and provider pricing.
Who created GPT-4o (Nov 2024)? ▶
GPT-4o (Nov 2024) was developed by OpenAI and released in 2024.
Is GPT-4o (Nov 2024) open source or proprietary? ▶
GPT-4o (Nov 2024) is a proprietary model. It is accessed through an API rather than by downloading the weights.
How much does GPT-4o (Nov 2024) cost? ▶
Pricing for GPT-4o (Nov 2024) depends on the provider. See the providers table on this page for the latest API rates.
How does GPT-4o (Nov 2024) perform on benchmarks? ▶
GPT-4o (Nov 2024) is benchmarked across 22 evaluations on GenAIList, including HumanEval (97%). See the full benchmark table below and compare it with other models.
No videos yet. Know a good one? Add it below.
Know a great video about GPT-4o (Nov 2024)?
Add YouTube Video
Add Tweet/Discussion
Report an Issue
Help us maintain accurate information in our database.
Suggest an Edit
Tell us what needs to be changed or corrected for