New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
Gemini 1.5 Pro
About Gemini 1.5 Pro
Gemini 1.5 Pro is an AI model developed by Google DeepMind, in the language category, released in 2024, made available as a proprietary (API-only) model.
On this page you'll find Gemini 1.5 Pro's full specifications, including 25 benchmark results. Review provider pricing and benchmark scores below, or compare Gemini 1.5 Pro head-to-head with other language models.
Links
Community
No reports yet. Own this model on some hardware? Be the first to confirm it runs.
No comments yet. Start the discussion.
Gemini 1.5 Pro benchmark scores▶
| Benchmark | Category | Score | Variant |
|---|---|---|---|
| HumanEval | code | 86.6% | 002-cited-minimax-text |
| HumanEval | code | 84.1% | aug-2024-cited-nvlm |
| MBPP+ | code | 75.4% | 002-plus-cited-minimax-text |
| ArenaHard | general | 85.3% | 002-cited-minimax-text |
| ArenaHard | general | 72% | cited-athene |
| IFEval | general | 89.4% | 002-avg-cited-minimax-text |
| MMLU | general | 86.8% | 002-cited-minimax-text |
| MMLU | general | 85.9% | aug-2024-cited-nvlm |
| MMLU-Pro | general | 75.8% | 002-cited-minimax-text |
| GSM8K | math | 95.2% | 002-cited-minimax-text |
| GSM8K | math | 90.8% | aug-2024-cited-nvlm |
| MATH | math | 84.6% | 002-cited-minimax-text |
| MATH | math | 67.7% | aug-2024-cited-nvlm |
| ChartQA | multimodal | 87.2% | aug-2024-cited-nvlm |
| ChartQA | multimodal | 83.8% | cot-cited-pixtral-large |
| DocVQA | multimodal | 93.100 | aug-2024-cited-nvlm |
| DocVQA | multimodal | 92.300 | anls-cited-pixtral-large |
| MMMU | multimodal | 66.3% | cot-cited-pixtral-large |
| MMMU | multimodal | 62.2% | val-aug-2024-cited-nvlm |
| MathVista | multimodal | 67.8% | cot-cited-pixtral-large |
| MathVista | multimodal | 63.9% | aug-2024-cited-nvlm |
| DROP | reasoning | 89.2% | 002-f1-cited-minimax-text |
| GPQA Diamond | reasoning | 59.1% | 002-diamond-cited-minimax-text |
| C-SimpleQA | safety | 59.4% | 002-cited-minimax-text |
| SimpleQA | safety | 23.4% | 002-cited-minimax-text |
More models like Gemini 1.5 Pro
Frequently asked questions
What is Gemini 1.5 Pro? ▶
Gemini 1.5 Pro is an AI model developed by Google DeepMind, in the language category, released in 2024. It is tracked on GenAIList with its specifications, benchmark scores and provider pricing.
Who created Gemini 1.5 Pro? ▶
Gemini 1.5 Pro was developed by Google DeepMind and released in 2024.
Is Gemini 1.5 Pro open source or proprietary? ▶
Gemini 1.5 Pro is a proprietary model. It is accessed through an API rather than by downloading the weights.
How much does Gemini 1.5 Pro cost? ▶
Pricing for Gemini 1.5 Pro depends on the provider. See the providers table on this page for the latest API rates.
How does Gemini 1.5 Pro perform on benchmarks? ▶
Gemini 1.5 Pro is benchmarked across 25 evaluations on GenAIList, including HumanEval (86.6%). See the full benchmark table below and compare it with other models.
No videos yet. Know a good one? Add it below.
Know a great video about Gemini 1.5 Pro?
Add YouTube Video
Add Tweet/Discussion
Report an Issue
Help us maintain accurate information in our database.
Suggest an Edit
Tell us what needs to be changed or corrected for