New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
Gemini 1.5 Flash (Sep 2024)
About Gemini 1.5 Flash (Sep 2024)
Gemini 1.5 Flash (Sep 2024) is an AI model developed by Google DeepMind, in the multimodal category, released in 2024, made available as a proprietary (API-only) model.
On this page you'll find Gemini 1.5 Flash (Sep 2024)'s full specifications, including 16 benchmark results. Review provider pricing and benchmark scores below, or compare Gemini 1.5 Flash (Sep 2024) head-to-head with other multimodal models.
Links
Community
No reports yet. Own this model on some hardware? Be the first to confirm it runs.
No comments yet. Start the discussion.
Gemini 1.5 Flash (Sep 2024) benchmark scores▶
| Benchmark | Category | Score | Variant |
|---|---|---|---|
| HumanEval | code | 74.4% | cited-phi35moe |
| MBPP | code | 77.5% | cited-phi35moe |
| ArenaHard | general | 55.2% | cited-phi35moe |
| MMLU | general | 78.7% | cited-phi35moe |
| MMLU-Pro | general | 57.2% | cited-phi35moe |
| MMMLU | general | 77.2% | cited-phi35moe |
| ARC-Challenge | knowledge | 92.8 | cited-phi35moe |
| GSM8K | math | 82.4% | cited-phi35moe |
| MATH | math | 38% | cited-phi35moe |
| MGSM | math | 75.8 | cited-phi35moe |
| BIG-Bench Hard | reasoning | 66.7% | cited-phi35moe |
| GPQA Diamond | reasoning | 37.5% | cited-phi35moe |
| HellaSwag | reasoning | 67.5 | cited-phi35moe |
| PIQA | reasoning | 87.5 | cited-phi35moe |
| Winogrande | reasoning | 74.7 | cited-phi35moe |
| TruthfulQA | safety | 76.6% | cited-phi35moe |
More models like Gemini 1.5 Flash (Sep 2024)
Frequently asked questions
What is Gemini 1.5 Flash (Sep 2024)? ▶
Gemini 1.5 Flash (Sep 2024) is an AI model developed by Google DeepMind, in the multimodal category, released in 2024. It is tracked on GenAIList with its specifications, benchmark scores and provider pricing.
Who created Gemini 1.5 Flash (Sep 2024)? ▶
Gemini 1.5 Flash (Sep 2024) was developed by Google DeepMind and released in 2024.
Is Gemini 1.5 Flash (Sep 2024) open source or proprietary? ▶
Gemini 1.5 Flash (Sep 2024) is a proprietary model. It is accessed through an API rather than by downloading the weights.
How much does Gemini 1.5 Flash (Sep 2024) cost? ▶
Pricing for Gemini 1.5 Flash (Sep 2024) depends on the provider. See the providers table on this page for the latest API rates.
How does Gemini 1.5 Flash (Sep 2024) perform on benchmarks? ▶
Gemini 1.5 Flash (Sep 2024) is benchmarked across 16 evaluations on GenAIList, including HumanEval (74.4%). See the full benchmark table below and compare it with other models.
No videos yet. Know a good one? Add it below.
Know a great video about Gemini 1.5 Flash (Sep 2024)?
Add YouTube Video
Add Tweet/Discussion
Report an Issue
Help us maintain accurate information in our database.
Suggest an Edit
Tell us what needs to be changed or corrected for