Google DeepMind
Google DeepMind
Language model · United States ·Feb 2024

Gemma 7B

Language Open (Restricted)
8.5B
Parameters
19
Benchmarks

About Gemma 7B

Gemma 7B is an AI model developed by Google DeepMind, in the language category, released in 2024, made available as an open-weights model with 8.5B params.

On this page you'll find Gemma 7B's full specifications, including 19 benchmark results. Review provider pricing and benchmark scores below, or compare Gemma 7B head-to-head with other language models.

Links

Run Gemma 7B locally — what to buy

Share this build ↗

Sized to what Gemma 7B actually needs (~8k context at Q4), not to the biggest GPU: Good = cheapest that runs it, Better = best value, Best = most headroom. Speed is a hardware estimate; anything past ~120 tok/s is shown as instant.

Software support

✓ measured · · compatible · — not supported. Informational only — speed is hardware-based.

Community

Would you run Gemma 7B again?
No votes yet — be the first.
Did it run? — community reports by hardware

No reports yet. Own this model on some hardware? Be the first to confirm it runs.

Discussion

No comments yet. Start the discussion.

Gemma 7B benchmark scores
Benchmark Category Score Variant
HumanEval code 37.2% base-cited-qwen2-7b
MBPP code 50.6% base-cited-qwen2-7b
C-Eval general 43.6% base-cited-qwen2-7b
IFEval general 26.59% cited-falcon-mamba
MMLU general 64.6% base-cited-qwen2-7b
MMLU general 64.56% cited-falcon-mamba
MMLU-Pro general 33.7% base-cited-qwen2-7b
MMLU-Pro general 21.64% cited-falcon-mamba
ARC-Challenge knowledge 61.09 cited-falcon-mamba
GSM8K math 50.87% cited-falcon-mamba
GSM8K math 46.4% base-cited-qwen2-7b
MATH math 24.3% base-cited-qwen2-7b
BIG-Bench Hard reasoning 55.1% base-cited-qwen2-7b
BIG-Bench Hard reasoning 21.12% cited-falcon-mamba
GPQA Diamond reasoning 25.7% base-cited-qwen2-7b
GPQA Diamond reasoning 4.92% cited-falcon-mamba
HellaSwag reasoning 82.2 cited-falcon-mamba
Winogrande reasoning 79.01 cited-falcon-mamba
TruthfulQA safety 44.79% cited-falcon-mamba

More models like Gemma 7B

Frequently asked questions

What is Gemma 7B?

Gemma 7B is an AI model developed by Google DeepMind, in the language category, released in 2024. It is tracked on GenAIList with its specifications, benchmark scores and provider pricing.

Who created Gemma 7B?

Gemma 7B was developed by Google DeepMind and released in 2024.

Is Gemma 7B open source or proprietary?

Gemma 7B ships as an open-weights model: you can download and self-host the weights, though the licence may place some restrictions on use.

How much does Gemma 7B cost?

Pricing for Gemma 7B depends on the provider. See the providers table on this page for the latest API rates.

How does Gemma 7B perform on benchmarks?

Gemma 7B is benchmarked across 19 evaluations on GenAIList, including HumanEval (37.2%). See the full benchmark table below and compare it with other models.

No videos yet. Know a good one? Add it below.

Know a great video about Gemma 7B?