// COMPARISON

Gemma 2 27B

A head-to-head benchmark comparison of Gemma 2 27B across 4 evaluations.

The models

Language Open (Restricted)
Params
27B
Context
β€”
Released
Jun 2024

Now we’re officially releasing Gemma 2 to researchers and developers globally. Available in both 9 billion (9B) and 27 billion (27B) parameter sizes, Gemma 2 is.

Full Gemma 2 27B specs β†’

Benchmark comparison

Benchmark Gemma 2 27B
general
AlpacaEval 2 52.2%
ArenaHard 57.5%
IFEval 59.7%
LiveBench 40

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

How many benchmarks are compared? β–Ά

This comparison covers 4 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.