// COMPARISON

Llama 3.2 3B

A head-to-head benchmark comparison of Llama 3.2 3B across 16 evaluations.

The models

Language Open (Restricted)
Params
3.2B
Context
β€”
Released
Sep 2024

Today, we’re releasing Llama 3.2, which includes small and medium-sized vision LLMs (11B and 90B), and lightweight, text-only models (1B and 3B) that fit onto e.

Full Llama 3.2 3B specs β†’

Benchmark comparison

Benchmark Llama 3.2 3B
general
AlpacaEval 2 18.7%
ArenaHard 17%
IFEval 70.1%
LiveBench 24
MMLU 61.8%
MMLU-Pro 39.2%
MMMLU 48.1%
knowledge
ARC-Challenge 76.1
math
GSM8K 75.6%
MATH 46.7%
MGSM 44.6
reasoning
BIG-Bench Hard 55.4%
HellaSwag 77.2
PIQA 68.2
Winogrande 53.2
safety
TruthfulQA 59.2%

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

How many benchmarks are compared? β–Ά

This comparison covers 16 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.