// COMPARISON

Qwen2.5-1.5B

A head-to-head benchmark comparison of Qwen2.5-1.5B across 4 evaluations.

The models

Language Open (Restricted)
Params
1.5B
Context
β€”
Released
Sep 2024

In the past three months since Qwen2’s release, numerous developers have built new models on the Qwen2 language models, providing us with valuable feedback. Dur.

Full Qwen2.5-1.5B specs β†’

Benchmark comparison

Benchmark Qwen2.5-1.5B
general
AlpacaEval 2 8.4%
ArenaHard 10.6%
IFEval 40.7%
LiveBench 19.2

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

How many benchmarks are compared? β–Ά

This comparison covers 4 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.