// COMPARISON

Qwen2-1.5B

A head-to-head benchmark comparison of Qwen2-1.5B across 13 evaluations.

The models

Language Open (Restricted)
Params
1.5B
Context
β€”
Released
Jun 2024

This report introduces the Qwen2 series, the latest addition to our large language models and large multimodal models. We release a comprehensive suite of found.

Full Qwen2-1.5B specs β†’

Benchmark comparison

Benchmark Qwen2-1.5B
code
HumanEval 31.1%
MBPP 37.4%
general
C-Eval 70.6%
MMLU 56.5%
MMLU-Pro 21.8%
knowledge
ARC-Challenge 43.9
CMMLU 70.3
math
GSM8K 58.5%
MATH 21.7%
reasoning
BIG-Bench Hard 37.2%
HellaSwag 66.6
Winogrande 66.2
safety
TruthfulQA 45.9%

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

Which of these models is best for coding? β–Ά

Qwen2-1.5B has the strongest result on HumanEval among the models compared here. See the code-category rows in the table for the full picture.

How many benchmarks are compared? β–Ά

This comparison covers 13 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.