// COMPARISON

Qwen2-0.5B

A head-to-head benchmark comparison of Qwen2-0.5B across 13 evaluations.

The models

Language Open (Restricted)
Params
500M
Context
β€”
Released
Jun 2024

After months of efforts, we are pleased to announce the evolution from Qwen1.5 to Qwen2. This time, we bring to you: - Pretrained and instruction-tuned models o.

Full Qwen2-0.5B specs β†’

Benchmark comparison

Benchmark Qwen2-0.5B
code
HumanEval 22%
MBPP 22%
general
C-Eval 58.2%
MMLU 45.4%
MMLU-Pro 14.7%
knowledge
ARC-Challenge 31.5
CMMLU 55.1
math
GSM8K 36.5%
MATH 10.7%
reasoning
BIG-Bench Hard 28.4%
HellaSwag 49.3
Winogrande 56.8
safety
TruthfulQA 39.7%

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

Which of these models is best for coding? β–Ά

Qwen2-0.5B has the strongest result on HumanEval among the models compared here. See the code-category rows in the table for the full picture.

How many benchmarks are compared? β–Ά

This comparison covers 13 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.