// COMPARISON

Qwen1.5-7B

A head-to-head benchmark comparison of Qwen1.5-7B across 10 evaluations.

The models

Language Open (Restricted)
Params
7B
Context
β€”
Released
Feb 2024

Qwen1.5 is the beta version of Qwen2, a transformer-based decoder-only language model pretrained on a large amount of data. In comparison with the previous rele.

Full Qwen1.5-7B specs β†’

Benchmark comparison

Benchmark Qwen1.5-7B
code
HumanEval 36%
MBPP 51.6%
general
C-Eval 74.1%
MMLU 61%
MMLU-Pro 29.9%
knowledge
CMMLU 73.1
math
GSM8K 62.5%
MATH 20.3%
reasoning
BIG-Bench Hard 40.2%
GPQA Diamond 26.7%

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

Which of these models is best for coding? β–Ά

Qwen1.5-7B has the strongest result on HumanEval among the models compared here. See the code-category rows in the table for the full picture.

How many benchmarks are compared? β–Ά

This comparison covers 10 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.