// COMPARISON

Nemotron-4 340B

A head-to-head benchmark comparison of Nemotron-4 340B across 5 evaluations.

The models

Language Open (Restricted)
Params
340B
Context
β€”
Released
Jun 2024

We release the Nemotron-4 340B model family, including Nemotron-4-340B-Base, Nemotron-4- 340B-Instruct, and Nemotron-4-340B-Reward. Our models are open access u.

Full Nemotron-4 340B specs β†’

Benchmark comparison

Benchmark Nemotron-4 340B
code
HumanEval 73.2%
MBPP 75.4%
general
ArenaHard 54.2%
MMLU 78.7%
math
GSM8K 92.3%

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

Which of these models is best for coding? β–Ά

Nemotron-4 340B has the strongest result on HumanEval among the models compared here. See the code-category rows in the table for the full picture.

How many benchmarks are compared? β–Ά

This comparison covers 5 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.