// COMPARISON

Aria

A head-to-head benchmark comparison of Aria across 6 evaluations.

The models

Multimodal Open (Restricted)
Params
24.9B
Context
β€”
Released
Oct 2024

Information comes in diverse modalities. Multimodal native AI models are essential to integrate real-world information and deliver comprehensive understanding. .

Full Aria specs β†’

Benchmark comparison

Benchmark Aria
general
MMLU 73.3%
math
MATH 50.8%
multimodal
ChartQA 86.4%
DocVQA 92.600
MMMU 54.9%
MathVista 66.1%

Best result per row highlighted in cyan. Each benchmark links to its definition and sources; each model links to its full scorecard.

Frequently asked questions

How many benchmarks are compared? β–Ά

This comparison covers 6 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.