// COMPARISON

GQA-8-XXL

A head-to-head benchmark comparison of GQA-8-XXL across 0 evaluations.

The models

Language Proprietary
Params
11B
Context
β€”
Released
Dec 2023

Multi-query attention (MQA), which only uses a single key-value head, drastically speeds up decoder inference. However, MQA can lead to quality degradation, and.

Full GQA-8-XXL specs β†’

Benchmark comparison

No shared benchmark scores found for these models yet.

Frequently asked questions

How many benchmarks are compared? β–Ά

This comparison covers 0 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.