// COMPARISON

ST-MoE

A head-to-head benchmark comparison of ST-MoE across 0 evaluations.

The models

Language Proprietary
Params
269B
Context
β€”
Released
Feb 2022

Scale has opened new frontiers in natural language processing -- but at a high cost. In response, Mixture-of-Experts (MoE) and Switch Transformers have been pro.

Full ST-MoE specs β†’

Benchmark comparison

No shared benchmark scores found for these models yet.

Frequently asked questions

How many benchmarks are compared? β–Ά

This comparison covers 0 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.