// COMPARISON

FFN SwiGLU

A head-to-head benchmark comparison of FFN SwiGLU across 0 evaluations.

The models

Language Proprietary
Params
220M
Context
β€”
Released
Feb 2020

Gated Linear Units (arXiv:1612.08083) consist of the component-wise product of two linear projections, one of which is first passed through a sigmoid function. .

Full FFN SwiGLU specs β†’

Benchmark comparison

No shared benchmark scores found for these models yet.

Frequently asked questions

How many benchmarks are compared? β–Ά

This comparison covers 0 benchmarks on which at least one of the selected models has a published score.

Where do the benchmark scores come from? β–Ά

Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.

Explore further

Build a different comparison

Models (0 selected)

Benchmarks (auto)

Select at least two models.