// RELEASE TIMELINE

Models Released in 2021

Browse every generative AI model released in 2021 — large language models, image generators, code models and more — ordered by release date. Compare their specs and rankings on our benchmarks page, or put any two side by side with compare. See also models from 2020 and models from 2022.

198 models

M6-10T

🇨🇳 Alibaba

Oct 2021 10T
Multimodal Proprietary

AlphaFold-Multimer

🇺🇸 Google DeepMind

Oct 2021
Language Open (Restricted)

Turing ULRv5

🇺🇸 Microsoft

Sep 2021 2.2B
Language Proprietary

LM-GVP

🇺🇸 Amazon Machine Learning Solutions Lab

Sep 2021
Language Open Weights

TrOCR

🇨🇳 Beihang University

Sep 2021 558M
Vision Open (Restricted)

PLATO-XL

🇨🇳 Baidu

Sep 2021 11B
Language Open (Restricted)

DLRM-2022

🇺🇸 Facebook

Sep 2021 3T
Language Proprietary

MegaMolBART

🇺🇸 NVIDIA

Sep 2021 45M
Language Open (Restricted)

HyperCLOVA 204B

🇰🇷 NAVER

Sep 2021 204B
Language Proprietary

HyperCLOVA 82B

🇰🇷 NAVER

Sep 2021 82B
Language Proprietary

NLM

🇺🇸 Carnegie Mellon University (CMU)

Sep 2021 247M
Language Proprietary

Speechmatics Enhanced

🇬🇧 Speechmatics

Sep 2021
Speech Proprietary

PermuteFormer

🇨🇳 Peking University

Sep 2021 149.7M
Language Proprietary

RNS-RNN

🇺🇸 University of Notre Dame

Sep 2021 5.8M
Language Proprietary

MEB

🇺🇸 Microsoft

Sep 2021 135B
Language Proprietary

FLAN 137B

🇺🇸 Google Research

Sep 2021 137B
Language Proprietary

PLUS-RNN

🇺🇸 Seoul National University

Sep 2021
Language Proprietary

$\infty$-former (SM)

🇬🇧 Universidade de Lisboa (ULisboa)

Sep 2021 124M
Language Proprietary

HJRSS

🇺🇸 University of Washington

Sep 2021 16M
Language Proprietary

ALiBi (L=3072, Lvalid = 3072)

🇺🇸 University of Washington

Aug 2021 1.3B
Language Open (Restricted)

Speechmatics Standard

🇬🇧 Speechmatics

Aug 2021
Speech Proprietary

ProteinLM

🇨🇳 Tsinghua University

Aug 2021 3B
Language Open (Restricted)

XLMR-XXL

🇺🇸 Facebook AI Research

Aug 2021 10.7B
Language Open (Restricted)

DNABERT

🇺🇸 Northeastern University

Aug 2021 110M
Language Open (Restricted)

GPT-2 (1.5B, Curriculum Learning 45K)

🇺🇸 Microsoft

Aug 2021 1.5B
Language Proprietary

GPT-2 (117M, SLW 110K)

🇺🇸 Microsoft

Aug 2021 117M
Language Proprietary

Jurassic-1-Jumbo

🇮🇱 AI21 Labs

Aug 2021 178B
Language Proprietary

Zidong Taichu

🇨🇳 Chinese Academy of Sciences

Aug 2021 3.2B
Multimodal Open (Restricted)

W2v-BERT

🇺🇸 Google Brain

Aug 2021 1B
Speech Proprietary

YOLOX-X

🇨🇳 Megvii Inc

Aug 2021 99.1M
Vision Open (Restricted)

FMMformer (2-kernel fast weight + Band20)

🇺🇸 University of California Los Angeles (UCLA)

Aug 2021 40M
Language Proprietary

6-Act Tether

🇺🇸 Facebook AI Research

Aug 2021 5M
Robotics Open (Restricted)

SEER

🇺🇸 Facebook AI Research

Jul 2021 1.3B
Vision Open Weights

GOAT

🇬🇧 DeepMind

Jul 2021 3.5M
Multimodal Proprietary

HuBERT

🇺🇸 Facebook AI Research

Jul 2021 1B
Speech Open (Restricted)

Codex

🇺🇸 OpenAI

Jul 2021 12B
Language Proprietary

ERNIE 3.0

🇨🇳 Baidu

Jul 2021 10B
Language Open (Restricted)

GemNet-T (OC20)

🇺🇸 Technical University of Munich

Jul 2021 1.9M
Language Open (Restricted)

Adaptive Input Transformer + RD

🇺🇸 Microsoft Research Asia

Jun 2021 247M
Language Proprietary

DEQ-Transformer (Post-LN) + Jacobian Regularisation

🇺🇸 Carnegie Mellon University (CMU)

Jun 2021 98M
Language Open (Restricted)

CPM-2

🇨🇳 Tsinghua University

Jun 2021 11B
Language Proprietary

Fold2Seq

🇺🇸 IBM

Jun 2021 12.4M
Language Proprietary

EfficientNetV2-XL

🇺🇸 Google

Jun 2021 208M
Vision Open (Restricted)

StyleGAN3-R

🇺🇸 NVIDIA

Jun 2021 1.6M
Language Open Weights

StyleGAN3-T

🇺🇸 NVIDIA

Jun 2021 2.2M
Language Open Weights

ALIGN

🇺🇸 Google Research

Jun 2021 820M
Multimodal Proprietary

Delta RNN (+ full context)

🇨🇭 IDSIA

Jun 2021 44.6M
Language Proprietary

Denoising Diffusion Probabilistic Models (LSUN Bedroom)

🇺🇸 University of California (UC) Berkeley

Jun 2021 256M
Vision Open (Restricted)

DeBERTa

🇺🇸 Microsoft

Jun 2021 1.5B
Language Open (Restricted)

CoAtNet

🇺🇸 Google

Jun 2021 2.4B
Vision Proprietary

EMDR

🇺🇸 Mila - Quebec AI (originally Montreal Institute for Learning Algorithms)

Jun 2021 440M
Language Open (Restricted)

ViT-G/14

🇺🇸 Google Brain

Jun 2021 1.8B
Vision Proprietary

AFP+FPI (PTB)

🇺🇸 University of Sheffield

Jun 2021 2M
Language Proprietary

AFP+FPI (WT2)

🇺🇸 University of Sheffield

Jun 2021 13.6M
Language Proprietary

GPT2-Large+LHOPT

🇺🇸 OpenAI

Jun 2021 760M
Language Proprietary

CODA

🇺🇸 The University of Hong Kong

May 2021 246.9M
Language Proprietary

Wu Dao 2.0

🇨🇳 Beijing Academy of Artificial Intelligence / BAAI

May 2021 1.8T
Multimodal Proprietary

ByT5-XXL

🇺🇸 Google

May 2021 12.9B
Language Open (Restricted)

CogView

🇨🇳 Tsinghua University

May 2021 4B
Language Open (Restricted)

DeepFRI

🇺🇸 Flatiron Institute

May 2021
Language Open (Restricted)

2021 was another fast-moving year for generative AI. The models listed above span large language models (LLMs), image and video generators, code models and more, each with its own parameter count, context window, licensing and availability. To understand how the models of 2021 actually perform, compare their scores on our benchmarks page, and use compare to evaluate any two releases side by side.

Tracking AI by release year makes it easy to see how the frontier moves. Browse AI models from 2020 or AI models from 2022 to compare how capabilities, context windows and open-weights availability evolved year over year.