// RELEASE TIMELINE

Models Released in 2020

Browse every generative AI model released in 2020 — large language models, image generators, code models and more — ordered by release date. Compare their specs and rankings on our benchmarks page, or put any two side by side with compare. See also models from 2019 and models from 2021.

113 models

GPT-3 Large

🇺🇸 OpenAI

Jun 2020 760M
Language Proprietary

GPT-3 Medium

🇺🇸 OpenAI

Jun 2020 356M
Language Proprietary

GPT-3 Small

🇺🇸 OpenAI

Jun 2020 125M
Language Proprietary

GPT-3 XL

🇺🇸 OpenAI

Jun 2020 1.3B
Language Proprietary

iGPT-L

🇺🇸 OpenAI

Jun 2020 1.4B
Language Open (Restricted)

iGPT-XL

🇺🇸 OpenAI

Jun 2020 6.8B
Vision Open (Restricted)

3-Layer-Tensor-Transformer+AdaHessian

🇺🇸 University of California (UC) Berkeley

Jun 2020
Language Proprietary

6-Layer-Tensor-Transformer+AdaHessian

🇺🇸 "NERSC

Jun 2020 85.5M
Language Proprietary

GPT-3 175B (davinci)

🇺🇸 OpenAI

May 2020 174.6B
Language Proprietary

GPT3-6.7B (rerun of original)

🇺🇸 Microsoft

May 2020 6.7B
Language Proprietary

DETR

🇺🇸 Facebook

May 2020 60M
Vision Open (Restricted)

Retrieval-Augmented Generator

🇺🇸 Facebook

May 2020 626M
Language Open (Restricted)

rTop-k(distributed setting)

🇺🇸 Stanford University

May 2020 69M
Language Proprietary

Specter

🇺🇸 Allen Institute for AI

May 2020 110M
Language Open (Restricted)

Conformer

🇺🇸 Google

May 2020 118.8M
Speech Proprietary

ONLSTM-SYD

🇨🇳 Westlake University

May 2020 25M
Language Proprietary

ContextNet

🇺🇸 Google

May 2020 112.7M
Speech Proprietary

NAS+ESS (156M)

🇨🇳 Northeastern University (China)

May 2020 156M
Language Proprietary

NAS+ESS (23M)

🇨🇳 Northeastern University (China)

May 2020 23M
Language Proprietary

UnifiedQA

🇺🇸 Allen Institute for AI

May 2020 11B
Language Open (Restricted)

Segatron XL base, M=384

🇺🇸 University of Waterloo

Apr 2020 257M
Language Open Weights

Segatron XL large, M=384

🇺🇸 University of Waterloo

Apr 2020 257M
Language Open Weights

Once for All

🇺🇸 MIT-IBM Watson AI Lab

Apr 2020 7.7M
Vision Open (Restricted)

Cube-Space AutoEncoder

🇺🇸 MIT-IBM Watson AI Lab

Apr 2020
Vision Proprietary

Go-explore

🇺🇸 Uber AI

Apr 2020
Multimodal Proprietary

DiffStk-MRNN

🇺🇸 Pennsylvania State University

Apr 2020 1M
Language Proprietary

GePpeTto

🇮🇹 ILC-CNR

Apr 2020 117M
Language Open Source

Agent57

🇬🇧 DeepMind

Mar 2020
Multimodal Proprietary

AraBERT

🇱🇧 American University of Beirut

Mar 2020 110M
Language Open (Restricted)

AraBERT LArge v2

🇱🇧 American University of Beirut

Mar 2020 371M
Language Open (Restricted)

MetNet

🇺🇸 Google

Mar 2020 225M
Language Proprietary

ELECTRA

🇺🇸 Stanford University

Mar 2020 335M
Language Open (Restricted)

Tensor-Transformer(1core)+PN (PTB)

🇺🇸 University of California (UC) Berkeley

Mar 2020
Language Proprietary

Tensor-Transformer(1core)+PN (WT103)

🇺🇸 University of California (UC) Berkeley

Mar 2020 85.3M
Language Open (Restricted)

WDC20 / DLWP

🇺🇸 University of Washington

Mar 2020 672.1K
Language Proprietary

ProGen

🇺🇸 Salesforce Research

Mar 2020 1.2B
Language Proprietary

Local Transformer (WT103)

🇺🇸 Google Research

Mar 2020
Language Proprietary

Routing Transformer (WT-103)

🇺🇸 Google Research

Mar 2020 79.5M
Language Open (Restricted)

TransformerXL + spectrum control

🇺🇸 University of California Los Angeles (UCLA)

Mar 2020 151M
Language Proprietary

MuPIPR

🇺🇸 University of California Los Angeles (UCLA)

Mar 2020
Language Proprietary

LSTM-3-layer+Gadam

🇺🇸 University of Oxford

Mar 2020 24M
Language Proprietary

TCAN (PTB)

🇨🇳 Ant Group

Feb 2020 13M
Language Proprietary

TCAN (WT2)

🇺🇸 Nanjing University

Feb 2020 33M
Language Proprietary

Feedback Transformer

🇺🇸 LORIA

Feb 2020 126M
Language Proprietary

FFN SwiGLU

🇺🇸 Google

Feb 2020 220M
Language Proprietary

Turing-NLG

🇺🇸 Microsoft

Feb 2020 17B
Language Proprietary

ALBERT-xxlarge

🇺🇸 Toyota Technological Institute at Chicago

Feb 2020 235M
Language Open (Restricted)

Perceiver IO (optical flow)

🇬🇧 DeepMind

Feb 2020 27.9M
Multimodal Proprietary

TaLK Convolution

🇨🇦 Carleton University

Feb 2020 240M
Language Proprietary

Theseus 6/768

🇺🇸 University of California San Diego

Feb 2020 66M
Language Open (Restricted)

Meena

🇺🇸 Google Brain

Jan 2020 2.6B
Language Proprietary

ContextNet + Noisy Student

🇺🇸 Google

Jan 2020
Speech Proprietary

AlphaFold

🇬🇧 DeepMind

Jan 2020 16.3M
Language Proprietary

2020 was another fast-moving year for generative AI. The models listed above span large language models (LLMs), image and video generators, code models and more, each with its own parameter count, context window, licensing and availability. To understand how the models of 2020 actually perform, compare their scores on our benchmarks page, and use compare to evaluate any two releases side by side.

Tracking AI by release year makes it easy to see how the frontier moves. Browse AI models from 2019 or AI models from 2021 to compare how capabilities, context windows and open-weights availability evolved year over year.