New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
Models Released in 2020
Browse every generative AI model released in 2020 — large language models, image generators, code models and more — ordered by release date. Compare their specs and rankings on our benchmarks page, or put any two side by side with compare. See also models from 2019 and models from 2021.
AraGPT2-Mega
🇱🇧 American University of Beirut
ERNIE-Doc (247M)
🇨🇳 Baidu
ERNIE-Doc Base (151M, WT103)
🇨🇳 Baidu
Shortformer
🇺🇸 University of Washington
CT-MoS (PTB)
🇺🇸 National Tsing Hua University
CT-MoS (WT2)
CT-MoS + DynamicEval (PTB)
🇺🇸 National Tsing Hua University
CT-MoS + DynamicEval (WT2)
🇺🇸 National Tsing Hua University
DensePhrases
🇺🇸 Korea University
RaSoR
🇺🇸 Korea University
VQGAN + CLIP
🇺🇸 Heidelberg University
ESM1b
🇺🇸 Facebook AI Research
RoBERTa (PFAM)
🇺🇸 IBM Research
OC-GAN (COCO-Stuff)
🇺🇸 Mila - Quebec AI (originally Montreal Institute for Learning Algorithms)
OC-GAN (Visual Genome)
🇺🇸 Mila - Quebec AI (originally Montreal Institute for Learning Algorithms)
CPM-Large
🇨🇳 Tsinghua University
Profile Prediction
🇺🇸 University of Washington
AlphaFold 2
🇬🇧 DeepMind
KEPLER
🇨🇳 Tsinghua University
AWD-FWM (PTB)
🇨🇭 IDSIA
AWD-FWM (WT2)
🇨🇭 IDSIA
Machine learning a model for RNA structure prediction
🇩🇪 International School for Advanced Studies
CPCProt
🇺🇸 University of Toronto
ChemBERTa
🇺🇸 University of Toronto
HiPPO-LegS
🇺🇸 Stanford University
CryptoGRU
🇺🇸 Indiana University Bloomington
ViT-Huge/14
🇺🇸 Google Brain
wave2vec 2.0 LARGE
GBERT-Large
🇩🇪 deepset
German ELECTRA Large
🇩🇪 deepset
Conformer + Wav2vec 2.0 + Noisy Student
mT5-XXL
TinyBert
🇨🇳 Huazhong University of Science and Technology
Memformer (4 encoder + 16 decoder)
🇺🇸 UC Davis
LUKE
🇺🇸 University of Washington
Frage-AWD-LSTM-MemoryAug-NeuralCache (PTB)
🇺🇸 Johns Hopkins University
LSTM-MemoryAug (PTB)
🇺🇸 Johns Hopkins University
LSTM-MemoryAug (WT2)
🇺🇸 Johns Hopkins University
PAR Transformer Large
🇺🇸 NVIDIA
ProBERTa
🇺🇸 University of Illinois Urbana-Champaign (UIUC)
ESM1-43M
🇺🇸 Facebook AI Research
ESM1-670M (UR100)
🇺🇸 Facebook AI Research
ESM1-670M (UR50/D)
🇺🇸 Facebook AI Research
ESM1-670M (UR50/S)
🇺🇸 Facebook AI Research
ESM1-85M
🇺🇸 Facebook AI Research
Transformer+Recurrent Windows of Context
🇺🇸 Toyota Technological Institute at Chicago
ERNIE-GEN (large)
🇨🇳 Baidu
DeLighT
🇺🇸 University of Washington
mBART-50
🇺🇸 Facebook AI
Grown to Prune Two-layer stacked LSTM
🇺🇸 University of Chicago
GPT2-LayerFusion-WS
🇺🇸 University of Liverpool
TransformerXL-LayerFusion-CA
🇺🇸 University of Liverpool
Hopfield Networks (2020)
🇦🇹 Johannes Kepler University Linz
SemExp
🇺🇸 Carnegie Mellon University (CMU)
DLRM-2021
🇺🇸 Meta AI
GShard (600B)
GShard (dense)
GPT-3 13B
🇺🇸 OpenAI
GPT-3 2.7B
🇺🇸 OpenAI
GPT-3 6.7B
🇺🇸 OpenAI
2020 was another fast-moving year for generative AI. The models listed above span large language models (LLMs), image and video generators, code models and more, each with its own parameter count, context window, licensing and availability. To understand how the models of 2020 actually perform, compare their scores on our benchmarks page, and use compare to evaluate any two releases side by side.
Tracking AI by release year makes it easy to see how the frontier moves. Browse AI models from 2019 or AI models from 2021 to compare how capabilities, context windows and open-weights availability evolved year over year.