// RELEASE TIMELINE

Models Released in 2019

Browse every generative AI model released in 2019 — large language models, image generators, code models and more — ordered by release date. Compare their specs and rankings on our benchmarks page, or put any two side by side with compare. See also models from 2018 and models from 2020.

145 models

Big Transfer (BiT-M)

🇺🇸 Google Brain

Dec 2019 928M
Vision Proprietary

DD-PPO

🇺🇸 Georgia Institute of Technology

Dec 2019
Robotics Proprietary

SeqVec

🇺🇸 Technical University of Munich

Dec 2019 93M
Language Open (Restricted)

OpenAI Five

🇺🇸 OpenAI

Dec 2019 159M
Multimodal Proprietary

OpenAI Five Rerun

🇺🇸 OpenAI

Dec 2019 159M
Multimodal Proprietary

MMLSTM (PTB)

🇨🇳 Beijing University of Posts and Telecommunications

Dec 2019 21.3M
Language Proprietary

MMLSTM (WT-103)

🇨🇳 Beijing University of Posts and Telecommunications

Dec 2019 75M
Language Proprietary

MMLSTM (WT-2)

🇨🇳 Beijing University of Posts and Telecommunications

Dec 2019 32.3M
Language Proprietary

StarGAN v2

🇰🇷 NAVER

Dec 2019
Vision Open Weights

StyleGAN2

🇺🇸 NVIDIA

Dec 2019 30M
Language Open (Restricted)

bRSM + cache

🇺🇸 Numenta

Dec 2019 2.6M
Language Proprietary

AWD-LSTM + DeFINE

🇺🇸 University of Washington

Nov 2019 20M
Language Proprietary

Adaptive LSTM + DeFINE

🇺🇸 University of Washington

Nov 2019 48.7M
Language Proprietary

Transformer-XL DeFINE (107M)

🇺🇸 University of Washington

Nov 2019 107.4M
Language Proprietary

Transformer-XL DeFINE (141M)

🇺🇸 University of Washington

Nov 2019 141M
Language Proprietary

Photo-Geometric Autoencoder

🇺🇸 University of Oxford

Nov 2019
Language Open (Restricted)

FastSpeech

🇺🇸 Zhejiang University (ZJU)

Nov 2019 30.1M
Speech Proprietary

MuZero

🇬🇧 DeepMind

Nov 2019 36.9M
Multimodal Proprietary

Transformer - LibriVox + Decoding/Rescoring

🇺🇸 Facebook

Nov 2019 296M
Speech Open (Restricted)

Long-range sequence Compressive Transformers

🇬🇧 DeepMind

Nov 2019
Language Proprietary

Noisy Student (L2)

🇺🇸 Carnegie Mellon University (CMU)

Nov 2019 480M
Vision Proprietary

CamemBERT

🇺🇸 Facebook

Nov 2019 335M
Language Open (Restricted)

Sandwich Transformer

🇺🇸 Allen Institute for AI

Nov 2019 209M
Language Proprietary

Self-Attention and Convolutional Layers

🇨🇭 Ecole Polytechnique F´ed´erale de Lausanne (EPFL)

Nov 2019 29.5M
Vision Proprietary

XLM-RoBERTa

🇺🇸 Facebook AI

Nov 2019 550M
Language Open Weights

Base LM + kNN LM + Continuous Cache

🇺🇸 Stanford University

Nov 2019 247M
Language Proprietary

AlphaStar

🇬🇧 DeepMind

Oct 2019 139M
Multimodal Proprietary

BART-large

🇺🇸 Facebook AI

Oct 2019 406.3M
Language Open (Restricted)

T5-11B

🇺🇸 Google

Oct 2019 11B
Language Open (Restricted)

T5-3B

🇺🇸 Google

Oct 2019 2.8B
Language Open (Restricted)

LSTM(large)+Sememe+cell

🇨🇳 Tsinghua University

Oct 2019 48M
Language Proprietary

LSTM(medium)+Sememe+cell (WT2)

🇨🇳 Tsinghua University

Oct 2019 24M
Language Proprietary

RMSNorm (Transformer-base)

🇺🇸 University of Edinburgh

Oct 2019 65M
Language Proprietary

Rubik's cube ADR robot

🇺🇸 OpenAI

Oct 2019 27.8M
Robotics Proprietary

M4-50B

🇺🇸 Google

Oct 2019 50B
Language Proprietary

AlphaX-1

🇺🇸 Facebook AI Research

Oct 2019 5.4M
Vision Proprietary

DistilBERT

🇺🇸 Hugging Face

Oct 2019 66M
Language Open (Restricted)

ALBERT

🇺🇸 Toyota Technological Institute at Chicago

Sep 2019 18M
Language Open (Restricted)

Adaptive Inputs + LayerDrop

🇺🇸 Facebook AI Research

Sep 2019 423M
Language Open (Restricted)

Alleviated TOI 10 (PTB)

🇨🇭 Ecole Polytechnique F´ed´erale de Lausanne (EPFL)

Sep 2019
Language Proprietary

Alleviated TOI 10 (WT103)

🇨🇭 Ecole Polytechnique F´ed´erale de Lausanne (EPFL)

Sep 2019
Language Proprietary

Alleviated TOI 10 (WT2)

🇨🇭 Ecole Polytechnique F´ed´erale de Lausanne (EPFL)

Sep 2019
Language Proprietary

Hide and Seek

🇺🇸 OpenAI

Sep 2019 1.6M
Multimodal Proprietary

Megatron-BERT

🇺🇸 NVIDIA

Sep 2019 3.9B
Language Proprietary

Megatron-LM (1.2B)

🇺🇸 NVIDIA

Sep 2019 1.2B
Language Proprietary

Megatron-LM (2.5B)

🇺🇸 NVIDIA

Sep 2019 2.5B
Language Proprietary

Megatron-LM (355M)

🇺🇸 NVIDIA

Sep 2019 355M
Language Open (Restricted)

Megatron-LM (8.3B)

🇺🇸 NVIDIA

Sep 2019 8.3B
Language Proprietary

Xiaoice

🇺🇸 Microsoft Research Asia

Sep 2019
Language Proprietary

ResNet-152 + ObjectNet

🇺🇸 Massachusetts Institute of Technology (MIT)

Sep 2019 38M
Vision Proprietary

Mogrifier (d2, MC) + dynamic eval

🇬🇧 DeepMind

Sep 2019 24M
Language Proprietary

Mogrifier (d2, MoS2, MC) + dynamic eval

🇬🇧 DeepMind

Sep 2019 35M
Language Proprietary

UDSMProt

🇩🇪 Fraunhofer Heinrich Hertz Institute

Sep 2019 28.3M
Language Open (Restricted)

DEQ-Transformer (Medium, Adaptive Embedding)

🇺🇸 Carnegie Mellon University (CMU)

Sep 2019 110M
Language Open (Restricted)

DEQ-TrellisNet (PTB)

🇺🇸 Carnegie Mellon University (CMU)

Sep 2019 24M
Language Proprietary

DEQ-TrellisNet (WT-103)

🇺🇸 Carnegie Mellon University (CMU)

Sep 2019 180M
Language Proprietary

AWD-LSTM+Behaviorial-Gating

🇺🇸 University of Southern California

Aug 2019 27M
Language Proprietary

LSTM-Medium+Behaviorial-Gating (PTB)

🇺🇸 University of Southern California

Aug 2019 20M
Language Proprietary

trRosetta

🇺🇸 Nankai University

Aug 2019
Language Open (Restricted)

TripletRes

🇺🇸 University of Michigan

Aug 2019
Language Proprietary

2019 was another fast-moving year for generative AI. The models listed above span large language models (LLMs), image and video generators, code models and more, each with its own parameter count, context window, licensing and availability. To understand how the models of 2019 actually perform, compare their scores on our benchmarks page, and use compare to evaluate any two releases side by side.

Tracking AI by release year makes it easy to see how the frontier moves. Browse AI models from 2018 or AI models from 2020 to compare how capabilities, context windows and open-weights availability evolved year over year.