// RELEASE TIMELINE

Models Released in 2019

Browse every generative AI model released in 2019 — large language models, image generators, code models and more — ordered by release date. Compare their specs and rankings on our benchmarks page, or put any two side by side with compare. See also models from 2018 and models from 2020.

145 models

Graph-based Semi-Supervised Learning (GSSL) Model on MNIST

🇺🇸 West Virginia University

Jul 2019
Vision Proprietary

RNN + char4-MS-vec

🇯🇵 NTT Communication Science Laboratories

Jul 2019 226M
Language Proprietary

RNN + char3-MS-vec

🇯🇵 NTT Communication Science Laboratories

Jul 2019 175M
Language Proprietary

RNN Baseline

🇺🇸 Massachusetts Institute of Technology (MIT)

Jul 2019
Language Proprietary

R-Transformer

🇺🇸 Michigan State University

Jul 2019 15.8M
Language Proprietary

Pluribus

🇺🇸 Facebook AI Research

Jul 2019
Multimodal Proprietary

All-attention network + adaptive span

🇺🇸 Facebook AI Research

Jul 2019 133M
Language Proprietary

RoBERTa Base

🇺🇸 Facebook

Jul 2019 125M
Language Open (Restricted)

RoBERTa Large

🇺🇸 Facebook

Jul 2019 355M
Language Open (Restricted)

Tensorized Transformer (257M)

🇺🇸 Tianjin University

Jun 2019 257M
Language Proprietary

Tensorized Transformer (OBW)

🇺🇸 Tianjin University

Jun 2019 160M
Language Proprietary

Tensorized Transformer (PTB)

🇺🇸 Tianjin University

Jun 2019 12M
Language Proprietary

Tensorized Transformer (W103)

🇺🇸 Tianjin University

Jun 2019 85.3M
Language Proprietary

Tensorized Transformer (large PTB)

🇺🇸 Tianjin University

Jun 2019
Language Proprietary

TAPE Transformer

🇺🇸 University of California (UC) Berkeley

Jun 2019 38M
Language Open (Restricted)

Walking Minotaur robot

🇺🇸 University of California (UC) Berkeley

Jun 2019
Robotics Proprietary

LaNet-L (CIFAR-10)

🇺🇸 Brown University

Jun 2019 44.1M
Vision Open Weights

PG-SWGAN

🇨🇭 ETH Zurich

Jun 2019
Language Proprietary

SAGAN

🇺🇸 Rutgers University

Jun 2019
Language Proprietary

Char-CNN-BiLSTM

🇺🇸 Capital One

Jun 2019
Language Proprietary

RNN + char2-MS-vec

🇯🇵 NTT Communication Science Laboratories

Jun 2019 158M
Language Proprietary

4 layer QRNN + dynamic evaluation

🇺🇸 University of Texas at Austin

Jun 2019
Language Proprietary

AWD-LSTM + MoS + Partial Shuffled

🇺🇸 University of Texas at Austin

Jun 2019 35M
Language Open Weights

AdvSoft + 4 layer QRNN + dynamic evaluation (WT103)

🇺🇸 University of Texas at Austin

Jun 2019
Language Proprietary

Adversarial + AWD-LSTM-MoS + partial shuffled

🇺🇸 University of Texas at Austin

Jun 2019
Language Proprietary

AWD-LSTM + Phrase Induction + finetuning (PTB)

🇺🇸 Massachusetts Institute of Technology (MIT)

Jun 2019 24M
Language Proprietary

Transformer-XL Large + Phrase Induction

🇺🇸 Massachusetts Institute of Technology (MIT)

Jun 2019 257M
Language Proprietary

VQ-VAE-2 (FFHQ)

🇺🇸 Google

Jun 2019
Language Proprietary

VQ-VAE-2 (ImageNet)

🇺🇸 Google

Jun 2019
Language Proprietary

XLNet

🇺🇸 Carnegie Mellon University (CMU)

Jun 2019 340M
Language Open (Restricted)

DLRM-2020

🇺🇸 Facebook AI

May 2019 100B
Language Proprietary

Grover-Mega

🇺🇸 University of Washington

May 2019 1.5B
Language Open (Restricted)

MnasNet-A1 + SSDLite

🇺🇸 Google

May 2019 4.9M
Vision Open (Restricted)

MnasNet-A3

🇺🇸 Google

May 2019 5.2M
Vision Open (Restricted)

EfficientNet-B1

🇺🇸 Google

May 2019 7.8M
Vision Open (Restricted)

RSM

Cerenaut

May 2019
Language Proprietary

Flow++ (CIFAR10)

🇺🇸 University of California (UC) Berkeley

May 2019 31.4M
Language Proprietary

AWD-LSTM-DRILL + dynamic evaluation† (PTB)

🇨🇭 IDIAP

May 2019 24M
Language Open (Restricted)

AWD-LSTM-DRILL + dynamic evaluation† (WT2)

🇨🇭 IDIAP

May 2019 34M
Language Open (Restricted)

RaptorX-Contact

🇺🇸 Toyota Technological Institute at Chicago

May 2019
Language Proprietary

Neuro-Symbolic Concept Learner

🇺🇸 Massachusetts Institute of Technology (MIT)

Apr 2019
Vision Proprietary

MuseNet

🇺🇸 OpenAI

Apr 2019 2B
Audio Proprietary

Sparse Transformer (CIFAR10)

🇺🇸 OpenAI

Apr 2019 59M
Language Proprietary

Sparse Transformer (Enwik8)

🇺🇸 OpenAI

Apr 2019 95M
Language Proprietary

Sparse Transformer (ImageNet)

🇺🇸 OpenAI

Apr 2019 152M
Language Proprietary

DANet

🇨🇳 Chinese Academy of Sciences

Apr 2019
Vision Open (Restricted)

BERT-Large-CAS (PTB+WT2+WT103)

🇺🇸 Amazon

Apr 2019 395M
Language Proprietary

BERT-Large-CAS (WT103)

🇺🇸 Amazon

Apr 2019 340M
Language Proprietary

BERT-Large-CAS (WT2)

🇺🇸 Amazon

Apr 2019 340M
Language Proprietary

LTM

🇦🇺 Murdoch University

Apr 2019
Language Proprietary

SpecAugment

🇺🇸 Google Brain

Apr 2019
Language Proprietary

Transformer-XL + RMS dynamic eval

🇺🇸 University of Edinburgh

Apr 2019 257M
Language Proprietary

MEGNet (crystal band gap model)

🇺🇸 University of California San Diego

Apr 2019 26.1K
Language Proprietary

MEGNet (crystal elasticity model)

🇺🇸 University of California San Diego

Apr 2019 26.1K
Language Proprietary

MEGNet (crystal formation energy model)

🇺🇸 University of California San Diego

Apr 2019 26.1K
Language Proprietary

MEGNet (molecule model)

🇺🇸 University of California San Diego

Apr 2019 8.7K
Language Proprietary

True-Regularization+Finetune+Dynamic-Eval

🇨🇳 Mobvoi

Apr 2019 7M
Language Proprietary

WeNet (PTB)

🇺🇸 Amazon

Apr 2019 23M
Language Proprietary

WeNet (Penn Treebank)

🇺🇸 Amazon

Apr 2019 23M
Language Proprietary

Cross-lingual alignment

🇺🇸 Tel Aviv University

Apr 2019
Language Open (Restricted)

2019 was another fast-moving year for generative AI. The models listed above span large language models (LLMs), image and video generators, code models and more, each with its own parameter count, context window, licensing and availability. To understand how the models of 2019 actually perform, compare their scores on our benchmarks page, and use compare to evaluate any two releases side by side.

Tracking AI by release year makes it easy to see how the frontier moves. Browse AI models from 2018 or AI models from 2020 to compare how capabilities, context windows and open-weights availability evolved year over year.