// RELEASE TIMELINE

Models Released in 2019

Browse every generative AI model released in 2019 — large language models, image generators, code models and more — ordered by release date. Compare their specs and rankings on our benchmarks page, or put any two side by side with compare. See also models from 2018 and models from 2020.

145 models

FAIRSEQ Adaptive Inputs

🇺🇸 Facebook AI Research

Apr 2019 247M
Language Proprietary

SciBERT

🇺🇸 Allen Institute for AI

Mar 2019 110M
Language Open (Restricted)

UniRep

🇺🇸 Harvard University

Mar 2019 18.2M
Language Open Weights

DOC + Finetune∗ + Partial Shuffle (PTB)

🇺🇸 University of Washington

Mar 2019
Language Proprietary

NMT Transformer 437M

🇺🇸 Google

Feb 2019 437.7M
Language Proprietary

KataGo

🇺🇸 Jane Street

Feb 2019 2.5M
Multimodal Open (Restricted)

ProxylessNAS

🇺🇸 Massachusetts Institute of Technology (MIT)

Feb 2019
Vision Open (Restricted)

SSA

🇺🇸 Massachusetts Institute of Technology (MIT)

Feb 2019
Language Proprietary

code2seq

🇺🇸 Technion - Israel Institute of Technology

Feb 2019 37M
Language Open (Restricted)

GPT-2 (1.5B)

🇺🇸 OpenAI

Feb 2019 1.5B
Language Open (Restricted)

GPT-2 (124M)

🇺🇸 OpenAI

Feb 2019 124M
Language Open (Restricted)

GPT-2 (355M)

🇺🇸 OpenAI

Feb 2019 355M
Language Open (Restricted)

GPT-2 (774M)

🇺🇸 OpenAI

Feb 2019 774M
Language Open (Restricted)

SDE

🇺🇸 Carnegie Mellon University (CMU)

Feb 2019
Language Proprietary

Compress-LSTM (4.6M)

🇷🇺 Samsung R&D Institute Russia

Feb 2019 4.6M
Language Proprietary

Compress-LSTM (66M)

🇷🇺 Samsung R&D Institute Russia

Feb 2019 66M
Language Proprietary

Hanabi 4 player

🇬🇧 DeepMind

Feb 2019 764K
Multimodal Proprietary

MT-DNN

🇺🇸 Microsoft

Jan 2019 330M
Language Open (Restricted)

TSLM+MoS (PTB)

🇺🇸 Tianjin University

Jan 2019
Language Proprietary

Mono3D++

🇺🇸 University of California Los Angeles (UCLA)

Jan 2019
Language Proprietary

Transformer-XL (257M)

🇺🇸 Carnegie Mellon University (CMU)

Jan 2019 257M
Language Open (Restricted)

Transformer-XL-ptb

🇺🇸 Carnegie Mellon University (CMU)

Jan 2019 24M
Language Proprietary

Decoupled weight decay regularization

🇩🇪 University of Freiburg

Jan 2019 36.5M
Vision Open (Restricted)

Transformer + Average Attention Network

🇺🇸 University of Electronic Science and Technology of China

Jan 2019
Language Proprietary

Transformer ELMo

🇺🇸 Allen Institute for AI

Jan 2019 56M
Language Proprietary

2019 was another fast-moving year for generative AI. The models listed above span large language models (LLMs), image and video generators, code models and more, each with its own parameter count, context window, licensing and availability. To understand how the models of 2019 actually perform, compare their scores on our benchmarks page, and use compare to evaluate any two releases side by side.

Tracking AI by release year makes it easy to see how the frontier moves. Browse AI models from 2018 or AI models from 2020 to compare how capabilities, context windows and open-weights availability evolved year over year.