- Params
- 257M
- Context
- β
- Released
- Apr 2019
This research note combines two methods that have recently improved the state of the art in language modeling: Transformers and dynamic evaluation. Transformers.
Full Transformer-XL + RMS dynamic eval specs β