- Params
- 247M
- Context
- β
- Released
- Sep 2018
We introduce adaptive input representations for neural language modeling which extend the adaptive softmax of Grave et al. (2017) to input representations of va.
Full Transformer (Adaptive Input Embeddings) WT103 specs β