- Params
- 24M
- Context
- β
- Released
- Jan 2021
Neural networks are often over-parameterized and hence benefit from aggressive regularization. Conventional regularization methods, such as Dropout or weight de.
Full Transformer-XL + AutoDropout (PTB) specs β