- Params
- 85.3M
- Context
- β
- Released
- Mar 2020
The standard normalization method for neural network (NN) models used in Natural Language Processing (NLP) is layer normalization (LN). This is different than b.
Full Tensor-Transformer(1core)+PN (WT103) specs β