- Params
- 2.9B
- Context
- β
- Released
- Nov 2018
Batch-splitting (data-parallelism) is the dominant distributed Deep Neural Network (DNN) training strategy, due to its universal applicability and its amenabili.
Full Mesh-TensorFlow Transformer 2.9B (translation) specs β