- Params
- 4.9B
- Context
- β
- Released
- Nov 2018
Batch-splitting (data-parallelism) is the dominant distributed Deep Neural Network (DNN) training strategy, due to its universal applicability and its amenabili.
Full Mesh-TensorFlow Transformer 4.9B (language) specs β