- Params
- β
- Context
- β
- Released
- Oct 2022
Data-parallel distributed training of deep neural networks (DNN) has gained very widespread adoption, but can still experience communication bottlenecks. To add.
Full Transformer-XL + PowerSGD + L-Greco specs β