- Params
- —
- Context
- —
- Released
- Mar 2019
Although SGD requires shuffling the training data between epochs, currently none of the word-level language modeling systems do this. Naively shuffling all sent.
Full DOC + Finetune∗ + Partial Shuffle (PTB) specs →