- Params
- 97.6M
- Context
- β
- Released
- Apr 2021
In this paper, we describe the use of recurrent neural networks to capture sequential information from the self-attention representations to improve the Transfo.
Full TransfoRNN(d=1024)(2-layer) (PTB) specs β