- Params
- 225M
- Context
- β
- Released
- Feb 2021
Large language models have become increasingly difficult to train because of the growing computation time and cost. In this work, we present SRU++, a highly-eff.
Full SRU++ Large only 2 attention layers (k=5) (WT103) specs β