- Params
- 242M
- Context
- β
- Released
- Oct 2022
Autoregressive Transformers are strong language models but incur O(T) complexity during per-token generation due to the self-attention mechanism. Recent work pr.
Full Decaying Fast Weights Transformer (WT-103) specs β