- Params
- 107.7M
- Context
- β
- Released
- Oct 2022
When a language model is trained to predict natural language sequences, its prediction at each moment depends on a representation of prior context. What kind of.
Full Verbatim Memory Transformer (108M) specs β