- Params
- 1.1B
- Context
- β
- Released
- Oct 2023
We present TinyLlama, a compact 1.1B language model pretrained on around 1 trillion tokens for approximately 3 epochs. Building on the architecture and tokenize.
Full TinyLlama-1.1B (1T token checkpoint) specs β