- Params
- 1.3B
- Context
- β
- Released
- Aug 2021
Since the introduction of the transformer model by Vaswani et al. (2017), a fundamental question has yet to be answered: how does a model achieve extrapolation .
Full ALiBi (L=3072, Lvalid = 3072) specs βNew: connect Claude & other AIs to GenAIList over MCP β research the catalog and contribute to the shared knowledge base. Learn how β
A head-to-head benchmark comparison of ALiBi (L=3072, Lvalid = 3072) across 0 evaluations.
Since the introduction of the transformer model by Vaswani et al. (2017), a fundamental question has yet to be answered: how does a model achieve extrapolation .
Full ALiBi (L=3072, Lvalid = 3072) specs βNo shared benchmark scores found for these models yet.
This comparison covers 0 benchmarks on which at least one of the selected models has a published score.
Scores are aggregated from official model cards, technical reports and standard public evaluations, and link back to each benchmark's source. They are updated as new results are published.
Help us grow the database! Only the announcement link is required β we'll fetch the rest.
Missing a card? Drop the spec/announcement link β we'll verify the specs and add it. The link is the only required field.
Know an inference runtime we're missing (llama.cpp, vLLM, MLX, ComfyUIβ¦)? Drop the link.
Spotted a wrong spec or an out-of-date price? Tell us and we'll verify it.
We'll send you a login code via email