New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
Tulu 3 8B
About Tulu 3 8B
Tulu 3 8B is an AI model developed by Allen Institute for AI, in the language category, released in 2024, made available as an open-weights model with 8B params.
On this page you'll find Tulu 3 8B's full specifications, including 10 benchmark results. Review provider pricing and benchmark scores below, or compare Tulu 3 8B head-to-head with other language models.
Links
Run Tulu 3 8B locally — what to buy
Share this build ↗Sized to what Tulu 3 8B actually needs (~8k context at Q4), not to the biggest GPU: Good = cheapest that runs it, Better = best value, Best = most headroom. Speed is a hardware estimate; anything past ~120 tok/s is shown as instant.
Software support
✓ measured · · compatible · — not supported. Informational only — speed is hardware-based.
Community
No reports yet. Own this model on some hardware? Be the first to confirm it runs.
No comments yet. Start the discussion.
Tulu 3 8B benchmark scores▶
| Benchmark | Category | Score | Variant |
|---|---|---|---|
| HumanEval | code | 83.9% | instruct-pass@10 |
| HumanEval+ | code | 79.2% | instruct-pass@10 |
| AlpacaEval 2 | general | 34.5% | instruct-lc-win |
| IFEval | general | 82.4% | instruct-prompt-loose |
| MMLU | general | 68.2% | instruct-0-shot-cot |
| GSM8K | math | 87.6% | instruct-8-shot-cot |
| MATH | math | 43.7% | instruct-4-shot-cot-flex |
| BIG-Bench Hard | reasoning | 66% | instruct-3-shot-cot |
| DROP | reasoning | 62.6% | instruct-3-shot |
| TruthfulQA | safety | 55% | instruct-6-shot |
More models like Tulu 3 8B
Frequently asked questions
What is Tulu 3 8B? ▶
Tulu 3 8B is an AI model developed by Allen Institute for AI, in the language category, released in 2024. It is tracked on GenAIList with its specifications, benchmark scores and provider pricing.
Who created Tulu 3 8B? ▶
Tulu 3 8B was developed by Allen Institute for AI and released in 2024.
Is Tulu 3 8B open source or proprietary? ▶
Tulu 3 8B ships as an open-weights model: you can download and self-host the weights, though the licence may place some restrictions on use.
How much does Tulu 3 8B cost? ▶
Pricing for Tulu 3 8B depends on the provider. See the providers table on this page for the latest API rates.
How does Tulu 3 8B perform on benchmarks? ▶
Tulu 3 8B is benchmarked across 10 evaluations on GenAIList, including HumanEval (83.9%). See the full benchmark table below and compare it with other models.
No videos yet. Know a good one? Add it below.
Know a great video about Tulu 3 8B?
Add YouTube Video
Add Tweet/Discussion
Report an Issue
Help us maintain accurate information in our database.
Suggest an Edit
Tell us what needs to be changed or corrected for