New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
Tulu 3 405B
About Tulu 3 405B
Tulu 3 405B is an AI model developed by Allen Institute for AI, in the language category, released in 2025, made available as an open-weights model with 405B params.
On this page you'll find Tulu 3 405B's full specifications, including 8 benchmark results. Review provider pricing and benchmark scores below, or compare Tulu 3 405B head-to-head with other language models.
Links
Run Tulu 3 405B locally — what it takes
Tulu 3 405B (405B) is too large to run on a single consumer or Apple machine. At Q4 its weights alone are about 227 GB — it needs a multi-GPU / datacenter setup:
- ≈ 1× AMD Instinct MI325X
- ≈ 2× NVIDIA B200
Lower quantization (Q3/Q2) or CPU + system-RAM offload (e.g. ktransformers) reduces the requirement at the cost of speed.
Software support
✓ measured · · compatible · — not supported. Informational only — speed is hardware-based.
Community
No reports yet. Own this model on some hardware? Be the first to confirm it runs.
No comments yet. Start the discussion.
Tulu 3 405B benchmark scores▶
| Benchmark | Category | Score | Variant |
|---|---|---|---|
| HumanEval | code | 95.9% | instruct-pass@10 |
| HumanEval+ | code | 92.9% | instruct-pass@10 |
| AlpacaEval 2 | general | 51.4% | instruct-lc-win |
| IFEval | general | 86% | instruct-prompt-loose |
| MMLU | general | 87% | instruct-5-shot-cot |
| GSM8K | math | 95.5% | instruct-8-shot-cot |
| MATH | math | 67.3% | instruct-4-shot-flex |
| BIG-Bench Hard | reasoning | 88.6% | instruct-0-shot-cot |
More models like Tulu 3 405B
Frequently asked questions
What is Tulu 3 405B? ▶
Tulu 3 405B is an AI model developed by Allen Institute for AI, in the language category, released in 2025. It is tracked on GenAIList with its specifications, benchmark scores and provider pricing.
Who created Tulu 3 405B? ▶
Tulu 3 405B was developed by Allen Institute for AI and released in 2025.
Is Tulu 3 405B open source or proprietary? ▶
Tulu 3 405B ships as an open-weights model: you can download and self-host the weights, though the licence may place some restrictions on use.
How much does Tulu 3 405B cost? ▶
Pricing for Tulu 3 405B depends on the provider. See the providers table on this page for the latest API rates.
How does Tulu 3 405B perform on benchmarks? ▶
Tulu 3 405B is benchmarked across 8 evaluations on GenAIList, including HumanEval (95.9%). See the full benchmark table below and compare it with other models.
No videos yet. Know a good one? Add it below.
Know a great video about Tulu 3 405B?
Add YouTube Video
Add Tweet/Discussion
Report an Issue
Help us maintain accurate information in our database.
Suggest an Edit
Tell us what needs to be changed or corrected for