New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
AMD Radeon Pro W7900 48GB
Runs downloadable LLMs up to ~71B at Q4, ~121.5-148.5 tok/s on an 8B model.
What you can run
At 8k context, FP16 KV. Full-speed tok/s holds up to "max ctx"; beyond it the context spills to system RAM (CPU/PCIe offload) and drops to the degraded figure.
| Model size | FP16 | Q8 | Q4 |
|---|---|---|---|
| 3B |
90.7-110.9 t/s ≤559k ctx · then ~4.2-5.1 (slow) |
181.4-221.8 t/s ≤605k ctx · then ~8.4-10.3 (slow) |
324-396 t/s ≤625k ctx · then ~15-18.3 (slow) |
| 7-8B |
34-41.6 t/s ≤203k ctx · then ~1.6-1.9 (slow) |
68-83.2 t/s ≤264k ctx · then ~3.2-3.9 (slow) |
121.5-148.5 t/s ≤291k ctx · then ~5.6-6.9 (slow) |
| 13B |
20.9-25.6 t/s ≤102k ctx · then ~1-1.2 (slow) |
41.9-51.2 t/s ≤181k ctx · then ~1.9-2.4 (slow) |
74.8-91.4 t/s ≤216k ctx · then ~3.5-4.2 (slow) |
| 32B | won't run |
17-20.8 t/s ≤41k ctx · then ~0.8-1 (slow) |
30.4-37.1 t/s ≤94k ctx · then ~1.4-1.7 (slow) |
| 70B | won't run | won't run |
13.9-17 t/s ≤11k ctx · then ~0.6-0.8 (slow) |
| 120B | won't run | won't run | won't run |
| 400B | won't run | won't run | won't run |
Estimate: tok/s ≈ bandwidth ÷ (params × bytes/param) × efficiency (AMD). Cyan = fits ~44.2 GB usable. Beyond "ctx", KV spills to system RAM (CPU/PCIe offload) (rough degraded speed shown).
What else you need for a full build▶
Minimum supporting components for a desktop built around the AMD Radeon Pro W7900 48GB. Guidance — exact needs depend on your case, other parts and how much you offload to system RAM.
Run popular models on the AMD Radeon Pro W7900 48GB
Videos about the AMD Radeon Pro W7900 48GB
AMD - Radeon Pro W7900 Graphic Card - 48 GB GDDR6 - Full-height - 384 bit Bus Width Review
AMD Radeon Pro W7900: A FIRST LOOK at this MONSTER!
More hardware like the AMD Radeon Pro W7900 48GB
About the AMD Radeon Pro W7900 48GB
AMD Radeon Pro W7900 48GB is a discrete GPU from AMD on RDNA 3, 2023. For local genAI the numbers that matter are its 48 GB (how big a model + context fits) and 864 GB/s bandwidth (generation speed). Plan for a ~700W power supply.
Frequently asked questions
What size LLM can the AMD Radeon Pro W7900 48GB run?▶
With ~44.2 GB usable it runs up to ~71B at Q4 (~20B at FP16) at 8k context. Bigger spills into system RAM (CPU/PCIe offload) and slows sharply.
How many tokens/sec does the AMD Radeon Pro W7900 48GB generate?▶
Generation is bandwidth-bound. At 864 GB/s an 8B model at Q4 runs ~121.5-148.5 tok/s (estimate).
Why does long context slow it down?▶
The KV cache for the context must also fit fast memory; once weights+KV exceed 44.2 GB it spills to system RAM (CPU/PCIe offload) and throughput collapses. Each row shows the max usable context.
What else do I need to run the AMD Radeon Pro W7900 48GB?▶
Besides the card: a ≥700W 80+ Gold power supply, at least 48GB of system RAM (2× the 48GB VRAM is ideal for CPU offload), a free PCIe x16 slot, any modern multi-core CPU, and a ≥1TB NVMe SSD for model weights.