New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
Intel Arc Pro B70
Runs downloadable LLMs up to ~45B at Q4, ~78.7-97.7 tok/s on an 8B model.
What you can run
At 8k context, FP16 KV. Full-speed tok/s holds up to "max ctx"; beyond it the context spills to system RAM (CPU/PCIe offload) and drops to the degraded figure.
| Model size | FP16 | Q8 | Q4 |
|---|---|---|---|
| 3B |
58.8-73 t/s ≤335k ctx · then ~3.9-4.8 (slow) |
117.5-145.9 t/s ≤381k ctx · then ~7.7-9.6 (slow) |
209.9-260.6 t/s ≤401k ctx · then ~13.8-17.1 (slow) |
| 7-8B |
22-27.4 t/s ≤91k ctx · then ~1.5-1.8 (slow) |
44.1-54.7 t/s ≤152k ctx · then ~2.9-3.6 (slow) |
78.7-97.7 t/s ≤179k ctx · then ~5.2-6.4 (slow) |
| 13B |
13.6-16.8 t/s ≤12k ctx · then ~0.9-1.1 (slow) |
27.1-33.7 t/s ≤91k ctx · then ~1.8-2.2 (slow) |
48.4-60.1 t/s ≤126k ctx · then ~3.2-4 (slow) |
| 32B | won't run | won't run |
19.7-24.4 t/s ≤38k ctx · then ~1.3-1.6 (slow) |
| 70B | won't run | won't run | won't run |
| 120B | won't run | won't run | won't run |
| 400B | won't run | won't run | won't run |
Estimate: tok/s ≈ bandwidth ÷ (params × bytes/param) × efficiency (Intel). Cyan = fits ~29.4 GB usable. Beyond "ctx", KV spills to system RAM (CPU/PCIe offload) (rough degraded speed shown).
What else you need for a full build▶
Minimum supporting components for a desktop built around the Intel Arc Pro B70. Guidance — exact needs depend on your case, other parts and how much you offload to system RAM.
Run popular models on the Intel Arc Pro B70
Videos about the Intel Arc Pro B70
Intel Arc Pro B70 (32GB) for Local LLMs: llama.cpp (SYCL/Vulkan), vLLM (Intel LLM Scaler) Benchmarks
Should You Buy Intel ARC PRO B70 GPU for Local AI? Gemma 4?
More hardware like the Intel Arc Pro B70
About the Intel Arc Pro B70
Intel Arc Pro B70 is a discrete GPU from Intel, 2026. For local genAI the numbers that matter are its 32 GB (how big a model + context fits) and 608 GB/s bandwidth (generation speed).
Frequently asked questions
What size LLM can the Intel Arc Pro B70 run?▶
With ~29.4 GB usable it runs up to ~45B at Q4 (~13B at FP16) at 8k context. Bigger spills into system RAM (CPU/PCIe offload) and slows sharply.
How many tokens/sec does the Intel Arc Pro B70 generate?▶
Generation is bandwidth-bound. At 608 GB/s an 8B model at Q4 runs ~78.7-97.7 tok/s (estimate).
Why does long context slow it down?▶
The KV cache for the context must also fit fast memory; once weights+KV exceed 29.4 GB it spills to system RAM (CPU/PCIe offload) and throughput collapses. Each row shows the max usable context.
What else do I need to run the Intel Arc Pro B70?▶
Besides the card: at least 32GB of system RAM (2× the 32GB VRAM is ideal for CPU offload), a free PCIe x16 slot, any modern multi-core CPU, and a ≥1TB NVMe SSD for model weights.