// RUN ON CONSUMER GPU

Run TurboVLA on Consumer GPU hardware

39 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
Instinct MI430X → ~160,187.5 yes 6040k —
AMD Instinct MI455X → ~134,750 yes 6040k —
Instinct MI455X → ~134,750 yes 6040k —
Instinct MI440X → ~134,750 yes 6040k —
Huawei Ascend 950DT → ~28,214.3 yes 1997k —
NVIDIA GeForce RTX 5090 → ~13,920 yes 425k ~$1,999
FuriosaAI RNGD → ~10,580.4 yes 649k —
NVIDIA GeForce RTX 4090 → ~7,830 yes 312k ~$1,599
NVIDIA GeForce RTX 3090 Ti → ~7,830 yes 312k ~$1,999
NVIDIA GeForce RTX 5080 → ~7,457.1 yes 200k ~$999
NVIDIA GeForce RTX 3090 → ~7,270.7 yes 312k ~$1,499
NVIDIA GeForce RTX 3080 Ti → ~7,084.3 yes 144k ~$1,199
NVIDIA GeForce RTX 5070 Ti → ~6,960 yes 200k ~$749
AMD Radeon RX 7900 XTX → ~6,600 yes 312k ~$999
NVIDIA GeForce RTX 3080 10GB → ~5,903.6 yes 116k ~$699
NVIDIA GeForce RTX 4080 → ~5,717.1 yes 200k ~$1,199
AMD Radeon RX 7900 XT → ~5,500 yes 256k ~$899
NVIDIA GeForce RTX 4070 Ti Super → ~5,220 yes 200k ~$799
NVIDIA GeForce RTX 5070 → ~5,220 yes 144k ~$549
NVIDIA GeForce RTX 3070 Ti → ~4,722.9 yes 88k ~$599
AMD Radeon RX 9070 XT → ~4,427.5 yes 200k ~$599
AMD Radeon RX 7800 XT → ~4,290 yes 200k ~$499
NVIDIA GeForce RTX 4070 → ~3,915 yes 144k ~$599
NVIDIA GeForce RTX 4070 Super → ~3,915 yes 144k ~$599
Intel Arc Pro B70 → ~3,908.6 yes 425k —
Intel Arc A770 16GB → ~3,600 yes 200k ~$329
AMD Radeon RX 6800 XT → ~3,520 yes 200k ~$649
AMD Radeon RX 6900 XT → ~3,520 yes 200k ~$999
NVIDIA GeForce RTX 3070 → ~3,480 yes 88k ~$499
NVIDIA GeForce RTX 5060 Ti 16GB → ~3,480 yes 200k ~$429
NVIDIA GeForce RTX 5060 Ti 8GB → ~3,480 yes 88k ~$379
Intel Arc B580 12GB → ~2,931.4 yes 144k ~$249
Intel Arc Pro B60 → ~2,931.4 yes 312k —
NVIDIA GeForce RTX 4060 Ti 16GB → ~2,237.1 yes 200k ~$499
NVIDIA GeForce RTX 4060 Ti 8GB → ~2,237.1 yes 88k ~$399
NVIDIA DGX Spark → ~2,120.6 yes 1733k ~$3,999
AMD Ryzen AI Max+ 395 → ~1,760 yes 1733k ~$1,999
Intel Arc Pro B50 → ~1,440 yes 200k —
NVIDIA GeForce RTX 2050 Mobile → ~870 yes 32k —

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

→ TurboVLA overview → All hardware

FAQ

What Consumer GPU hardware runs TurboVLA?▶

On GenAIList, 39 Consumer GPU options can run TurboVLA at Q4 — the fastest is the Instinct MI430X at ~160,187.5 tok/s.

How fast is TurboVLA on Consumer GPU hardware?▶

Estimated generation speed ranges from ~870 to ~160,187.5 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.