// RUN ON CONSUMER GPU

Run CodeT5-base on Consumer GPU hardware

33 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
NVIDIA GeForce RTX 5090 → ~12,654.5 yes 424k ~$1,999
NVIDIA GeForce RTX 4090 → ~7,118.2 yes 312k ~$1,599
NVIDIA GeForce RTX 3090 Ti → ~7,118.2 yes 312k ~$1,999
NVIDIA GeForce RTX 5080 → ~6,779.2 yes 200k ~$999
NVIDIA GeForce RTX 3090 → ~6,609.7 yes 312k ~$1,499
NVIDIA GeForce RTX 3080 Ti → ~6,440.3 yes 144k ~$1,199
NVIDIA GeForce RTX 5070 Ti → ~6,327.3 yes 200k ~$749
AMD Radeon RX 7900 XTX → ~6,000 yes 312k ~$999
NVIDIA GeForce RTX 3080 10GB → ~5,366.9 yes 116k ~$699
NVIDIA GeForce RTX 4080 → ~5,197.4 yes 200k ~$1,199
AMD Radeon RX 7900 XT → ~5,000 yes 256k ~$899
NVIDIA GeForce RTX 5070 → ~4,745.5 yes 144k ~$549
NVIDIA GeForce RTX 4070 Ti Super → ~4,745.5 yes 200k ~$799
NVIDIA GeForce RTX 3070 Ti → ~4,293.5 yes 88k ~$599
AMD Radeon RX 9070 XT → ~4,025 yes 200k ~$599
AMD Radeon RX 7800 XT → ~3,900 yes 200k ~$499
NVIDIA GeForce RTX 4070 Super → ~3,559.1 yes 144k ~$599
NVIDIA GeForce RTX 4070 → ~3,559.1 yes 144k ~$599
Intel Arc Pro B70 → ~3,553.2 yes 424k —
Intel Arc A770 16GB → ~3,272.7 yes 200k ~$329
AMD Radeon RX 6800 XT → ~3,200 yes 200k ~$649
AMD Radeon RX 6900 XT → ~3,200 yes 200k ~$999
NVIDIA GeForce RTX 3070 → ~3,163.6 yes 88k ~$499
NVIDIA GeForce RTX 5060 Ti 16GB → ~3,163.6 yes 200k ~$429
NVIDIA GeForce RTX 5060 Ti 8GB → ~3,163.6 yes 88k ~$379
Intel Arc Pro B60 → ~2,664.9 yes 312k —
Intel Arc B580 12GB → ~2,664.9 yes 144k ~$249
NVIDIA GeForce RTX 4060 Ti 8GB → ~2,033.8 yes 88k ~$399
NVIDIA GeForce RTX 4060 Ti 16GB → ~2,033.8 yes 200k ~$499
NVIDIA DGX Spark → ~1,927.8 yes 1733k ~$3,999
AMD Ryzen AI Max+ 395 → ~1,600 yes 1733k ~$1,999
Intel Arc Pro B50 → ~1,309.1 yes 200k —
NVIDIA GeForce RTX 2050 Mobile → ~790.9 yes 31k —

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

→ CodeT5-base overview → All hardware

FAQ

What Consumer GPU hardware runs CodeT5-base?▶

On GenAIList, 33 Consumer GPU options can run CodeT5-base at Q4 — the fastest is the NVIDIA GeForce RTX 5090 at ~12,654.5 tok/s.

How fast is CodeT5-base on Consumer GPU hardware?▶

Estimated generation speed ranges from ~790.9 to ~12,654.5 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.