// RUN ON CONSUMER GPU

Run Transformer (Adaptive Input Embeddings) WT103 on Consumer GPU hardware

33 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
NVIDIA GeForce RTX 5090 โ†’ ~11,271.3 yes 424k ~$1,999
NVIDIA GeForce RTX 4090 โ†’ ~6,340.1 yes 312k ~$1,599
NVIDIA GeForce RTX 3090 Ti โ†’ ~6,340.1 yes 312k ~$1,999
NVIDIA GeForce RTX 5080 โ†’ ~6,038.2 yes 200k ~$999
NVIDIA GeForce RTX 3090 โ†’ ~5,887.2 yes 312k ~$1,499
NVIDIA GeForce RTX 3080 Ti โ†’ ~5,736.3 yes 143k ~$1,199
NVIDIA GeForce RTX 5070 Ti โ†’ ~5,635.6 yes 200k ~$749
AMD Radeon RX 7900 XTX โ†’ ~5,344.1 yes 312k ~$999
NVIDIA GeForce RTX 3080 10GB โ†’ ~4,780.2 yes 115k ~$699
NVIDIA GeForce RTX 4080 โ†’ ~4,629.3 yes 200k ~$1,199
AMD Radeon RX 7900 XT โ†’ ~4,453.4 yes 256k ~$899
NVIDIA GeForce RTX 5070 โ†’ ~4,226.7 yes 143k ~$549
NVIDIA GeForce RTX 4070 Ti Super โ†’ ~4,226.7 yes 200k ~$799
NVIDIA GeForce RTX 3070 Ti โ†’ ~3,824.2 yes 87k ~$599
AMD Radeon RX 9070 XT โ†’ ~3,585 yes 200k ~$599
AMD Radeon RX 7800 XT โ†’ ~3,473.7 yes 200k ~$499
NVIDIA GeForce RTX 4070 Super โ†’ ~3,170 yes 143k ~$599
NVIDIA GeForce RTX 4070 โ†’ ~3,170 yes 143k ~$599
Intel Arc Pro B70 โ†’ ~3,164.8 yes 424k โ€”
Intel Arc A770 16GB โ†’ ~2,915 yes 200k ~$329
AMD Radeon RX 6800 XT โ†’ ~2,850.2 yes 200k ~$649
AMD Radeon RX 6900 XT โ†’ ~2,850.2 yes 200k ~$999
NVIDIA GeForce RTX 3070 โ†’ ~2,817.8 yes 87k ~$499
NVIDIA GeForce RTX 5060 Ti 16GB โ†’ ~2,817.8 yes 200k ~$429
NVIDIA GeForce RTX 5060 Ti 8GB โ†’ ~2,817.8 yes 87k ~$379
Intel Arc Pro B60 โ†’ ~2,373.6 yes 312k โ€”
Intel Arc B580 12GB โ†’ ~2,373.6 yes 143k ~$249
NVIDIA GeForce RTX 4060 Ti 8GB โ†’ ~1,811.5 yes 87k ~$399
NVIDIA GeForce RTX 4060 Ti 16GB โ†’ ~1,811.5 yes 200k ~$499
NVIDIA DGX Spark โ†’ ~1,717.1 yes 1733k ~$3,999
AMD Ryzen AI Max+ 395 โ†’ ~1,425.1 yes 1733k ~$1,999
Intel Arc Pro B50 โ†’ ~1,166 yes 200k โ€”
NVIDIA GeForce RTX 2050 Mobile โ†’ ~704.5 yes 31k โ€”

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

FAQ

What Consumer GPU hardware runs Transformer (Adaptive Input Embeddings) WT103?โ–ถ

On GenAIList, 33 Consumer GPU options can run Transformer (Adaptive Input Embeddings) WT103 at Q4 โ€” the fastest is the NVIDIA GeForce RTX 5090 at ~11,271.3 tok/s.

How fast is Transformer (Adaptive Input Embeddings) WT103 on Consumer GPU hardware?โ–ถ

Estimated generation speed ranges from ~704.5 to ~11,271.3 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.