// RUN ON DATACENTER GPU

Run Qwen1.5-110B on Datacenter GPU hardware

10 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
NVIDIA B200 โ†’ ~113 yes 346k โ€”
AMD Instinct MI325X โ†’ ~75 yes 526k โ€”
NVIDIA H200 โ†’ ~67.8 yes 203k โ€”
AMD Instinct MI300X 192GB โ†’ ~66.3 yes 346k ~$15,000
NVIDIA H100 SXM5 80GB โ†’ ~47.3 yes 32k ~$30,000
Intel Gaudi 3 โ†’ ~43.2 yes 167k โ€”
NVIDIA A100 SXM4 80GB โ†’ ~28.8 yes 32k ~$15,000
NVIDIA H100 PCIe 80GB โ†’ ~28.2 yes 32k ~$25,000
NVIDIA A100 PCIe 80GB โ†’ ~27.3 yes 32k ~$12,000
NVIDIA RTX PRO 6000 Blackwell โ†’ ~25.3 yes 77k ~$8,500

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

FAQ

What Datacenter GPU hardware runs Qwen1.5-110B?โ–ถ

On GenAIList, 10 Datacenter GPU options can run Qwen1.5-110B at Q4 โ€” the fastest is the NVIDIA B200 at ~113 tok/s.

How fast is Qwen1.5-110B on Datacenter GPU hardware?โ–ถ

Estimated generation speed ranges from ~25.3 to ~113 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.