// RUN ON DATACENTER GPU

Run Orion Star (猎户星空大模型) on Datacenter GPU hardware

13 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
NVIDIA B200 → ~887.8 yes 1021k
AMD Instinct MI325X → ~589.3 yes 1380k
NVIDIA H200 → ~532.7 yes 735k
AMD Instinct MI300X 192GB → ~520.5 yes 1021k ~$15,000
NVIDIA H100 SXM5 80GB → ~371.7 yes 392k ~$30,000
Intel Gaudi 3 → ~339.8 yes 662k
NVIDIA A100 SXM4 80GB → ~226.3 yes 392k ~$15,000
NVIDIA H100 PCIe 80GB → ~221.9 yes 392k ~$25,000
NVIDIA A100 PCIe 80GB → ~214.7 yes 392k ~$12,000
NVIDIA RTX PRO 6000 Blackwell → ~198.9 yes 482k ~$8,500
NVIDIA RTX 6000 Ada 48GB → ~106.5 yes 213k ~$6,800
NVIDIA L40S 48GB → ~95.9 yes 213k ~$10,000
AMD Radeon Pro W7900 48GB → ~84.9 yes 213k ~$3,999

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

FAQ

What Datacenter GPU hardware runs Orion Star (猎户星空大模型)?

On GenAIList, 13 Datacenter GPU options can run Orion Star (猎户星空大模型) at Q4 — the fastest is the NVIDIA B200 at ~887.8 tok/s.

How fast is Orion Star (猎户星空大模型) on Datacenter GPU hardware?

Estimated generation speed ranges from ~84.9 to ~887.8 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.