// RUN ON DATACENTER GPU

Run Japanese StableLM Base Alpha 7B on Datacenter GPU hardware

13 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
NVIDIA B200 โ†’ ~1,775.5 yes 1306k โ€”
AMD Instinct MI325X โ†’ ~1,178.6 yes 1756k โ€”
NVIDIA H200 โ†’ ~1,065.3 yes 948k โ€”
AMD Instinct MI300X 192GB โ†’ ~1,041.1 yes 1306k ~$15,000
NVIDIA H100 SXM5 80GB โ†’ ~743.5 yes 520k ~$30,000
Intel Gaudi 3 โ†’ ~679.6 yes 857k โ€”
NVIDIA A100 SXM4 80GB โ†’ ~452.5 yes 520k ~$15,000
NVIDIA H100 PCIe 80GB โ†’ ~443.9 yes 520k ~$25,000
NVIDIA A100 PCIe 80GB โ†’ ~429.5 yes 520k ~$12,000
NVIDIA RTX PRO 6000 Blackwell โ†’ ~397.7 yes 632k ~$8,500
NVIDIA RTX 6000 Ada 48GB โ†’ ~213.1 yes 296k ~$6,800
NVIDIA L40S 48GB โ†’ ~191.8 yes 296k ~$10,000
AMD Radeon Pro W7900 48GB โ†’ ~169.7 yes 296k ~$3,999

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

FAQ

What Datacenter GPU hardware runs Japanese StableLM Base Alpha 7B?โ–ถ

On GenAIList, 13 Datacenter GPU options can run Japanese StableLM Base Alpha 7B at Q4 โ€” the fastest is the NVIDIA B200 at ~1,775.5 tok/s.

How fast is Japanese StableLM Base Alpha 7B on Datacenter GPU hardware?โ–ถ

Estimated generation speed ranges from ~169.7 to ~1,775.5 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.