// RUN ON DATACENTER GPU

Run Voxtral Small on Datacenter GPU hardware

10 options with enough VRAM (FP16), ranked by headroom.

HardwareVRAMFits FP16?Headroom~Price
AMD Instinct MI325X → 256 GB yes ~185.4 GB
NVIDIA B200 → 192 GB yes ~126.5 GB
AMD Instinct MI300X 192GB → 192 GB yes ~126.5 GB ~$15,000
NVIDIA H200 → 141 GB yes ~79.6 GB
Intel Gaudi 3 → 128 GB yes ~67.7 GB
NVIDIA RTX PRO 6000 Blackwell → 96 GB yes ~38.2 GB ~$8,500
NVIDIA H100 SXM5 80GB → 80 GB yes ~23.5 GB ~$30,000
NVIDIA A100 SXM4 80GB → 80 GB yes ~23.5 GB ~$15,000
NVIDIA H100 PCIe 80GB → 80 GB yes ~23.5 GB ~$25,000
NVIDIA A100 PCIe 80GB → 80 GB yes ~23.5 GB ~$12,000

VRAM fit at FP16 (lower precision needs less). We don't estimate generation speed for image/video/audio — it depends on tool, resolution and steps.

FAQ

What Datacenter GPU hardware can run Voxtral Small?

On GenAIList, 10 Datacenter GPU GPUs have enough VRAM to hold Voxtral Small at FP16 — the most headroom is on the AMD Instinct MI325X (256 GB).

How fast is Voxtral Small on Datacenter GPU hardware?

We don't estimate generation speed for image/video/audio models — it depends on the tool, resolution and step count. This page ranks by which hardware fits the model in memory.