// RUN ON DATACENTER GPU

Run AWD-LSTM-DRILL + dynamic evaluation† (WT2) on Datacenter GPU hardware

13 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
NVIDIA B200 → ~365,546.2 yes 2672k
AMD Instinct MI325X → ~242,647.1 yes 3571k
NVIDIA H200 → ~219,327.7 yes 1956k
AMD Instinct MI300X 192GB → ~214,338.2 yes 2672k ~$15,000
NVIDIA H100 SXM5 80GB → ~153,072.5 yes 1100k ~$30,000
Intel Gaudi 3 → ~139,916 yes 1774k
NVIDIA A100 SXM4 80GB → ~93,168.6 yes 1100k ~$15,000
NVIDIA H100 PCIe 80GB → ~91,386.6 yes 1100k ~$25,000
NVIDIA A100 PCIe 80GB → ~88,416.5 yes 1100k ~$12,000
NVIDIA RTX PRO 6000 Blackwell → ~81,882.4 yes 1324k ~$8,500
NVIDIA RTX 6000 Ada 48GB → ~43,865.5 yes 651k ~$6,800
NVIDIA L40S 48GB → ~39,479 yes 651k ~$10,000
AMD Radeon Pro W7900 48GB → ~34,941.2 yes 651k ~$3,999

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

FAQ

What Datacenter GPU hardware runs AWD-LSTM-DRILL + dynamic evaluation† (WT2)?

On GenAIList, 13 Datacenter GPU options can run AWD-LSTM-DRILL + dynamic evaluation† (WT2) at Q4 — the fastest is the NVIDIA B200 at ~365,546.2 tok/s.

How fast is AWD-LSTM-DRILL + dynamic evaluation† (WT2) on Datacenter GPU hardware?

Estimated generation speed ranges from ~34,941.2 to ~365,546.2 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.