// RUN ON DATACENTER GPU

Run ERNIE-4.5-300B-A47B on Datacenter GPU hardware

3 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
NVIDIA B200 โ†’ ~41.4 yes 14k โ€”
AMD Instinct MI325X โ†’ ~27.5 yes 126k โ€”
AMD Instinct MI300X 192GB โ†’ ~24.3 yes 14k ~$15,000

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

FAQ

What Datacenter GPU hardware runs ERNIE-4.5-300B-A47B?โ–ถ

On GenAIList, 3 Datacenter GPU options can run ERNIE-4.5-300B-A47B at Q4 โ€” the fastest is the NVIDIA B200 at ~41.4 tok/s.

How fast is ERNIE-4.5-300B-A47B on Datacenter GPU hardware?โ–ถ

Estimated generation speed ranges from ~24.3 to ~41.4 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.