// RUN ON APPLE

Run dots.llm1 on Apple hardware

5 options ranked by estimated speed at Q4 / 8k context.

HardwareEst tok/sFits 8k?Max ctx~Price
Apple M2 Ultra 192GB โ†’ ~8.2 yes 280k ~$6,600
Apple M1 Ultra 128GB โ†’ ~8.2 yes 104k ~$4,800
Apple M4 Max 128GB โ†’ ~5.6 yes 104k ~$4,900
Apple M3 Max 128GB โ†’ ~4.1 yes 104k ~$4,700
Apple M2 Max 96GB โ†’ ~4.1 yes 16k ~$3,300

Estimate at Q4 (memory-bound). Click any option for its full per-hardware estimate and measured numbers.

FAQ

What Apple hardware runs dots.llm1?โ–ถ

On GenAIList, 5 Apple options can run dots.llm1 at Q4 โ€” the fastest is the Apple M2 Ultra 192GB at ~8.2 tok/s.

How fast is dots.llm1 on Apple hardware?โ–ถ

Estimated generation speed ranges from ~4.1 to ~8.2 tok/s at Q4 (memory-bandwidth bound). Click any option for its full estimate and any measured numbers.