// RUN โ€” FITS

Can the Apple M4 Max 36GB run Emu2?

Yes โ€” here's how fast and up to what context, with real measured numbers.

Emu2 on the Apple M4 Max 36GB

QuantFits?Max contextSpeedBeyond context
FP16 no โ€” โ€” โ€”
Q8 no โ€” โ€” โ€”
Q4 yes 39k 17.9-21.6 t/s ~0.3-0.4 (slow)

Estimate (memory-bound). Beyond "max context" the KV cache spills to SSD swap and speed drops to the "beyond" figure.

FAQ

Can the Apple M4 Max 36GB run Emu2?โ–ถ

Yes. At Q4 it generates ~17.9-21.6 tok/s and fits up to 39k context; beyond that it spills to SSD swap and slows to ~0.3-0.4 tok/s.

How much context fits?โ–ถ

At Q4, up to about 39k tokens stay in fast memory; longer context spills to SSD swap and throughput collapses.