// RUN โ€” FITS

Can the Apple M2 Max 32GB run Stable Diffusion 3.5 Large?

Yes โ€” here's how fast and up to what context, with real measured numbers.

Stable Diffusion 3.5 Large on the Apple M2 Max 32GB

QuantFits?Max contextSpeedBeyond context
FP16 yes 85k 16.8-20.2 t/s ~0.4-0.5 (slow)
Q8 yes 146k 33.6-40.5 t/s ~0.8-1 (slow)
Q4 yes 174k 60-72.3 t/s ~1.5-1.8 (slow)

Estimate (memory-bound). Beyond "max context" the KV cache spills to SSD swap and speed drops to the "beyond" figure.

FAQ

Can the Apple M2 Max 32GB run Stable Diffusion 3.5 Large?โ–ถ

Yes. At Q4 it generates ~60-72.3 tok/s and fits up to 174k context; beyond that it spills to SSD swap and slows to ~1.5-1.8 tok/s.

How much context fits?โ–ถ

At Q4, up to about 174k tokens stay in fast memory; longer context spills to SSD swap and throughput collapses.