// RUN โ€” FITS

Can the Apple M1 Max 64GB run North Mini Code 1.0?

Yes โ€” here's how fast and up to what context, with real measured numbers.

North Mini Code 1.0 on the Apple M1 Max 64GB

QuantFits?Max contextSpeedBeyond context
FP16 no โ€” โ€” โ€”
Q8 yes 100k 9.1-10.9 t/s ~0.2-0.3 (slow)
Q4 yes 150k 16.2-19.5 t/s ~0.4-0.5 (slow)

Estimate (memory-bound). Beyond "max context" the KV cache spills to SSD swap and speed drops to the "beyond" figure.

FAQ

Can the Apple M1 Max 64GB run North Mini Code 1.0?โ–ถ

Yes. At Q4 it generates ~16.2-19.5 tok/s and fits up to 150k context; beyond that it spills to SSD swap and slows to ~0.4-0.5 tok/s.

How much context fits?โ–ถ

At Q4, up to about 150k tokens stay in fast memory; longer context spills to SSD swap and throughput collapses.