// LOCAL-GENAI HARDWARE

Hardware for local LLMs

GPUs and unified-memory systems ranked for running downloadable models — memory, bandwidth, max model, estimated tokens/sec.

Missing something? Add it.
17 devices
Apple M4 Max 128GB Consumer

Apple M4 Max 128GB

Apple
128GB
Memory
546 GB/s
Bandwidth
195B
Max model Q4
82.9-99.9
8B Q4 tok/s
Apple M4 Max 64GB Consumer

Apple M4 Max 64GB

Apple
64GB
Memory
546 GB/s
Bandwidth
95B
Max model Q4
82.9-99.9
8B Q4 tok/s
Apple M4 Max 48GB Consumer

Apple M4 Max 48GB

Apple
48GB
Memory
546 GB/s
Bandwidth
69.5B
Max model Q4
82.9-99.9
8B Q4 tok/s
Apple M4 Max 36GB Consumer

Apple M4 Max 36GB

Apple
36GB
Memory
546 GB/s
Bandwidth
50B
Max model Q4
82.9-99.9
8B Q4 tok/s
Apple M3 Max 128GB Consumer

Apple M3 Max 128GB

Apple
128GB
Memory
400 GB/s
Bandwidth
195B
Max model Q4
60.7-73.2
8B Q4 tok/s
Apple M2 Max 96GB Consumer

Apple M2 Max 96GB

Apple
96GB
Memory
400 GB/s
Bandwidth
146.5B
Max model Q4
60.7-73.2
8B Q4 tok/s
Apple M1 Max 64GB Consumer

Apple M1 Max 64GB

Apple
64GB
Memory
400 GB/s
Bandwidth
95B
Max model Q4
60.7-73.2
8B Q4 tok/s
Apple M3 Max 64GB Consumer

Apple M3 Max 64GB

Apple
64GB
Memory
400 GB/s
Bandwidth
95B
Max model Q4
60.7-73.2
8B Q4 tok/s
Apple M2 Max 64GB Consumer

Apple M2 Max 64GB

Apple
64GB
Memory
400 GB/s
Bandwidth
95B
Max model Q4
60.7-73.2
8B Q4 tok/s
Apple M3 Max 48GB Consumer

Apple M3 Max 48GB

Apple
48GB
Memory
400 GB/s
Bandwidth
69.5B
Max model Q4
60.7-73.2
8B Q4 tok/s
Apple M1 Max 32GB Consumer

Apple M1 Max 32GB

Apple
32GB
Memory
400 GB/s
Bandwidth
43.5B
Max model Q4
60.7-73.2
8B Q4 tok/s
Apple M2 Max 32GB Consumer

Apple M2 Max 32GB

Apple
32GB
Memory
400 GB/s
Bandwidth
43.5B
Max model Q4
60.7-73.2
8B Q4 tok/s
Apple M3 Max 36GB Consumer

Apple M3 Max 36GB

Apple
36GB
Memory
300 GB/s
Bandwidth
50B
Max model Q4
45.5-54.9
8B Q4 tok/s
Apple M2 Ultra 192GB Prosumer

Apple M2 Ultra 192GB

Apple
192GB
Memory
800 GB/s
Bandwidth
298B
Max model Q4
121.4-146.4
8B Q4 tok/s
Apple M1 Ultra 128GB Prosumer

Apple M1 Ultra 128GB

Apple
128GB
Memory
800 GB/s
Bandwidth
195B
Max model Q4
121.4-146.4
8B Q4 tok/s
Apple M2 Ultra 64GB Prosumer

Apple M2 Ultra 64GB

Apple
64GB
Memory
800 GB/s
Bandwidth
95B
Max model Q4
121.4-146.4
8B Q4 tok/s
Apple M1 Ultra 64GB Prosumer

Apple M1 Ultra 64GB

Apple
64GB
Memory
800 GB/s
Bandwidth
95B
Max model Q4
121.4-146.4
8B Q4 tok/s

How to read this

Two numbers dominate local inference: memory (how big a model + context fits) and bandwidth (token speed). Click any hardware for the full size×quant matrix, max usable context and measured reports, or browse runtimes.