// RUN — FITS

Can the GMKtec EVO-X3 run Qwen2-0.5B?

Yes — here's how fast and up to what context, with real measured numbers.

Qwen2-0.5B on the GMKtec EVO-X3

QuantFits?Max contextSpeedBeyond context
FP16 yes 1720k 166.4-202.2 t/s ~6.5-7.9 (slow)
Q8 yes 1727k 332.8-404.5 t/s ~13-15.8 (slow)
Q4 yes 1731k 594.3-722.3 t/s ~23.2-28.2 (slow)

Estimate (memory-bound). Beyond "max context" the KV cache spills to SSD swap and speed drops to the "beyond" figure.

→ All models on the GMKtec EVO-X3 → Qwen2-0.5B specs → Other hardware

FAQ

Can the GMKtec EVO-X3 run Qwen2-0.5B?▶

Yes. At Q4 it generates ~594.3-722.3 tok/s and fits up to 1731k context; beyond that it spills to SSD swap and slows to ~23.2-28.2 tok/s.

How much context fits?▶

At Q4, up to about 1731k tokens stay in fast memory; longer context spills to SSD swap and throughput collapses.