// RUN โ€” FITS

Can the NVIDIA GeForce RTX 2050 run Maestrale Chat v0.4?

Yes โ€” here's how fast and up to what context, with real measured numbers.

Maestrale Chat v0.4 on the NVIDIA GeForce RTX 2050

QuantFits?Max contextSpeedBeyond context
FP16 no โ€” โ€” โ€”
Q8 no โ€” โ€” โ€”
Q4 yes 8k 20.9-24.9 t/s ~1.9-2.2 (slow)

Estimate (memory-bound). Beyond "max context" the KV cache spills to SSD swap and speed drops to the "beyond" figure.

FAQ

Can the NVIDIA GeForce RTX 2050 run Maestrale Chat v0.4?โ–ถ

Yes. At Q4 it generates ~20.9-24.9 tok/s and fits up to 8k context; beyond that it spills to SSD swap and slows to ~1.9-2.2 tok/s.

How much context fits?โ–ถ

At Q4, up to about 8k tokens stay in fast memory; longer context spills to SSD swap and throughput collapses.