// RUN โ€” FITS

Can the Intel Arc Pro B70 run FunSearch?

Yes โ€” here's how fast and up to what context, with real measured numbers.

FunSearch on the Intel Arc Pro B70

QuantFits?Max contextSpeedBeyond context
FP16 no โ€” โ€” โ€”
Q8 yes 49k 23.5-29.2 t/s ~1.5-1.9 (slow)
Q4 yes 75k 42-52.1 t/s ~2.8-3.4 (slow)

Estimate (memory-bound). Beyond "max context" the KV cache spills to system RAM offload (depends on your system RAM) and speed drops to the "beyond" figure.

FAQ

Can the Intel Arc Pro B70 run FunSearch?โ–ถ

Yes. At Q4 it generates ~42-52.1 tok/s and fits up to 75k context; beyond that it spills to system RAM offload (depends on your system RAM) and slows to ~2.8-3.4 tok/s.

How much context fits?โ–ถ

At Q4, up to about 75k tokens stay in fast memory; longer context spills to system RAM offload (depends on your system RAM) and throughput collapses.