I'm trying to run a model locally on Windows, but I get a 'CUDA out of memory' error. Does Jan support CPU-only inference?

[ammiyo]

any answers?

[isthatpratham]

Yes, Jan supports CPU-only inference. When downloading a model, ensure you select a quantized version (like Q4_K_M) which is lighter on RAM. You can also force CPU usage in the settings if your GPU memory is limited.