MultiGPU-Support

[gitmr0580]

Hi, I like "clara" a lot.
Is there any chance for adding multi-gpu support? I have two rtx 3090 and one rtx3060. It would be awesome to put a bigger Model on one 3090, Flux for comfy on the other 3090 and finally a smaller one on the 3060.
Currently only 24GB of memory space (one 3090) is available in the settings section @hardware Acceleration.

[badboysm890]

yes we are brining in a dedicated clara-core that is just an dropin replacement to ollama supporting all gguf model soo whihc will have all the standard feature that a dev or enthusiast might need