Multi-GPU support ?

[skrew]

Hi,

I have 11 GPU in my server but the script don't spread across gpu, which end with an out of memory error.

Any multi-gpu support in the future ?

[EndlessSora]

Thank you for your suggestion. We will try to improve memory usage for users' convenience. We also welcome community contributions.

We have released our Hugging Face online demo. Please feel free to try it: https://huggingface.co/spaces/ByteDance/InfiniteYou-FLUX

[EndlessSora]

We have provided quantization and offloading options to reduce the memory requirements for our models. There are also some additional tips there. Thanks!