docs: update diffusers multi-GPU documentation to mention tensor_parallel_size configuration#8621
Conversation
✅ Deploy Preview for localai ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
Head branch was pushed to by a user without write access
3685bc4 to
e24d4bf
Compare
Head branch was pushed to by a user without write access
e24d4bf to
6bb1064
Compare
…llel_size configuration
Head branch was pushed to by a user without write access
6bb1064 to
e47f9d8
Compare
|
I've updated the documentation to clearly explain the multi-GPU configuration for diffusers. The changes include: Summary of Changes1. backend/python/diffusers/README.mdAdded a new section explaining multi-GPU configuration with :
2. docs/content/features/GPU-acceleration.mdReorganized the multi-GPU section to be more prominent:
How to Use Multi-GPU with DiffusersTo use diffusers with multiple GPUs, configure your model with set to the number of GPUs you want to use: When , the backend automatically enables to distribute the model across multiple GPUs. This works with all diffusers pipelines (text-to-image, image-to-image, inpainting, etc.). For more details, see: |
Head branch was pushed to by a user without write access
This PR updates the documentation for diffusers multi-GPU support to clearly explain the tensor_parallel_size configuration parameter.
Changes
backend/python/diffusers/README.md
docs/content/features/GPU-acceleration.md