- 
                Notifications
    You must be signed in to change notification settings 
- Fork 6.5k
Add notebook doc img2img #2472
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add notebook doc img2img #2472
Conversation
| The documentation is not available anymore as the PR was closed or merged. | 
| # Text-Guided Image-to-Image Generation | ||
|  | ||
| The [`StableDiffusionImg2ImgPipeline`] lets you pass a text prompt and an initial image to condition the generation of new images. | ||
| [[open-in-colab]] | 
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Where is the corresponding generated google colab?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you also link the google colab that is automatically generated from this doc?
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
| @patrickvonplaten I think with this line  Maria and Steven told me so - we can merge this one and see what happens. | 
|  | ||
| As you can see, when using a lower value for `strength`, the generated image is more closer to the original `image` | ||
|  | ||
| Now let's use a different scheduler - [LMSDiscreteScheduler](https://huggingface.co/docs/diffusers/api/schedulers#diffusers.LMSDiscreteScheduler) | 
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| Now let's use a different scheduler - [LMSDiscreteScheduler](https://huggingface.co/docs/diffusers/api/schedulers#diffusers.LMSDiscreteScheduler) | |
| Now let's use a different scheduler - [LMSDiscreteScheduler](https://huggingface.co/docs/diffusers/api/schedulers#diffusers.LMSDiscreteScheduler) | 
Let's use maybe a different scheduler here, such as DPMSolverMultistepScheduler -> LMS requires another dependency and not the best scheduler anymore
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok for me,
Note that the notebooks don't seem to be created automatically yet though - but ok to merge and check later.
Also, let's make sure to use the most up-to-date schedulers in our docs
* convert img2img.mdx into notebook doc * fix * Update docs/source/en/using-diffusers/img2img.mdx Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com> --------- Co-authored-by: yiyixuxu <yixu@yis-macbook-pro.lan> Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
* convert img2img.mdx into notebook doc * fix * Update docs/source/en/using-diffusers/img2img.mdx Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com> --------- Co-authored-by: yiyixuxu <yixu@yis-macbook-pro.lan> Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
* convert img2img.mdx into notebook doc * fix * Update docs/source/en/using-diffusers/img2img.mdx Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com> --------- Co-authored-by: yiyixuxu <yixu@yis-macbook-pro.lan> Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
This PR is the first example of how we can integrate the notebook into the doc page itself
for https://huggingface.co/docs/diffusers/using-diffusers/img2img
there are a lot of other doc pages that have a link to a colab notebook - plan to integrate them all after I get feedback for this one (so that we don't have to maintain these notebooks separately)
for example
https://huggingface.co/docs/diffusers/stable_diffusion
https://huggingface.co/docs/diffusers/using-diffusers/inpaint
https://huggingface.co/docs/diffusers/using-diffusers/rl
https://huggingface.co/docs/diffusers/using-diffusers/other-modalities