-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Text + partial image prompting #34
Comments
Good question! I am also being curious whether it is possible with the provided source code. |
@hyungkwonko Yes it sure does, I already implemented and tested on my own, need some coding Just pass the x0 and mask into the DDIM sampler, and you can do inpainting while using text prompts @cachett-ML for your case, mask the image (eg. only the top half), then do the inpainting with text prompts, however, you can do the same, but I have no clue if it would work... IMO, a more decent approch may consider conditioning on visible areas during training, rather than utilizing this text conditioned txt2img model to do the inpainting task, but this model is so far the best we can get our hands on : )
Hope it helps, cheers For the complete code of txt2img.py, i made a pull request below, see |
Hey @lxj616, |
Hi !
In Dall-E, we can provide a partial image in addition to the text description so that the model only completes the image. See:
Can we do the same with your models? That would be awesome.
I tried to modify the LAION-400M model notebook but without much success.
The text was updated successfully, but these errors were encountered: