Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Request] Finally, Outpainting (like Dally) for SD! #480

Closed
ZeroCool22 opened this issue Sep 14, 2022 · 24 comments
Closed

[Request] Finally, Outpainting (like Dally) for SD! #480

ZeroCool22 opened this issue Sep 14, 2022 · 24 comments
Labels
enhancement New feature or request

Comments

@ZeroCool22
Copy link

ZeroCool22 commented Sep 14, 2022

https://github.com/lkwq007/stablediffusion-infinity

Could you include it in your UI?

lkwq007_stablediffusion-infinity-.Outpainting.with.Stable.Diffusion.on.an.infinite.canvas.mp4

197257616-82c1e58f-7463-4896-8345-6750a828c844

@ZeroCool22 ZeroCool22 changed the title Finally, Outpainting (like Dally) for SD! [Request] Finally, Outpainting (like Dally) for SD! Sep 14, 2022
@aniketgore
Copy link

this looks awesome.

@dingir8
Copy link

dingir8 commented Sep 15, 2022

Please ! <3 Automatic are so wounderfull man for all you already did for us, pls add this its very cool

@kodxana
Copy link

kodxana commented Sep 15, 2022

+1 for this I'm tired of having setup 5 containers for each web ui :D

@1blackbar
Copy link

Im gonna be nitpicky and say it does not convey a styule of the painting , maybe you need to lead with prompt... but yeah it does look good but i think this is using such different UI it would require major rewrite to this one to be able to move rectangle like this

@marquilio7
Copy link

marquilio7 commented Sep 15, 2022

Im gonna be nitpicky and say it does not convey a styule of the painting , maybe you need to lead with prompt... but yeah it does look good but i think this is using such different UI it would require major rewrite to this one to be able to move rectangle like this

You could add a new empty tab in the UI for this

EDIT: I would make the whole canvas and interaction on the client-side

@randecse
Copy link

randecse commented Sep 15, 2022

This would be brilliant! Thanks for everything, Automatic.

@johneliot1978
Copy link

yes please!

@gamerey43
Copy link

i second this

it will help a lot

@gamerey43
Copy link

this would actually simplify the code for outpainting

Automatic this is literally a good idea and it's good the community views your version as the defacto for the most part :)

@MrFelt
Copy link

MrFelt commented Oct 19, 2022

Yeah I would die for this ngl. Would make it easy as heck to outpaint.

@IkariDevGIT
Copy link

pleeeeeease

@Spaceginner
Copy link
Contributor

What about a collab with author of sd infinity?

@Gitterman69
Copy link

please please please please please :)

@Mikerhinos
Copy link

This would be a great addition to me.

@mbloflin
Copy link

I work with very wide images (5:1) and SD does not handle this width well for the most part. With Infinity as part of the webui I could create better images and outpaint the extra width and have a more coherent subject. That would be awesome! Thanks for all that we have so far it has been GREAT.

@ClashSAN
Copy link
Collaborator

try the script basic outpainting canvas test
or the PR #3693

@mezotaken
Copy link
Collaborator

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Extensions#openoutpaint-extension
Reopen if that's not the feature you were requesting for, or it doesn't work as stated.

@Frief84
Copy link

Frief84 commented Jan 6, 2023

@mezotaken
Copy link
Collaborator

@Frief84 Can you elaborate a bit? I can see its missing eraser, and it is obviously different UI, but everything else is in place? Regional outpainting on infinite canvas using local webui installation. It's no problem to reopen the issue, but we need to point out a difference so that someone else who sees the issue could understand this difference and implement it.

@Frief84
Copy link

Frief84 commented Jan 6, 2023

@Frief84 Can you elaborate a bit? I can see its missing eraser, and it is obviously different UI, but everything else is in place? Regional outpainting on infinite canvas using local webui installation. It's no problem to reopen the issue, but we need to point out a difference so that someone else who sees the issue could understand this difference and implement it.

oh yes of course sorry
An eraser is only present...but just on different place

So the first difference I found is the infinite canvas, in the implemented openoutpaint extension it is limited,
which means you can create larger resolutions in this one

The second is that they seem to be trying to keep the style of the first picture without having to mention it in the prompt

transparency is perceived as a mask if selected

those are the two things that struck me as a newbee

@mezotaken
Copy link
Collaborator

mezotaken commented Jan 6, 2023

I see.

  1. Infinite canvas is not infinite in openoutpaint
  2. SDInfinity use interrogation to ensure the same style.

Transparency as a mask is purely inside-job from local inpainting implementation, probably worth a separate issue, this is not connected to openoutpaint.

  1. How long ago it was not infinite? looks like they implemented it about 3 weeks ago:

image
zero01101/openOutpaint#108

  1. About keeping style: which model are you using?

@Frief84
Copy link

Frief84 commented Jan 6, 2023

sd-v1-5-inpainting.ckpt ...
I find stablediffusion-infinityis a bit more user friendly at least for me

@mezotaken mezotaken reopened this Jan 6, 2023
@mezotaken mezotaken added the enhancement New feature or request label Jan 12, 2023
@ClashSAN
Copy link
Collaborator

ClashSAN commented May 1, 2023

This is fulfilled by openoutpaint extension and blinkdl's (painthua ?)

@ClashSAN ClashSAN closed this as completed May 1, 2023
@mikkorantalainen
Copy link

mikkorantalainen commented May 27, 2023

Am I missing something but isn't this simply better UI for inpainting? Basically the UI should display to be rendered tile area (512x512 for low VRAM people) which you can position partially overlapping the existing image and then write a prompt to tell what the area should contain. Then the missing part is automatically masked, the whole to-be-rendered tile area is used as input for img2img and ControlNet with canny/canny model + "pixel perfect" option and position the output when ready.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests