[Feature]: Please take a look at InpaintAnything.

[Subash-Chandra]

Expected behavior

https://github.com/geekyutao/Inpaint-Anything

Their approach to mask creation is pretty good. I think your own mask drawing window could use a few tweaks to make it a bit more intuitive like this.

There should also be a button to upload a mask to Inpaint Upload.

[light-and-ray]

InpaintAnything is very awful extension from code side and UX side by my opinion. It's much easier and faster to use regular inpaint tab

If you want to use only dino + sam features (detection by word), I made a ui tab for sd-webui-segment-anything, where you can use it faster: https://github.com/light-and-ray/sd-webui-replacer

[light-and-ray]

There should also be a button to upload a mask to Inpaint Upload.

It is, look at these videos: https://github.com/continue-revolution/sd-webui-segment-anything?tab=readme-ov-file#demo

[Subash-Chandra]

The most valuable feature that is in InpaintAnything that is not even available in the original Auto1111 img2img tab due to gradio limitations is the ability to remove masks by sketch.

Can you add this feature? Where we can use the points to specify segments, but also add and subtract masks to the original mask by sketch?

[light-and-ray]

I think it's available now in webui gradio 4 branch. Possible will be in webui 1.9 or 1.10, now you can try it in gradio 4 branch

AUTOMATIC1111/stable-diffusion-webui#14184