Worse quality on every "iteration" of inpainting

[user425846]

Hi,

whenever i send an inpainted image back to inpainting and do another inpainting prompt, the quality of the image gets progessively worse. I have seen people inpainting for hours with stable diffusion with hundreds or thousand iterations and no loss in quality. Is there anything i can do about that? Why is it so different between SD and Kandinsky?

[user425846]

I have attached 3 images here doing some random inpainting, 1. the starting image, 2. after some inpainting, 3. after more inpainting. You can see the quality getting progressively worse. It is obviously caused by saving and putting in the PNG over and over again, but im wondering how we can do inpainting without quality loss.

[seruva19]

Yes, I noticed the same (#23). Clearly there is something wrong about the conversion of the input image. Maybe I will need to rewrite the whole inpainting method :(

[user425846]

Okay interesting, sorry for not seeing the previous issue.

Here is an example using diffusers: https://huggingface.co/kandinsky-community/kandinsky-2-1-inpaint and even in their sample image you can already see a degradation in quality / colors from just one inpainting

[seruva19]

Yes, that's weird.
There is implementation of inpainting in Kandinsky extension for Automatic (https://github.com/MMqd/kandinsky-for-automatic1111/blob/main/scripts/kandinsky.py) - I have to check if it works properly and if it does, I will adapt their code.

[user425846]

I will give it a shot, will get back to you when i tested it

[user425846]

Okay, so, in this extension, there is a setting called "inpaint area", with 2 options: "Whole picture" and "only masked". These are different options from the masking. The masking still applies, even when choosing whole picture.

When i choose whole picture, i get the same result as with your script, degrading quality. But when i choose only masked, there is no degradation in quality in the rest of the image. However, the edge of the mask is very, very clearly visible and the result of the inpainting is not very good, it doesnt fit as well in the picture as the whole picture mode.

[user425846]

Some examples: 1.png: Initial image, 2.png: Using whole picture mode, it fits very well, but the quality of the rest of the image degrades, 3.png: It fits horribly and the borders of the masking are clearly visible, but not degredation in quality for the rest of the image

[seruva19]

Thank you for your analysis, it's really helpful 👍 I will try to fix it ASAP.