What's the "hint" image used for training the inpaint controlnet model?

[zjintheroom]

In the tutorial, it is mentioned that a "hint" image is used when training controlnet models. but for the inpainting process, there's a original image and a binary mask image. I would like to know that which image is used as "hint" image when training the inpainting controlnet model? Thanks in advance!

[geroldmeisinger]

I'm also interested for more information on this please! What I found out so far is you can use images with alpha channels for training. I believe the inpainting model was trained with RGB+A.
also see here #271

[donggoing]

Anythings new? I would like to finetune the SD2.1 for multicontrol (Inpainting + xx). But i am not sure how the inpainting been trained, if i just need to change the hint "image" to give the masked-image and mask info? Or it there something more i need to do?

[geroldmeisinger]

also see here lllyasviel/ControlNet-v1-1-nightly#89