How to condition on an image?

[amirshamaei]

I was wondering if it is possible to condition the input on an image? since the scale size is (Bdim) so how we can scale the input (BLdim) using an image. Should I patch the image to size of (B, pp , dim)?

[tanghengjian]

you mean text condition ? if so, i will try to make it , but the data preparation of text-image pairs may spent a lot .

[emergencyd]

I guess you can refer to latent diffusion inpainting. Just concat your encoded input image, resized condition mask, encoded masked image to a multi-channel input.