Skip to content

Commit

Permalink
Merge pull request #324 from alibaba/diffusion_inpaint
Browse files Browse the repository at this point in the history
add inpaint pipeline tutorial
  • Loading branch information
chywang committed Jul 6, 2023
2 parents 411e708 + 00b1ec2 commit c058aae
Showing 1 changed file with 19 additions and 0 deletions.
19 changes: 19 additions & 0 deletions diffusion/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,25 @@ image.save("result.png")

如果需要使用其他模型,只需要替换对应model_id的值即可。

### 文本引导的局部重绘

使用 mask 遮盖部分区域,对图像中部分细节进行修改,示例脚本如下:

```python
from diffusers import StableDiffusionInpaintPipeline
from PIL import Image

image = Image.open("image.png")
mask_image = Image.open("mask_image.png")

model_id = "alibaba-pai/pai-diffusion-artist-large-zh"
pipe = StableDiffusionInpaintPipeline.from_pretrained(model_id)
pipe = pipe.to("cuda")
prompt = "输入文本"
image = pipe(prompt=prompt, image=image, mask_image=mask_image, strength=0.8).images[0]
image.save("result.png")
```

### 可控的图像生成

我们提供了两个 ControlNet 模型,您可以使用 ControlNet 模型进行可控的图像生成,示例脚本如下:
Expand Down

0 comments on commit c058aae

Please sign in to comment.