Style Aligned Image Generation via Shared Attention

Setup

This code was tested with Python 3.11, Pytorch 2.1 and Diffusers 0.16.

See style_aligned_sdxl notebook for generating style aligned images using SDXL.

See style_aligned_transfer_sdxl notebook for generating images with a style from reference image using SDXL.

See style_aligned_w_controlnet notebook for generating style aligned and depth conditioned images using SDXL with ControlNet-Depth.

style_aligned_w_multidiffusion can be used for generating style aligned panoramas using SD V2 with MultiDiffusion.

To start a demo locally, simply run

python <demo file name>.py

and enter the demo in your browser using the provided url.

An online demo of ControlNet + StyleAligned is available here.

This is not an officially supported Google product.

Name		Name	Last commit message	Last commit date
Latest commit History 25 Commits
doc		doc
example_image		example_image
LICENSE		LICENSE
README.md		README.md
contributing.md		contributing.md
demo_stylealigned_controlnet.py		demo_stylealigned_controlnet.py
demo_stylealigned_multidiffusion.py		demo_stylealigned_multidiffusion.py
demo_stylealigned_sdxl.py		demo_stylealigned_sdxl.py
inversion.py		inversion.py
pipeline_calls.py		pipeline_calls.py
requirements.txt		requirements.txt
sa_handler.py		sa_handler.py
style_aligned_sd1.ipynb		style_aligned_sd1.ipynb
style_aligned_sdxl.ipynb		style_aligned_sdxl.ipynb
style_aligned_transfer_sdxl.ipynb		style_aligned_transfer_sdxl.ipynb
style_aligned_w_controlnet.ipynb		style_aligned_w_controlnet.ipynb
style_aligned_w_multidiffusion.ipynb		style_aligned_w_multidiffusion.ipynb