[WIP][Community Pipeline] ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models

[ayushtues]

ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models

Adding ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models : https://yingqinghe.github.io/scalecrafter/ as a community pipeline as discussed in #5442

TLDR from github repo : ScaleCrafter is capable of generating images with a resolution of 4096 x 4096 and videos with a resolution of 2048 x 1152 based on pre-trained diffusion models on a lower resolution. Notably, our approach needs no extra training/optimization.

Code: https://github.com/yingqinghe/scalecrafter
Project Page : https://yingqinghe.github.io/scalecrafter/

TO-DO

• Pipeline Code
• Add documentation
• Pass tests

CC

@patrickvonplaten @sayakpaul @DN6

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

[sayakpaul]

Could be also cool to do it with: #5472

[sayakpaul]

@ayushtues could you please fix the styling issues and take care of the documentation? I think we can merge it afterwards.

[ayushtues]

@sayakpaul can you please look into the comment above?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.