StableCascade Pipeline

[saddam213]

Pipeline for StableCascade diffusion process

Tasks

• Pipeline Scaffold
• Model Conversion
• DDPMWuerstchenScheduler
• Text To Image
• Image To Image

[AshD]

I added a request on Feb 16 to convert this model in onnx format.
https://huggingface.co/stabilityai/stable-cascade/discussions/16

Will try to see if I can do it next week.

[saddam213]

Success!!!!

Well sort of, Pipeline now runs end to end without errors, all models seem to be accepting the inputs and outputting data

Flow: Tokenizer -> TextEncoder -> PriorUnet -> DecoderUnet -> VQGAN

Output is garbage but that was expected as we need a new Scheduler DDPMWuerstchenScheduler
https://github.com/huggingface/diffusers/blob/main/src/diffusers/schedulers/scheduling_ddpm_wuerstchen.py

Its possible my model conversion is not correct, but we will see once I have the new scheduler implemented

[saddam213]

Its working, woot!!

[saddam213]

Image quality from the new DDPMWuerstchen Scheduler is much better"

an image of a shiba inu, donning a spacesuit and helmet

photo of a cat