Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Guide] Significally increase speed with sd 2.1 turbo #57

Open
light-and-ray opened this issue Jan 7, 2024 · 7 comments
Open

[Guide] Significally increase speed with sd 2.1 turbo #57

light-and-ray opened this issue Jan 7, 2024 · 7 comments

Comments

@light-and-ray
Copy link

light-and-ray commented Jan 7, 2024

In webui was added support of sd_turbo. It's generally turbo version of sd 2.1 512. I've tested, and it works nice with StableSR. You need to:

  1. update webui to 1.7.0 version
  2. download sd_turbo model
  3. (upd webui 1.8 has native lcm sampler support) install lcm sampler or use it from animate-diff extension, if you have it installed
  4. install StableSR 512 model
  5. decrease sampling steps to 4
  6. use Stable SR stablesr_webui_sd-v2-1-512-ema-000117 with sd_turbo
@light-and-ray light-and-ray changed the title [Guide] Signufically increase speed with sd 2.1 turbo [Guide] Significally increase speed with sd 2.1 turbo Jan 10, 2024
@IceClear IceClear pinned this issue Jan 12, 2024
@IceClear
Copy link
Collaborator

The 768 model should also work? I guess.

@light-and-ray
Copy link
Author

The 768 model should also work? I guess.

There's no sd turbo for the 768 model. Stablesr768 + sd 2.1 512 doesn't work

@light-and-ray
Copy link
Author

Also I've noticed higher number of steps produces more blurred image. So 4 steps not only the fastest, it also has the best quality. 3 and less produce a lot of artifacts

@IceClear
Copy link
Collaborator

Also I've noticed higher number of steps produces more blurred image. So 4 steps not only the fastest, it also has the best quality. 3 and less produce a lot of artifacts

I guess it is because sd turbo directly distilled on 4 steps. I will consider finetuning current model on the sd turbo if I have time later :)Thx for your help.

@CCpt5
Copy link

CCpt5 commented Jan 16, 2024

Also I've noticed higher number of steps produces more blurred image. So 4 steps not only the fastest, it also has the best quality. 3 and less produce a lot of artifacts

I guess it is because sd turbo directly distilled on 4 steps. I will consider finetuning current model on the sd turbo if I have time later :)Thx for your help.

First of all, I love all the work you've done on this. The results are brilliant and I've used StableSR successfully for months now.

I was curious if there's still a plan to eventually release an SDXL model? Or did that idea get abandoned? Perhaps due to time or feasibility?

@IceClear
Copy link
Collaborator

Hi. Thx for your interest and glad to hear that.
We are interested in developing a XL version. But I am currently struggling with my PhD projects and may not be available for that.

@IceClear IceClear unpinned this issue Jan 17, 2024
@IceClear IceClear pinned this issue Jan 17, 2024
@CCpt5
Copy link

CCpt5 commented Mar 22, 2024

Heads up that an SD2.1 model (LoRA) with similar low step inference was recently released here: https://huggingface.co/h1t/TCD-SD21-base-LoRA

They use a method called Trajectory Consistency Distillation (TCD) as explained in their paper here: https://arxiv.org/abs/2402.19159

Any thoughts on whether or not this would work with StableSR similar to how Turbo has? If so it's worth checking to see if their model was trained to also work w/ the 768x768 resolution.

If anyone gives it a go before I get a chance please report your findings!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants