Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: The progress bar is always stuck at 50% for a long time, taking 10 times the time #11050

Closed
1 task done
wzgrx opened this issue Jun 6, 2023 · 27 comments
Closed
1 task done
Labels
bug-report Report of a bug, yet to be confirmed

Comments

@wzgrx
Copy link
Contributor

wzgrx commented Jun 6, 2023

Is there an existing issue for this?

  • I have searched the existing issues and checked the recent builds/commits

What happened?

The progress bar is always stuck at 50% for a long time, taking 10 times the time
Reinstallation has no effect,I haven't touched anything, only updated the SD, and this problem occurred

Steps to reproduce the problem

Reinstallation has no effect

What should have happened?

Generating images at normal speed

Commit where the problem happens

a009fe1

What Python version are you running on ?

Python 3.10.x

What platforms do you use to access the UI ?

Windows

What device are you running WebUI on?

Nvidia GPUs (RTX 20 above), Nvidia GPUs (GTX 16 below)

What browsers do you use to access the UI ?

Microsoft Edge

Command Line Arguments

--medvram --api --autolaunch

List of extensions

multidiffusion-upscaler-for-automatic1111 | https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111 | main | 70b3c5e | Sun May 28 09:11:28 2023
sd-webui-additional-networks | https://github.com/kohya-ss/sd-webui-additional-networks | main | e9f3d622 | Tue May 23 12:31:15 2023
sd-webui-bilingual-localization | https://github.com/journey-ad/sd-webui-bilingual-localization | main | 89a02280 | Thu Apr 27 03:54:25 2023
sd-webui-controlnet | https://github.com/Mikubill/sd-webui-controlnet | main | 7ad8cc8 | Mon Jun 5 23:24:06 2023
sd-webui-prompt-all-in-one | https://github.com/Physton/sd-webui-prompt-all-in-one | main | 2c3653e4 | Sun Jun 4 14:58:02 2023 |
sd-webui-prompt-format | https://github.com/Haoming02/sd-webui-prompt-format | main | 4b0942d2 | Fri Jun 2 13:43:03 2023 | 未知
stable-diffusion-webui-localization-zh_Hans | https://github.com/hanamizuki-ai/stable-diffusion-webui-localization-zh_Hans | master | f09e0d85 | Mon Jun 5 16:00:02 2023 |
stable-diffusion-webui-wd14-tagger | https://github.com/Elziy/stable-diffusion-webui-wd14-tagger | master | 34ddca60 | Sat Apr 22 02:42:59 2023 |
| https://github.com/AUTOMATIC1111/stable-diffusion-webui-wildcards | master | 6ed81ed1 | Sat Oct 29 16:18:48 2022 |
multidiffusion-upscaler-for-automatic1111 https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111 main 70b3c5ea Sun May 28 09:11:28 2023
sd-webui-additional-networks https://github.com/kohya-ss/sd-webui-additional-networks main e9f3d622 Tue May 23 12:31:15 2023
sd-webui-bilingual-localization https://github.com/journey-ad/sd-webui-bilingual-localization main 89a02280 Thu Apr 27 03:54:25 2023
sd-webui-controlnet https://github.com/Mikubill/sd-webui-controlnet main 7ad8cc8e Mon Jun 5 23:24:06 2023 未知
sd-webui-prompt-all-in-one https://github.com/Physton/sd-webui-prompt-all-in-one main 2c3653e4 Sun Jun 4 14:58:02 2023
sd-webui-prompt-format https://github.com/Haoming02/sd-webui-prompt-format main 4b0942d2 Fri Jun 2 13:43:03 2023
stable-diffusion-webui-localization-zh_Hans https://github.com/hanamizuki-ai/stable-diffusion-webui-localization-zh_Hans master f09e0d85 Mon Jun 5 16:00:02 2023
stable-diffusion-webui-wd14-tagger https://github.com/Elziy/stable-diffusion-webui-wd14-tagger master 34ddca60 Sat Apr 22 02:42:59 2023
https://github.com/AUTOMATIC1111/stable-diffusion-webui-wildcards master 6ed81ed1 Sat Oct 29 16:18:48 2022

Console logs

No error reports, just stuck all the time

Additional information

Snipaste_2023-06-06_08-08-15

@wzgrx wzgrx added the bug-report Report of a bug, yet to be confirmed label Jun 6, 2023
@w-e-w
Copy link
Collaborator

w-e-w commented Jun 6, 2023

that's totally normal, your using Hires. fix
Hires. fix is just

  1. usnig txt2img to generate an image at a small resolution then upscale the image
  2. upscale the image
  3. using the upscaled image do img2im generation at a higher resolution

50% the progress bar shows 50% when it findined getting the first small image
then it will do the upscaling
and continue to 100% doing the 2nd pass generation

@w-e-w w-e-w closed this as completed Jun 6, 2023
@w-e-w w-e-w reopened this Jun 6, 2023
@w-e-w
Copy link
Collaborator

w-e-w commented Jun 6, 2023

wait try something in the settings
image
enable that option see if it changes the behavior

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

等待尝试设置图像中的某些内容启用该选项,看看它是否会改变行为

It's completely abnormal. It's stuck at 50% for 7-8 hours and can't generate any images at all. The previous versions were all normal, only updating SD, so it was an issue with SD updates. I reinstalled the latest SD, but it's still the same.

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

这是完全正常的,你使用雇佣。修复只是Hires. fix

  1. USNIG Txt2img 以小分辨率生成图像,然后放大图像
  2. 放大图像
  3. 使用放大的图像以更高的分辨率生成IMG2im

50% 进度条显示 50% 当它发现获得第一个小图像时,它将进行放大并继续 100% 进行第二次传递生成

It's completely abnormal. It's stuck at 50% for 7-8 hours and can't generate any images at all. The previous versions were all normal, only updating SD, so it was an issue with SD updates. I reinstalled the latest SD, but it's still the same.Previously, the same settings were magnified twice and took 5 minutes. Now, it takes 7-8 hours to get stuck at 50%. After restarting the computer and reinstalling SD, the same goes for it.

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

等待尝试设置image中的某些内容启用该选项,看看它是否会改变行为

According to your method, it's still the same, always stuck at 50%.

@w-e-w
Copy link
Collaborator

w-e-w commented Jun 6, 2023

okay that's extremely odd
please try and be specific about which version works
can you give extra details on your setup
what Nvidia driver are you using?

please be specific about which version works
don't use terms like the latest, previous versions, these phrases has little meaning, and also since you're using the dev branch theres isn't a concept of versions

can you go back commit by commit and try to find out which commit actually causes this causes the issue

also during testing I suggest you disabled or even remove every extension you have installed

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

okay that's extremely odd please try and be specific about which version works can you give extra details on your setup what driver are you using?

please be specific about which version works don't use terms like the latest, previous versions, these phrases has little meaning, and also since you're using the dev branch theres isn't a concept of versions

can you go back commit by commit and try to find out which commit actually causes this causes the issue

ee2f4fb

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

好的,这非常奇怪,请尝试具体说明哪个版本有效,您能否提供有关设置的额外详细信息,您使用的驱动程序是什么?
请具体说明哪个版本有效 不要使用最新版本、以前的版本等术语,这些短语几乎没有意义,而且由于您使用的是 dev 分支,因此没有版本的概念
您能否通过提交返回提交并尝试找出哪个提交实际导致此问题

ee2f4fb

The graphics card driver is the latest. I haven't touched the computer or driver during this period, so I updated the SD version without any other operations.

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

好的,这非常奇怪,请尝试并具体说明哪个版本有效,您能否提供有关设置的更多详细信息,您使用的 Nvidia 驱动程序是什么?

请具体说明哪个版本有效 不要使用最新版本、以前的版本等术语,这些短语几乎没有意义,而且由于您使用的是 dev 分支,因此没有版本的概念

您能否通过提交返回提交并尝试找出哪个提交实际导致此问题

同样在测试期间,我建议您禁用甚至删除已安装的每个扩展程序

Snipaste_2023-06-06_20-56-45
Reinstallation without any plugins, still stuck at 50 after enabling high-definition repair

@w-e-w
Copy link
Collaborator

w-e-w commented Jun 6, 2023

The graphics card driver is the latest. I haven't touched the computer or driver during this period, so I updated the SD version without any other operations.

the thing is the most recent drivers could cause some issues apparently there are some changes in how the video manages memory according to vlad

vladmandic/automatic#1285

also ee2f4fb are you saying that commit has no issues?

ee2f4fbvery old version in terms of dev branch,
please go forward slowly
testing specific commits, try to find out which specific commit is the cause of the issue
particularly pick the commits that AUTO has merged something such as these
image

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

显卡驱动程序是最新的。在此期间我没有碰过计算机或驱动程序,因此我在没有任何其他操作的情况下更新了SD版本。

问题是最新的驱动程序可能会导致一些问题,显然根据 VLAD 的说法,视频管理内存的方式发生了一些变化

弗拉德曼迪克#1285

另外EE2F4FB你是说提交没有问题吗?

ee2f4fbimage非常旧的版本 就开发分支而言,请慢慢测试特定的提交,尝试找出导致问题的特定限制,特别是选择AUTO已合并的提交,例如

It seems like there is a problem with NVIDIA's driver 535. Let me lower the version and try it out. Is this a problem with NVIDIA? We will fix it later No

@w-e-w
Copy link
Collaborator

w-e-w commented Jun 6, 2023

also have you test if the issue exist in master branch 1.3.2?

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

您是否还测试了主分支 1.3.2 中是否存在问题?

vladmandic/automatic#1285
It seems to be a problem with the NVIDIA driver. I am looking for a way to downgrade the driver version and then test it again.

@w-e-w
Copy link
Collaborator

w-e-w commented Jun 6, 2023

there's a program called nvcleanstall
it allows you to select different versions of an NVIDIA drivers and only install the components you need
https://www.techpowerup.com/download/techpowerup-nvcleanstall/
image

you don't have to use this program but it is convenient

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

NVcleanstall

You are really my hero, thank you very much

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

NVcleanstall

You are really my hero, thank you very much

After testing, it seems that version 531 is the most normal version, with 532 being about 20% slower and 535 being over 9000% slower

@w-e-w
Copy link
Collaborator

w-e-w commented Jun 6, 2023

9000%..............

@alekandrogm
Copy link

NVcleanstall

You are really my hero, thank you very much

After testing, it seems that version 531 is the most normal version, with 532 being about 20% slower and 535 being over 9000% slower

Thank you both so much. I was bumping my head into the wall for a few days because of this error and after reinstalling stable diffusion a few times I still was not able to generate images as fast as a week ago

@wzgrx
Copy link
Contributor Author

wzgrx commented Jun 6, 2023

NVcleanstall

You are really my hero, thank you very much

After testing, it seems that version 531 is the most normal version, with 532 being about 20% slower and 535 being over 9000% slower

Thank you both so much. I was bumping my head into the wall for a few days because of this error and after reinstalling stable diffusion a few times I still was not able to generate images as fast as a week ago

Don't mention it, I also encountered the same problem. Currently, the speed of the Nvidia 531.79 version is normal during testing. I'm not sure if the old version 531.68.61 will be faster, so I haven't had time to test it yet.

@YPL73
Copy link

YPL73 commented Jun 29, 2023

NVcleanstall

You are really my hero, thank you very much

After testing, it seems that version 531 is the most normal version, with 532 being about 20% slower and 535 being over 9000% slower

Thank you both so much. I was bumping my head into the wall for a few days because of this error and after reinstalling stable diffusion a few times I still was not able to generate images as fast as a week ago

Don't mention it, I also encountered the same problem. Currently, the speed of the Nvidia 531.79 version is normal during testing. I'm not sure if the old version 531.68.61 will be faster, so I haven't had time to test it yet.

i have the same error as you did with the generating stops at 50 %, but when i download the 531,79 version it doesnt let me run the SD bat file for some reason.

@igatsu
Copy link

igatsu commented Jun 30, 2023

I had the generation stop at 100%, the art was generated in 10 seconds and hung at 100% for 18 seconds... VRAM was also very busy with pytorch. Rolled the video driver back to 531 and all the problems disappeared. Thanks for the tip!

@david-trigo
Copy link

david-trigo commented Aug 7, 2023

there's a program called nvcleanstall it allows you to select different versions of an NVIDIA drivers and only install the components you need https://www.techpowerup.com/download/techpowerup-nvcleanstall/ image

you don't have to use this program but it is convenient

Hi, I updated the drivers without thinking and now SD is running very slow. I tried to go back to v531.68 with this program, it installs correctly but SD is still running slower than yesterday. Is there a particular box to check? Thank you.

Edit: finally my problem seems to be with the laptop itself. Yesterday I was testing 536.67 on my desktop with 3080 with no problems.

@Whaleman55
Copy link

I use my 4090 and get the same issue. When I roll back the driver to 531.79 this issue was indeed resolved.
this issue may also be related to the upscaler model because i didnt get stuck when using latent, but when using other models

@DmytroSokhach
Copy link

DmytroSokhach commented Oct 24, 2023

Have same issue:
RTX 3090
Driver Version: 545.84 10/17/2023

Rollback for 1-2 month old driver doesn't sound good to me 🤕 Any other options?

Reinstalled to 531.79 and still the same problem.

@alekandrogm
Copy link

Does anyone know if this has been fixed?

@harolds
Copy link

harolds commented Feb 23, 2024

The latest driver still has this problem. So it seems its not fixed yet.

@theonciest
Copy link

Same here, it was running fine for awhile now, but not sure what I did, one day it stopped working when I restarted my computer. Not sure what has changed, maybe using a different browser now? I have no idea

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug-report Report of a bug, yet to be confirmed
Projects
None yet
Development

No branches or pull requests

10 participants