Create .gitattributes #71

ChrisAcrobat · 2022-08-28T17:09:17Z

DRAFT: Confirming the solution.

ChrisAcrobat · 2022-08-28T17:42:21Z

📢 Discussion from #59 continues here.

ChrisAcrobat · 2022-08-28T17:55:38Z

@hlky @oc013
Looks like its crashing here.
I don't see any logs from webui.py, are they hidden somewhere?

sd                  | entrypoint.sh: Launching...'
sd                  | Relaunch count: 9
sd                  | Loaded GFPGAN
sd                  | Loaded RealESRGAN with model RealESRGAN_x4plus
sd                  | Loading model from models/ldm/stable-diffusion-v1/model.ckpt
sd                  | Global Step: 470000
sd                  | LatentDiffusion: Running in eps-prediction mode
sd                  | entrypoint.sh: Process is ending. Relaunching in 0.5s...
sd                  | /sd/entrypoint.sh: line 89:   774 Killed                  python -u scripts/webui.py
sd                  | entrypoint.sh: Launching...'
sd                  | Relaunch count: 10
sd                  | Loaded GFPGAN
sd                  | Loaded RealESRGAN with model RealESRGAN_x4plus
sd                  | Loading model from models/ldm/stable-diffusion-v1/model.ckpt
sd                  | Global Step: 470000
sd                  | LatentDiffusion: Running in eps-prediction mode
sd                  | /sd/entrypoint.sh: line 89:   798 Killed                  python -u scripts/webui.py
sd                  | entrypoint.sh: Process is ending. Relaunching in 0.5s...
sd                  | entrypoint.sh: Launching...'
sd                  | Relaunch count: 11
sd                  | Loaded GFPGAN
sd                  | Loaded RealESRGAN with model RealESRGAN_x4plus
sd                  | Loading model from models/ldm/stable-diffusion-v1/model.ckpt
sd                  | Global Step: 470000
sd                  | LatentDiffusion: Running in eps-prediction mode
sd                  | entrypoint.sh: Process is ending. Relaunching in 0.5s...
sd                  | /sd/entrypoint.sh: line 89:   822 Killed                  python -u scripts/webui.py
sd                  | entrypoint.sh: Launching...'

oc013 · 2022-08-28T18:01:31Z

As far as I know what you see in STDOUT there is the logs. I'm rebuilding now to give you a comparison of what should happen on a successful first launch. Can you scroll back and see if there are any errors downloading things?

oc013 · 2022-08-28T18:10:24Z

I'm assuming everything up to the actual launch point was successful since I see in your output that it got past loading the model files without an error:

sd  | entrypoint.sh: Launching...
sd  | Downloading: "https://github.com/xinntao/facexlib/releases/download/v0.1.0/detection_Resnet50_Final.pth" to /opt/conda/envs/ldm/lib/python3.8/site-packages/facexlib/weights/detection_Resnet50_Final.pth
sd  | 
100%|██████████| 104M/104M [00:05<00:00, 19.4MB/s] 
sd  | Downloading: "https://github.com/xinntao/facexlib/releases/download/v0.2.2/parsing_parsenet.pth" to /opt/conda/envs/ldm/lib/python3.8/site-packages/facexlib/weights/parsing_parsenet.pth
sd  | 
100%|██████████| 81.4M/81.4M [00:04<00:00, 19.5MB/s]
sd  | Loaded GFPGAN
sd  | Loaded RealESRGAN with model RealESRGAN_x4plus
sd  | Loading model from models/ldm/stable-diffusion-v1/model.ckpt
sd  | Global Step: 470000
sd  | LatentDiffusion: Running in eps-prediction mode
sd  | DiffusionWrapper has 859.52 M params.
sd  | making attention of type 'vanilla' with 512 in_channels
sd  | Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
sd  | making attention of type 'vanilla' with 512 in_channels
Downloading: 100%|██████████| 1.59G/1.59G [01:30<00:00, 18.9MB/s]
sd  | Running on local URL:  http://localhost:7860/
sd  | 
sd  | To create a public link, set `share=True` in `launch()`.

PS That extra single quote I left in the launching msg really bugs me 😆

hlky · 2022-08-28T20:30:50Z

This is ready @ChrisAcrobat @oc013 ?

ChrisAcrobat · 2022-08-29T04:33:35Z

Haven't checked the last comments yet (timezone). I'll do it on the train or something. I'll reply later!

ChrisAcrobat · 2022-08-29T06:26:59Z

@oc013
I'm assuming everything up to the actual launch point was successful since I see in your output that it got past loading the model files without an error:

I think it looks so too. 🙂 log

oc013 · 2022-08-29T06:48:02Z

This PR changes the scripts/webui.py @hlky

$ git stash
warning: CRLF will be replaced by LF in scripts/webui.py.

ChrisAcrobat · 2022-08-29T06:53:09Z

Yeah, that wasn't ment to be merged. Did I accidentally disable the Draft-status?

ChrisAcrobat · 2022-08-29T06:54:38Z

@hlky: Remove this line: https://github.com/hlky/stable-diffusion/blob/main/.gitattributes#L2

oc013 · 2022-08-29T06:58:40Z

I think either remove .gitattributes and users of the repository should be expected to have their git client setup as I linked in the previous discussion, so they get what is exactly in the repository

git config --global core.autocrlf input

Or the files in the repository should be updated to be consistent to allow .gitattributes to do its thing and result in a clean state on everyone's local machine.

ChrisAcrobat · 2022-08-29T08:42:14Z

Doing git config --global core.autocrlf input will effect every (future?) user repo, in which can cause other problems.
But sure, adding .gitattributes to .gitignore could be a possible fix, but the .sh files (as in my intend PR 5007fdc) should never ever use CRLF, right?

oc013 · 2022-08-29T09:38:10Z

Someone made a PR that will make everything consistent #91

Regarding your problem I'm not sure what's going wrong yet but I did start a general discussion here #93 on docker that includes some Windows specific info I found. Can you verify that you've completed everything there?

ChrisAcrobat · 2022-08-29T10:59:24Z

Yes, I have just redid all the steps in #93 from scratch with no noticeable difference.
I after the reinstall also tried closing the container and then restart it, and then I noticed where it crashed. It was maybe obvious for you, but I now see that it crashes somewhere here:

sd  | Loading model from models/ldm/stable-diffusion-v1/model.ckpt
sd  | Global Step: 470000
sd  | LatentDiffusion: Running in eps-prediction mode

Full log after the second docker compose up, after the first attempt returned the same result as previous (similar or equal to this):

[+] Running 1/0
 - Container sd  Created                                                                                           0.0s
Attaching to sd
sd  |      active environment : ldm
sd  |     active env location : /opt/conda/envs/ldm
sd  | Validating model files...
sd  | checking model.ckpt...
sd  | model.ckpt is valid!
sd  |
sd  | checking GFPGANv1.3.pth...
sd  | GFPGANv1.3.pth is valid!
sd  |
sd  | checking RealESRGAN_x4plus.pth...
sd  | RealESRGAN_x4plus.pth is valid!
sd  |
sd  | checking RealESRGAN_x4plus_anime_6B.pth...
sd  | RealESRGAN_x4plus_anime_6B.pth is valid!
sd  |
sd  | entrypoint.sh: Launching...'
sd  | Loaded GFPGAN
sd  | Loaded RealESRGAN with model RealESRGAN_x4plus
sd  | Loading model from models/ldm/stable-diffusion-v1/model.ckpt
sd  | Global Step: 470000
sd  | LatentDiffusion: Running in eps-prediction mode
sd  | entrypoint.sh: Process is ending. Relaunching in 0.5s...
sd  | /sd/entrypoint.sh: line 89:    29 Killed                  python -u scripts/webui.py
sd  | entrypoint.sh: Launching...'
sd  | Relaunch count: 1

oc013 · 2022-08-29T11:03:06Z

Can you try the following to see if you get any more info:

Leave the one terminal open so the container is up
Open a new command prompt
Type docker exec -it sd bash
Type python -u scripts/webui.py

ChrisAcrobat · 2022-08-29T11:07:28Z

(ldm) root@519ae7e8a662:/sd# python -u scripts/webui.py
Loaded GFPGAN
Loaded RealESRGAN with model RealESRGAN_x4plus
Loading model from models/ldm/stable-diffusion-v1/model.ckpt
Global Step: 470000
LatentDiffusion: Running in eps-prediction mode
Killed

oc013 · 2022-08-29T11:20:49Z

Ok just making sure it wasn't somehow the bash script killing the python script.

The next message should be DiffusionWrapper has 859.52 M params.

I'm not 100% sure at this point but it's possibly memory that's an issue? What's your hardware look like? In the docker exec -it sd bash can you run nvidia-smi and see your gpus there?

https://stackoverflow.com/questions/65935028/python-script-gets-killed
https://stackoverflow.com/questions/19189522/what-does-killed-mean-when-processing-a-huge-csv-with-python-which-suddenly-s

ChrisAcrobat · 2022-08-29T13:27:58Z

nvidia-smi returns:

Mon Aug 29 13:24:20 2022
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 515.57       Driver Version: 516.59       CUDA Version: 11.7     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  On   | 00000000:01:00.0  On |                  N/A |
| N/A   59C    P0    31W /  N/A |   2200MiB /  8192MiB |      1%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A        84      C   /python3.8                      N/A      |
+-----------------------------------------------------------------------------+

@oc013 It now also displayed python3.8, which it didn't do before. I was probably too quick the last time. So I also tried python -u scripts/webui.py again and now got this;

Traceback (most recent call last):
  File "/sd/scripts/webui.py", line 3, in <module>
    from frontend.frontend import draw_gradio_ui
ModuleNotFoundError: No module named 'frontend'

oc013 · 2022-08-29T16:19:20Z

#93 Please see Updating section

hlky · 2022-08-29T16:24:36Z

Added #93 to the wiki https://github.com/hlky/stable-diffusion/wiki/Docker-Guide

ChrisAcrobat · 2022-08-29T16:46:38Z

Updating shouldn't be the issue, because I made a clean install with first purging Docker. But I will certainly try it again!

oc013 · 2022-08-29T16:48:18Z

This is new front end code they changed, maybe cloned at a bad time. You can verify if it's there or not at frontend/frontend.py

ChrisAcrobat · 2022-08-29T17:31:27Z

There was a frontend/frontend.py in the container, but I didn't look that closely. I have purge it now and is reinstalling.

ChrisAcrobat · 2022-08-29T19:55:37Z

I tried now again, but no luck. Still the same.
It crashes somewhere after the log sd | LatentDiffusion: Running in eps-prediction mode and sd | DiffusionWrapper has 859.52 M params..
This maybe doesn't mean much, but cmdr2/stable-diffusion-ui is working fine for me through Docker.

ChrisAcrobat · 2022-08-29T20:15:14Z

I'm opening a issue, it doesn't make since to have the communication in a closed PR. 🙂

ChrisAcrobat · 2022-08-29T20:27:07Z

By the way, thank you very much to both of you, @oc013 and @hlky for your help so far!

Create .gitattributes

5007fdc

ChrisAcrobat mentioned this pull request Aug 28, 2022

Finish moving all docker paths to sd #59

Merged

Update .gitattributes

3022200

hlky marked this pull request as ready for review August 28, 2022 20:30

hlky merged commit f3ab556 into Sygil-Dev:main Aug 29, 2022

oc013 mentioned this pull request Aug 29, 2022

.gitattributes: common template #91

Closed

ChrisAcrobat mentioned this pull request Aug 29, 2022

webui.py crashes in Docker on a Windows (WSL) machine #113

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Create .gitattributes #71

Create .gitattributes #71

ChrisAcrobat commented Aug 28, 2022

ChrisAcrobat commented Aug 28, 2022

ChrisAcrobat commented Aug 28, 2022

oc013 commented Aug 28, 2022

oc013 commented Aug 28, 2022 •

edited

Loading

hlky commented Aug 28, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022 •

edited

Loading

oc013 commented Aug 29, 2022 •

edited

Loading

ChrisAcrobat commented Aug 29, 2022 •

edited

Loading

oc013 commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 29, 2022 •

edited

Loading

ChrisAcrobat commented Aug 29, 2022 •

edited

Loading

oc013 commented Aug 29, 2022

hlky commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

Create .gitattributes #71

Create .gitattributes #71

Conversation

ChrisAcrobat commented Aug 28, 2022

ChrisAcrobat commented Aug 28, 2022

ChrisAcrobat commented Aug 28, 2022

oc013 commented Aug 28, 2022

oc013 commented Aug 28, 2022 • edited Loading

hlky commented Aug 28, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022 • edited Loading

oc013 commented Aug 29, 2022 • edited Loading

ChrisAcrobat commented Aug 29, 2022 • edited Loading

oc013 commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 29, 2022 • edited Loading

ChrisAcrobat commented Aug 29, 2022 • edited Loading

oc013 commented Aug 29, 2022

hlky commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

ChrisAcrobat commented Aug 29, 2022

oc013 commented Aug 28, 2022 •

edited

Loading

ChrisAcrobat commented Aug 29, 2022 •

edited

Loading

oc013 commented Aug 29, 2022 •

edited

Loading

ChrisAcrobat commented Aug 29, 2022 •

edited

Loading

oc013 commented Aug 29, 2022 •

edited

Loading

ChrisAcrobat commented Aug 29, 2022 •

edited

Loading