Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Issue]: Issues with DWopenpose installation and loading #3191

Open
2 tasks done
devils-shadow opened this issue Jun 1, 2024 · 7 comments
Open
2 tasks done

[Issue]: Issues with DWopenpose installation and loading #3191

devils-shadow opened this issue Jun 1, 2024 · 7 comments
Labels
upstream Fix is required in upstream library

Comments

@devils-shadow
Copy link

devils-shadow commented Jun 1, 2024 •
edited
Loading

132732-783616_INFO_Starting_SD..txt

Issue Description

Upon initial load of the DWpose controlnet model, SDN attempts to install its requirements but fails when attempting to install mmcv:
image111

Running the same command in venv shows that it attempts to install mmcv 2.2.0 and errors out in attempting to do so:
image1112

Installing mmcv 2.2.0 via pip install mmcv==2.2.0 -f https://download.openmmlab.com/mmcv/dist/cu121/torch2.3/index.html completes successfully, but SDN doesn't like the version, it expects 2.0.0rc4 :
ERROR Control Processor load failed: id="DWPose" error=MMCV==2.2.0 is used but incompatible.

Cleaning up and installing 2.0.0rc4 using the same technique as above also works as expected, and now SDN no longer warns of the version mismatch. But now another error is encountered:
19:22:49-211082 ERROR Control processor DWPose: DLL load failed while importing _ext: The specified module could not be found. 19:22:49-313600 ERROR Control processor DWPose: DLL load failed while importing _ext: The specified module could not be found. 19:22:49-315596 ERROR Control processor DWPose: OpenMMLab is not installed

For this, an older SDN ticket exists: #2877
The proposed solution in the linked ticket is running the following in venv:
WindowsTerminal_AE2B6zu1Og

Sadly the DLL load failed/OpenMMLab is not installed errors still persist.

Please note that the attached log file is from a different user experiencing the same issue (failed mmcv install).

Version Platform Description

Python 3.10.11 on Windows
Version: app=sd.next updated=2024-06-01 hash=06f9d6b6 branch=master
Platform: arch=AMD64 cpu=AMD64 Family 25 Model 33 Stepping 2, AuthenticAMD system=Windows
release=Windows-10-10.0.22631-SP0 python=3.10.11
nVidia CUDA toolkit detected: nvidia-smi present
Extensions: disabled=['sdnext-modernui']
Extensions: enabled=['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'stable-diffusion-webui-rembg'] extensions-builtin
Extensions: enabled=['a1111-sd-webui-tagcomplete', 'adetailer', 'sd-civitai-browser-plus'] extensions
Startup: standard
Load packages: {'torch': '2.3.0+cu121', 'diffusers': '0.28.0', 'gradio': '3.43.2'}
VRAM: Detected=11.99 GB Optimization=none
Engine: backend=Backend.DIFFUSERS compute=cuda device=cuda attention="Scaled-Dot-Product" mode=no_grad
Device: device=NVIDIA GeForce RTX 4070 n=1 arch=sm_90 cap=(8, 9) cuda=12.1 cudnn=8801 driver=552.44

Relevant log output

13:29:48-810163 DEBUG    Control Processor loading: id="DWPose"                
                         class=DWposeDetector                                  
13:29:49-135640 DEBUG    Package not found: mmcv                               
13:29:49-136640 INFO     Installing package: mmcv                              
13:29:49-137637 DEBUG    Running pip: install --upgrade mmcv                   
13:29:57-141702 DEBUG    Control ControlNet model loading: id="OpenPose XL"    
                         path="thibaud/controlnet-openpose-sdxl-1.0"           
13:29:59-923515 DEBUG    Server: alive=True jobs=1 requests=158 uptime=129     
                         memory=1.86/127.78 backend=Backend.DIFFUSERS          
                         state=idle                                            
13:30:01-224929 DEBUG    Control input: type=PIL.Image input=[<PIL.Image.Image 
                         image mode=RGB size=1000x1618 at 0x254E676A0B0>]      
13:30:05-247283 ERROR    Error running pip: install --upgrade mmcv             
13:30:05-249305 DEBUG    Pip output: Collecting mmcv                           
                           Using cached mmcv-2.2.0.tar.gz (479 kB)             
                           Preparing metadata (setup.py): started              
                           Preparing metadata (setup.py): finished with status 
                         'done'                                                
 ---                                                                            
                           note: This error originates from a subprocess, and  
                         is likely not a problem with pip.                     
                           ERROR: Failed building wheel for mmcv               
                           Running setup.py clean for mmcv                     
                         Failed to build mmcv                                  
                         ERROR: Could not build wheels for mmcv, which is      
                         required to install pyproject.toml-based projects     
13:30:06-064352 ERROR    DWPose: No module named 'mmcv'                        
13:30:06-066348 DEBUG    Control Processor loaded: id="DWPose"                 
                         class=DWposeDetector time=17.26                       
13:30:49-748340 DEBUG    Control ControlNet model loaded: id="OpenPose XL"     
                         path="thibaud/controlnet-openpose-sdxl-1.0" time=52.61
13:31:03-717412 ERROR    Control Processor failed: id="DWPose"                 
                         error='DWposeDetector' object has no attribute        
                         'pose_estimation'                                     
13:31:03-719405 ERROR    Control Processor: AttributeError                     
AttributeError: 'DWposeDetector' object has no attribute 'pose_estimation'

Backend

Diffusers

Branch

Master

Model

SD 1.5

Acknowledgements

  • I have read the above and searched for existing issues
  • I confirm that this is classified correctly and its not an extension issue
@vladmandic
Copy link
Owner

i've just pushed an update which installs correct versions.
if issue still remains, we need to check which other dependencies may be required - report here and i'll reopen.

@devils-shadow
Copy link
Author

devils-shadow commented Jun 2, 2024 •
edited
Loading

clean install of latest main, going straight to the control tab and selecting DWpose:

2024-06-02 21:10:36,602 | sd | ERROR | __init__ | DWPose: No module named 'mmcv'
2024-06-02 21:10:36,603 | sd | DEBUG | processors | Control Processor loaded: id="DWPose" class=DWposeDetector time=0.00

didn't even trigger an automatic install of mmcv/dependencies
likewise checking the list of installed packages in venv does not show mmcv in the list:

Package                        Version
------------------------------ ---------------
absl-py                        2.1.0
accelerate                     0.30.1
addict                         2.4.0
aenum                          3.1.15
aiofiles                       23.2.1
aiohttp                        3.9.5
aiosignal                      1.3.1
altair                         5.3.0
annotated-types                0.7.0
antlr4-python3-runtime         4.9.3
anyio                          4.4.0
astunparse                     1.6.3
async-timeout                  4.0.3
attrs                          23.2.0
basicsr                        1.4.2
blendmodes                     2024.1.1
cachetools                     5.3.3
certifi                        2024.6.2
charset-normalizer             3.3.2
clean-fid                      0.1.35
click                          8.1.7
clip                           1.0
clip-interrogator              0.6.0
cloudpickle                    3.0.0
colorama                       0.4.6
coloredlogs                    15.0.1
compel                         2.0.2
contourpy                      1.2.1
cycler                         0.12.1
datasets                       2.19.1
dctorch                        0.1.2
diffusers                      0.28.0
dill                           0.3.8
dnspython                      2.6.1
einops                         0.4.1
email_validator                2.1.1
exceptiongroup                 1.2.1
facexlib                       0.3.0
fastapi                        0.111.0
fastapi-cli                    0.0.4
fasteners                      0.19
ffmpy                          0.3.2
filelock                       3.13.1
filetype                       1.2.0
filterpy                       1.4.5
flatbuffers                    24.3.25
fonttools                      4.53.0
frozenlist                     1.4.1
fsspec                         2024.2.0
ftfy                           6.2.0
future                         1.0.0
gast                           0.4.0
gfpgan                         1.3.8
gitdb                          4.0.11
GitPython                      3.1.43
google-auth                    2.29.0
google-auth-oauthlib           1.0.0
google-pasta                   0.2.0
gradio                         3.43.2
gradio_client                  0.5.0
greenlet                       3.0.3
grpcio                         1.64.0
h11                            0.14.0
h5py                           3.11.0
httpcore                       0.17.3
httptools                      0.6.1
httpx                          0.24.1
huggingface-hub                0.23.2
humanfriendly                  10.0
idna                           3.7
imageio                        2.34.1
importlib_metadata             7.1.0
importlib_resources            6.4.0
inflection                     0.5.1
intel-openmp                   2021.4.0
invisible-watermark            0.2.0
Jinja2                         3.1.3
jsonmerge                      1.9.2
jsonschema                     4.22.0
jsonschema-specifications      2023.12.1
keras                          2.13.1
kiwisolver                     1.4.5
kornia                         0.7.2
kornia_rs                      0.1.3
lark                           1.1.9
lazy_loader                    0.4
libclang                       18.1.1
lightning-utilities            0.11.2
llvmlite                       0.42.0
lmdb                           1.4.1
lpips                          0.1.4
Markdown                       3.6
markdown-it-py                 3.0.0
MarkupSafe                     2.1.5
matplotlib                     3.9.0
mdurl                          0.1.2
mkl                            2021.4.0
mpmath                         1.3.0
multidict                      6.0.5
multiprocess                   0.70.16
networkx                       3.2.1
numba                          0.59.1
numexpr                        2.8.8
numpy                          1.26.4
oauthlib                       3.2.2
omegaconf                      2.3.0
onnx                           1.16.1
onnxruntime                    1.18.0
onnxruntime-gpu                1.18.0
open-clip-torch                2.24.0
opencv-contrib-python-headless 4.9.0.80
opencv-python                  4.9.0.80
opencv-python-headless         4.9.0.80
opt-einsum                     3.3.0
optimum                        1.20.0
orjson                         3.10.3
packaging                      24.0
pandas                         2.2.2
patch-ng                       1.17.4
peft                           0.11.1
pi_heif                        0.16.0
piexif                         1.1.3
pillow                         10.3.0
pip                            23.0.1
platformdirs                   4.2.2
pooch                          1.8.1
protobuf                       4.25.3
psutil                         5.9.8
pyarrow                        16.1.0
pyarrow-hotfix                 0.6
pyasn1                         0.6.0
pyasn1_modules                 0.4.0
pydantic                       1.10.15
pydantic_core                  2.18.3
pydub                          0.25.1
Pygments                       2.18.0
PyMatting                      1.1.12
pyparsing                      3.1.2
pyreadline3                    3.4.1
python-dateutil                2.9.0.post0
python-dotenv                  1.0.1
python-multipart               0.0.9
pytorch-lightning              1.9.4
pytz                           2024.1
PyWavelets                     1.6.0
PyYAML                         6.0.1
referencing                    0.35.1
regex                          2024.5.15
rembg                          2.0.57
requests                       2.31.0
requests-oauthlib              2.0.0
resize-right                   0.0.2
rich                           13.7.1
rpds-py                        0.18.1
rsa                            4.9
safetensors                    0.4.3
scikit-image                   0.23.2
scipy                          1.13.1
semantic-version               2.10.0
sentencepiece                  0.2.0
setuptools                     69.5.1
shellingham                    1.5.4
six                            1.16.0
smmap                          5.0.1
sniffio                        1.3.1
SQLAlchemy                     2.0.30
starlette                      0.37.2
sympy                          1.12.1
tb-nightly                     2.17.0a20240602
tbb                            2021.11.0
tensorboard                    2.13.0
tensorboard-data-server        0.7.2
tensordict                     0.1.2
tensorflow                     2.13.0
tensorflow-estimator           2.13.0
tensorflow-intel               2.13.0
tensorflow-io-gcs-filesystem   0.31.0
termcolor                      2.4.0
tifffile                       2024.5.22
timm                           0.9.16
tokenizers                     0.19.1
toml                           0.10.2
tomli                          2.0.1
toolz                          0.12.1
torch                          2.3.0+cu121
torchdiffeq                    0.2.4
torchmetrics                   1.4.0.post0
torchsde                       0.2.6
torchvision                    0.18.0+cu121
tqdm                           4.66.4
trampoline                     0.1.2
transformers                   4.41.1
typer                          0.12.3
typing_extensions              4.11.0
tzdata                         2024.1
ujson                          5.10.0
urllib3                        1.26.18
uvicorn                        0.30.1
voluptuous                     0.14.2
watchfiles                     0.22.0
wcwidth                        0.2.13
websockets                     11.0.3
Werkzeug                       3.0.3
wheel                          0.43.0
wrapt                          1.16.0
xxhash                         3.4.1
yapf                           0.40.2
yarl                           1.9.4
zipp                           3.19.1

returning to my existing install, I attempted some variations on a manual install based on the specific version dependencies outlined in this commit: 7ea8145

Looking in links: https://download.openmmlab.com/mmcv/dist/cu121/torch2.1/index.html, https://download.openmmlab.com/mmcv/dist/cu121/torch2.3.0/index.html
Collecting mmcv==2.1.0
  Downloading https://download.openmmlab.com/mmcv/dist/cu121/torch2.1.0/mmcv-2.1.0-cp310-cp310-win_amd64.whl (35.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35.4/35.4 MB 14.9 MB/s eta 0:00:00
Requirement already satisfied: addict in e:\automatic\venv\lib\site-packages (from mmcv==2.1.0) (2.4.0)
Collecting mmengine>=0.3.0 (from mmcv==2.1.0)
  Using cached mmengine-0.10.4-py3-none-any.whl.metadata (20 kB)
Requirement already satisfied: numpy in e:\automatic\venv\lib\site-packages (from mmcv==2.1.0) (1.26.4)
Requirement already satisfied: packaging in e:\automatic\venv\lib\site-packages (from mmcv==2.1.0) (24.0)
Requirement already satisfied: Pillow in e:\automatic\venv\lib\site-packages (from mmcv==2.1.0) (10.3.0)
Requirement already satisfied: pyyaml in e:\automatic\venv\lib\site-packages (from mmcv==2.1.0) (6.0.1)
Requirement already satisfied: yapf in e:\automatic\venv\lib\site-packages (from mmcv==2.1.0) (0.40.2)
Requirement already satisfied: opencv-python>=3 in e:\automatic\venv\lib\site-packages (from mmcv==2.1.0) (4.9.0.80)
Requirement already satisfied: regex in e:\automatic\venv\lib\site-packages (from mmcv==2.1.0) (2024.5.10)
Requirement already satisfied: matplotlib in e:\automatic\venv\lib\site-packages (from mmengine>=0.3.0->mmcv==2.1.0) (3.8.4)
Requirement already satisfied: rich in e:\automatic\venv\lib\site-packages (from mmengine>=0.3.0->mmcv==2.1.0) (13.4.2)
Requirement already satisfied: termcolor in e:\automatic\venv\lib\site-packages (from mmengine>=0.3.0->mmcv==2.1.0) (2.4.0)
Requirement already satisfied: importlib-metadata>=6.6.0 in e:\automatic\venv\lib\site-packages (from yapf->mmcv==2.1.0) (7.1.0)
Requirement already satisfied: platformdirs>=3.5.1 in e:\automatic\venv\lib\site-packages (from yapf->mmcv==2.1.0) (4.2.1)
Requirement already satisfied: tomli>=2.0.1 in e:\automatic\venv\lib\site-packages (from yapf->mmcv==2.1.0) (2.0.1)
Requirement already satisfied: zipp>=0.5 in e:\automatic\venv\lib\site-packages (from importlib-metadata>=6.6.0->yapf->mmcv==2.1.0) (3.18.1)
Requirement already satisfied: contourpy>=1.0.1 in e:\automatic\venv\lib\site-packages (from matplotlib->mmengine>=0.3.0->mmcv==2.1.0) (1.2.1)
Requirement already satisfied: cycler>=0.10 in e:\automatic\venv\lib\site-packages (from matplotlib->mmengine>=0.3.0->mmcv==2.1.0) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in e:\automatic\venv\lib\site-packages (from matplotlib->mmengine>=0.3.0->mmcv==2.1.0) (4.51.0)
Requirement already satisfied: kiwisolver>=1.3.1 in e:\automatic\venv\lib\site-packages (from matplotlib->mmengine>=0.3.0->mmcv==2.1.0) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in e:\automatic\venv\lib\site-packages (from matplotlib->mmengine>=0.3.0->mmcv==2.1.0) (3.1.2)
Requirement already satisfied: python-dateutil>=2.7 in e:\automatic\venv\lib\site-packages (from matplotlib->mmengine>=0.3.0->mmcv==2.1.0) (2.9.0.post0)
Requirement already satisfied: markdown-it-py>=2.2.0 in e:\automatic\venv\lib\site-packages (from rich->mmengine>=0.3.0->mmcv==2.1.0) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in e:\automatic\venv\lib\site-packages (from rich->mmengine>=0.3.0->mmcv==2.1.0) (2.18.0)
Requirement already satisfied: mdurl~=0.1 in e:\automatic\venv\lib\site-packages (from markdown-it-py>=2.2.0->rich->mmengine>=0.3.0->mmcv==2.1.0) (0.1.2)
Requirement already satisfied: six>=1.5 in e:\automatic\venv\lib\site-packages (from python-dateutil>=2.7->matplotlib->mmengine>=0.3.0->mmcv==2.1.0) (1.16.0)
Downloading mmengine-0.10.4-py3-none-any.whl (451 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.7/451.7 kB 3.5 MB/s eta 0:00:00
Installing collected packages: mmengine, mmcv
Successfully installed mmcv-2.1.0 mmengine-0.10.4
(venv) PS E:\automatic\venv\Scripts> mim install mmpose==1.3.1 mmdet==3.3.0 --no-deps
Looking in links: https://download.openmmlab.com/mmcv/dist/cu121/torch2.3.0/index.html
Collecting mmpose==1.3.1
  Using cached mmpose-1.3.1-py2.py3-none-any.whl.metadata (29 kB)
Collecting mmdet==3.3.0
  Downloading mmdet-3.3.0-py3-none-any.whl.metadata (29 kB)
Using cached mmpose-1.3.1-py2.py3-none-any.whl (1.7 MB)
Downloading mmdet-3.3.0-py3-none-any.whl (2.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.2/2.2 MB 8.9 MB/s eta 0:00:00
Installing collected packages: mmdet, mmpose
Successfully installed mmdet-3.3.0 mmpose-1.3.1

starting up SDN again with these changes, we get the same errors reported in the original ticket:

21:32:58-334889 ERROR    Control processor DWPose: DLL load failed while importing _ext: The specified procedure could
                         not be found.
21:32:58-436889 ERROR    Control processor DWPose: DLL load failed while importing _ext: The specified procedure could
                         not be found.
21:32:58-437889 ERROR    Control processor DWPose: OpenMMLab is not installed
21:32:58-438889 DEBUG    Control Processor loaded: id="DWPose" class=DWposeDetector time=1.18

so... more or less back to square one here

@vladmandic
Copy link
Owner

argh. i hate openmim
i just rewrote installer for those dependencies, care to try again?
you can also enable extra debug with SD_DWPOSE_DEBUG=true

@devils-shadow
Copy link
Author

appears to fail with the same error I ran into when attempting to install mmcv manually (see OP). My bypass was to use the URL to install it.

2024-06-03 01:23:53,128 | sd | INFO | installer | Logger: file="E:\clean\sdnext.log" level=DEBUG size=65 mode=create
2024-06-03 01:23:53,129 | sd | INFO | installer | Python 3.10.11 on Windows
2024-06-03 01:23:53,236 | sd | INFO | installer | Version: app=sd.next updated=2024-06-02 hash=4acb0c88 branch=master url=https://github.com/vladmandic/automatic/tree/master
2024-06-03 01:23:53,587 | sd | INFO | launch | Platform: arch=AMD64 cpu=AMD64 Family 25 Model 33 Stepping 2, AuthenticAMD system=Windows release=Windows-10-10.0.22631-SP0 python=3.10.11
2024-06-03 01:23:53,588 | sd | DEBUG | installer | Setting environment tuning
2024-06-03 01:23:53,590 | sd | DEBUG | installer | HF cache folder: C:\Users\devil\.cache\huggingface\hub
2024-06-03 01:23:53,591 | sd | DEBUG | installer | Torch allocator: "garbage_collection_threshold:0.80,max_split_size_mb:512"
2024-06-03 01:23:53,592 | sd | DEBUG | installer | Torch overrides: cuda=False rocm=False ipex=False diml=False openvino=False
2024-06-03 01:23:53,592 | sd | DEBUG | installer | Torch allowed: cuda=True rocm=True ipex=True diml=True openvino=True
2024-06-03 01:23:53,594 | sd | INFO | installer | nVidia CUDA toolkit detected: nvidia-smi present
2024-06-03 01:23:54,693 | sd | INFO | installer | Torch 2.3.0+cu121
2024-06-03 01:23:54,714 | sd | INFO | installer | Torch backend: nVidia CUDA 12.1 cuDNN 8801
2024-06-03 01:23:54,716 | sd | INFO | installer | Torch detected GPU: NVIDIA GeForce RTX 4070 VRAM 12282 Arch (8, 9) Cores 46
2024-06-03 01:23:54,792 | sd | DEBUG | installer | Repository update time: Mon Jun  3 00:42:46 2024
2024-06-03 01:23:54,793 | sd | INFO | launch | Startup: standard
2024-06-03 01:23:54,793 | sd | INFO | installer | Verifying requirements
2024-06-03 01:23:54,797 | sd | INFO | installer | Verifying packages
2024-06-03 01:23:54,798 | sd | INFO | installer | Verifying submodules
2024-06-03 01:23:56,180 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-extension-chainner / main
2024-06-03 01:23:56,240 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-extension-system-info / main
2024-06-03 01:23:56,299 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-webui-agent-scheduler / main
2024-06-03 01:23:56,358 | sd | DEBUG | installer | Submodule: extensions-builtin/sdnext-modernui / main
2024-06-03 01:23:56,416 | sd | DEBUG | installer | Submodule: extensions-builtin/stable-diffusion-webui-rembg / master
2024-06-03 01:23:56,476 | sd | DEBUG | installer | Submodule: modules/k-diffusion / master
2024-06-03 01:23:56,533 | sd | DEBUG | installer | Submodule: wiki / master
2024-06-03 01:23:56,566 | sd | DEBUG | paths | Register paths
2024-06-03 01:23:56,629 | sd | DEBUG | installer | Installed packages: 209
2024-06-03 01:23:56,630 | sd | DEBUG | installer | Extensions all: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg']
2024-06-03 01:23:56,809 | sd | DEBUG | installer | Running extension installer: E:\clean\extensions-builtin\sd-webui-agent-scheduler\install.py
2024-06-03 01:23:57,140 | sd | DEBUG | installer | Running extension installer: E:\clean\extensions-builtin\stable-diffusion-webui-rembg\install.py
2024-06-03 01:23:57,413 | sd | DEBUG | installer | Extensions all: []
2024-06-03 01:23:57,414 | sd | INFO | installer | Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg']
2024-06-03 01:23:57,414 | sd | INFO | installer | Verifying requirements
2024-06-03 01:23:57,415 | sd | DEBUG | launch | Setup complete without errors: 1717367037
2024-06-03 01:23:57,418 | sd | DEBUG | installer | Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0}
2024-06-03 01:23:57,419 | sd | DEBUG | launch | Starting module: <module 'webui' from 'E:\\clean\\webui.py'>
2024-06-03 01:23:57,421 | sd | INFO | launch | Command line args: ['--debug'] debug=True
2024-06-03 01:23:57,422 | sd | DEBUG | launch | Env flags: ['SD_DWPOSE_DEBUG=true']
2024-06-03 01:24:00,470 | sd | INFO | loader | Load packages: {'torch': '2.3.0+cu121', 'diffusers': '0.28.0', 'gradio': '3.43.2'}
2024-06-03 01:24:00,952 | sd | INFO | shared | VRAM: Detected=11.99 GB Optimization=none
2024-06-03 01:24:00,954 | sd | DEBUG | shared | Read: file="config.json" json=28 bytes=1201 time=0.000
2024-06-03 01:24:00,956 | sd | INFO | shared | Engine: backend=Backend.DIFFUSERS compute=cuda device=cuda attention="Scaled-Dot-Product" mode=no_grad
2024-06-03 01:24:00,992 | sd | INFO | shared | Device: device=NVIDIA GeForce RTX 4070 n=1 arch=sm_90 cap=(8, 9) cuda=12.1 cudnn=8801 driver=555.85
2024-06-03 01:24:00,994 | sd | DEBUG | shared | Read: file="html\reference.json" json=39 bytes=22892 time=0.000
2024-06-03 01:24:01,349 | sd | DEBUG | __init__ | ONNX: version=1.18.0 provider=CUDAExecutionProvider, available=['AzureExecutionProvider', 'CPUExecutionProvider']
2024-06-03 01:24:01,414 | sd | DEBUG | sd_hijack | Importing LDM
2024-06-03 01:24:01,430 | sd | DEBUG | webui | Entering start sequence
2024-06-03 01:24:01,432 | sd | DEBUG | webui | Initializing
2024-06-03 01:24:01,450 | sd | INFO | sd_vae | Available VAEs: path="models\VAE" items=0
2024-06-03 01:24:01,451 | sd | DEBUG | sd_unet | Available UNets: path="models\UNET" items=0
2024-06-03 01:24:01,452 | sd | INFO | extensions | Disabled extensions: ['sdnext-modernui']
2024-06-03 01:24:01,453 | sd | DEBUG | modelloader | Scanning diffusers cache: folder=models\Diffusers items=0 time=0.00
2024-06-03 01:24:01,454 | sd | INFO | sd_models | Available models: path="models\Stable-diffusion" items=0 time=0.00
2024-06-03 01:24:01,614 | sd | DEBUG | webui | Load extensions
2024-06-03 01:24:01,645 | sd | INFO | networks | LoRA networks: available=0 folders=2
2024-06-03 01:24:01,647 | sd | INFO | script_loading | Extension: script='extensions-builtin\Lora\scripts\lora_script.py' �[2;36m01:24:01-645576�[0m�[2;36m �[0m�[34mINFO    �[0m LoRA networks: �[33mavailable�[0m=�[1;36m0�[0m �[33mfolders�[0m=�[1;36m2�[0m
2024-06-03 01:24:01,921 | sd | INFO | script_loading | Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
2024-06-03 01:24:01,931 | sd | DEBUG | webui | Extensions init time: 0.32 sd-webui-agent-scheduler=0.25
2024-06-03 01:24:01,940 | sd | DEBUG | shared | Read: file="html/upscalers.json" json=4 bytes=2672 time=0.000
2024-06-03 01:24:01,941 | sd | DEBUG | shared | Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.000
2024-06-03 01:24:01,943 | sd | DEBUG | chainner_model | chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=0
2024-06-03 01:24:01,946 | sd | DEBUG | modelloader | Load upscalers: total=52 downloaded=0 user=0 time=0.01 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
2024-06-03 01:24:01,959 | sd | DEBUG | styles | Load styles: folder="models\styles" items=288 time=0.01
2024-06-03 01:24:01,961 | sd | DEBUG | webui | Creating UI
2024-06-03 01:24:01,963 | sd | DEBUG | theme | UI themes available: type=Standard themes=12
2024-06-03 01:24:01,964 | sd | INFO | theme | UI theme: type=Standard name="black-teal"
2024-06-03 01:24:01,969 | sd | DEBUG | ui_javascript | UI theme: css="E:\clean\javascript\black-teal.css" base="sdnext.css" user="None"
2024-06-03 01:24:01,971 | sd | DEBUG | ui_txt2img | UI initialize: txt2img
2024-06-03 01:24:01,995 | sd | DEBUG | ui_extra_networks | Extra networks: page='model' items=38 subfolders=2 tab=txt2img folders=['models\\Stable-diffusion', 'models\\Diffusers', 'models\\Reference'] list=0.01 thumb=0.00 desc=0.00 info=0.00 workers=4 sort=Default
2024-06-03 01:24:01,997 | sd | DEBUG | ui_extra_networks | Extra networks: page='lora' items=0 subfolders=0 tab=txt2img folders=['models\\Lora', 'models\\LyCORIS'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=4 sort=Default
2024-06-03 01:24:02,019 | sd | DEBUG | ui_extra_networks | Extra networks: page='style' items=288 subfolders=1 tab=txt2img folders=['models\\styles', 'html'] list=0.01 thumb=0.00 desc=0.00 info=0.00 workers=4 sort=Default
2024-06-03 01:24:02,021 | sd | DEBUG | ui_extra_networks | Extra networks: page='embedding' items=0 subfolders=0 tab=txt2img folders=['models\\embeddings'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=4 sort=Default
2024-06-03 01:24:02,023 | sd | DEBUG | ui_extra_networks | Extra networks: page='vae' items=0 subfolders=0 tab=txt2img folders=['models\\VAE'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=4 sort=Default
2024-06-03 01:24:02,229 | sd | DEBUG | ui_img2img | UI initialize: img2img
2024-06-03 01:24:02,321 | sd | DEBUG | ui_control_helpers | UI initialize: control models=models\control
2024-06-03 01:24:02,705 | sd | DEBUG | shared | Read: file="ui-config.json" json=0 bytes=2 time=0.001
2024-06-03 01:24:02,790 | sd | DEBUG | theme | UI themes available: type=Standard themes=12
2024-06-03 01:24:02,899 | sd | DEBUG | shared | Reading failed: E:\clean\html\extensions.json [Errno 2] No such file or directory: 'E:\\clean\\html\\extensions.json'
2024-06-03 01:24:02,900 | sd | INFO | ui_extensions | Extension list is empty: refresh required
2024-06-03 01:24:03,238 | sd | DEBUG | ui_extensions | Extension list: processed=6 installed=6 enabled=5 disabled=1 visible=6 hidden=0
2024-06-03 01:24:03,532 | sd | DEBUG | webui | Root paths: ['E:\\clean']
2024-06-03 01:24:03,592 | sd | INFO | webui | Local URL: http://127.0.0.1:7860/
2024-06-03 01:24:03,593 | sd | DEBUG | webui | Gradio functions: registered=1694
2024-06-03 01:24:03,594 | sd | DEBUG | middleware | FastAPI middleware: ['Middleware', 'Middleware']
2024-06-03 01:24:03,597 | sd | DEBUG | webui | Creating API
2024-06-03 01:24:03,737 | sd | INFO | task_runner | [AgentScheduler] Task queue is empty
2024-06-03 01:24:03,738 | sd | INFO | api | [AgentScheduler] Registering APIs
2024-06-03 01:24:03,828 | sd | DEBUG | webui | Scripts setup: ['IP Adapters:0.02', 'AnimateDiff:0.009', 'X/Y/Z Grid:0.011', 'Face:0.01']
2024-06-03 01:24:03,829 | sd | DEBUG | sd_models | Model metadata: file="metadata.json" no changes
2024-06-03 01:24:03,831 | sd | DEBUG | modeldata | Model requested: fn=<lambda>
2024-06-03 01:24:03,832 | sd | WARNING | sd_models | Cannot generate without a checkpoint
2024-06-03 01:24:03,833 | sd | INFO | sd_models | Set system paths to use existing folders
2024-06-03 01:24:03,834 | sd | INFO | sd_models |   or use --models-dir <path-to-folder> to specify base folder with all models
2024-06-03 01:24:03,835 | sd | INFO | sd_models |   or use --ckpt-dir <path-to-folder> to specify folder with sd models
2024-06-03 01:24:03,836 | sd | INFO | sd_models |   or use --ckpt <path-to-checkpoint> to force using specific model
2024-06-03 01:24:03,837 | sd | DEBUG | script_callbacks | Script callback init time: task_scheduler.py:app_started=0.10
2024-06-03 01:24:03,838 | sd | INFO | webui | Startup time: 6.41 torch=2.10 gradio=0.67 diffusers=0.27 libraries=0.94 extensions=0.32 face-restore=0.16 ui-en=0.28 ui-img2img=0.06 ui-control=0.09 ui-models=0.19 ui-settings=0.19 ui-extensions=0.37 ui-defaults=0.05 launch=0.29 api=0.08 app-started=0.15
2024-06-03 01:24:03,839 | sd | DEBUG | shared | Save: file="config.json" json=28 bytes=1157 time=0.002
2024-06-03 01:24:09,944 | sd | INFO | server | MOTD: N/A
2024-06-03 01:24:11,868 | sd | DEBUG | theme | UI themes available: type=Standard themes=12
2024-06-03 01:24:12,010 | sd | INFO | api | Browser session: user=None client=127.0.0.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36
2024-06-03 01:24:22,874 | sd | DEBUG | processors | Control Processor loading: id="DWPose" class=DWposeDetector
2024-06-03 01:24:22,876 | sd | DEBUG | installer | Package not found: openmim
2024-06-03 01:24:22,877 | sd | DEBUG | installer | Package not found: mmengine
2024-06-03 01:24:22,877 | sd | DEBUG | installer | Package not found: mmcv
2024-06-03 01:24:22,878 | sd | DEBUG | installer | Package not found: mmpose
2024-06-03 01:24:22,879 | sd | DEBUG | installer | Package not found: mmdet
2024-06-03 01:24:22,880 | sd | TRACE | __init__ | DWPose required=['openmim==0.3.9', 'mmengine==0.10.4', 'mmcv==2.1.0', 'mmpose==1.3.1', 'mmdet==3.3.0'] status=[False, False, False, False, False]
2024-06-03 01:24:22,881 | sd | INFO | __init__ | Installing DWPose dependencies: [['openmim==0.3.9', 'mmengine==0.10.4', 'mmcv==2.1.0', 'mmpose==1.3.1', 'mmdet==3.3.0']]
2024-06-03 01:24:22,882 | sd | INFO | installer | Installing package: -re openmim==0.3.9 mmengine==0.10.4 mmcv==2.1.0 mmpose==1.3.1 mmdet==3.3.0
2024-06-03 01:24:22,883 | sd | DEBUG | installer | Running pip: install --upgrade --no-deps --force-reinstall openmim==0.3.9 mmengine==0.10.4 mmcv==2.1.0 mmpose==1.3.1 mmdet==3.3.0 
2024-06-03 01:24:25,833 | sd | ERROR | installer | Error running pip: install --upgrade --no-deps --force-reinstall openmim==0.3.9 mmengine==0.10.4 mmcv==2.1.0 mmpose==1.3.1 mmdet==3.3.0
2024-06-03 01:24:25,834 | sd | DEBUG | installer | Pip output: Collecting openmim==0.3.9
  Using cached openmim-0.3.9-py2.py3-none-any.whl (52 kB)
Collecting mmengine==0.10.4
  Using cached mmengine-0.10.4-py3-none-any.whl (451 kB)
Collecting mmcv==2.1.0
  Using cached mmcv-2.1.0.tar.gz (471 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'

  error: subprocess-exited-with-error
  
  python setup.py egg_info did not run successfully.
  exit code: 1
  
  [16 lines of output]
  C:\Users\devil\AppData\Local\Temp\pip-install-j6uj05jy\mmcv_2dee9ae2626b48428ecfe1878738c32d\setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    from pkg_resources import DistributionNotFound, get_distribution, parse_version
  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "C:\Users\devil\AppData\Local\Temp\pip-install-j6uj05jy\mmcv_2dee9ae2626b48428ecfe1878738c32d\setup.py", line 477, in <module>
      ext_modules=get_extensions(),
    File "C:\Users\devil\AppData\Local\Temp\pip-install-j6uj05jy\mmcv_2dee9ae2626b48428ecfe1878738c32d\setup.py", line 434, in get_extensions
      ext_ops = extension(
    File "E:\clean\venv\lib\site-packages\torch\utils\cpp_extension.py", line 1077, in CUDAExtension
      library_dirs += library_paths(cuda=True)
    File "E:\clean\venv\lib\site-packages\torch\utils\cpp_extension.py", line 1211, in library_paths
      paths.append(_join_cuda_home(lib_dir))
    File "E:\clean\venv\lib\site-packages\torch\utils\cpp_extension.py", line 2419, in _join_cuda_home
      raise OSError('CUDA_HOME environment variable is not set. '
  OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.
  [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

Encountered error while generating package metadata.

See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

[notice] A new release of pip is available: 23.0.1 -> 24.0
[notice] To update, run: E:\clean\venv\Scripts\python.exe -m pip install --upgrade pip
2024-06-03 01:24:25,841 | sd | TRACE | __init__ | DWPose pip install: Collecting openmim==0.3.9
  Using cached openmim-0.3.9-py2.py3-none-any.whl (52 kB)
Collecting mmengine==0.10.4
  Using cached mmengine-0.10.4-py3-none-any.whl (451 kB)
Collecting mmcv==2.1.0
  Using cached mmcv-2.1.0.tar.gz (471 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'

  error: subprocess-exited-with-error
  
  python setup.py egg_info did not run successfully.
  exit code: 1
  
  [16 lines of output]
  C:\Users\devil\AppData\Local\Temp\pip-install-j6uj05jy\mmcv_2dee9ae2626b48428ecfe1878738c32d\setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    from pkg_resources import DistributionNotFound, get_distribution, parse_version
  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "C:\Users\devil\AppData\Local\Temp\pip-install-j6uj05jy\mmcv_2dee9ae2626b48428ecfe1878738c32d\setup.py", line 477, in <module>
      ext_modules=get_extensions(),
    File "C:\Users\devil\AppData\Local\Temp\pip-install-j6uj05jy\mmcv_2dee9ae2626b48428ecfe1878738c32d\setup.py", line 434, in get_extensions
      ext_ops = extension(
    File "E:\clean\venv\lib\site-packages\torch\utils\cpp_extension.py", line 1077, in CUDAExtension
      library_dirs += library_paths(cuda=True)
    File "E:\clean\venv\lib\site-packages\torch\utils\cpp_extension.py", line 1211, in library_paths
      paths.append(_join_cuda_home(lib_dir))
    File "E:\clean\venv\lib\site-packages\torch\utils\cpp_extension.py", line 2419, in _join_cuda_home
      raise OSError('CUDA_HOME environment variable is not set. '
  OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.
  [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

Encountered error while generating package metadata.

See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

[notice] A new release of pip is available: 23.0.1 -> 24.0
[notice] To update, run: E:\clean\venv\Scripts\python.exe -m pip install --upgrade pip
2024-06-03 01:24:25,914 | sd | ERROR | __init__ | DWPose: No module named 'mmcv'
2024-06-03 01:24:25,915 | sd | DEBUG | processors | Control Processor loaded: id="DWPose" class=DWposeDetector time=3.04
2024-06-03 01:25:47,666 | sd | INFO | webui | Exiting

@vladmandic
Copy link
Owner

note that packages i've selected are different than what you've tried and couldn't make to work
pip: install --upgrade --no-deps --force-reinstall openmim==0.3.9 mmengine==0.10.4 mmcv==2.1.0 mmpose==1.3.1 mmdet==3.3.0

so you can install that with appending what you've suggested:
-f https://download.openmmlab.com/mmcv/dist/cu121/torch2.3/index.html

but i'm reluctant to add that to auto-installer as that would lock it down to torch 2.3 with cuda 12.1 only and there are plenty of users on other versions of torch/cuda. also this is only needed if mmcv installer cannot find cuda on its own and on many systems it does. and guessing download path based on torch and cuda and figuring out what's available and what not is not something i want to do.

anyhow, if my recommended versions plus your download path combo works, perhaps this should be added to wiki page https://github.com/vladmandic/automatic/wiki/Control

@devils-shadow
Copy link
Author

Just to be clear, all my attempts to manually fix this via venv were done on my regular main install; I didn't touch anything on the clean main install, except running git pulls and starting it with --upgrade --reset.

That being said, even a manual install now fails using pip install --upgrade --no-deps --force-reinstall openmim==0.3.9 mmengine==0.10.4 mmcv==2.1.0 mmpose==1.3.1 mmdet==3.3.0 -f https://download.openmmlab.com/mmcv/dist/cu121/torch2.3/index.html with the same error:

(venv) PS E:\automatic> pip cache purge
Files removed: 12
(venv) PS E:\automatic> pip install --upgrade --no-deps --force-reinstall openmim==0.3.9 mmengine==0.10.4 mmcv==2.1.0 mmpose==1.3.1 mmdet==3.3.0 -f https://download.openmmlab.com/mmcv/dist/cu121/torch2.3/index.html
Looking in links: https://download.openmmlab.com/mmcv/dist/cu121/torch2.3/index.html
Collecting openmim==0.3.9
  Downloading openmim-0.3.9-py2.py3-none-any.whl.metadata (16 kB)
Collecting mmengine==0.10.4
  Downloading mmengine-0.10.4-py3-none-any.whl.metadata (20 kB)
Collecting mmcv==2.1.0
  Downloading mmcv-2.1.0.tar.gz (471 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 471.4/471.4 kB 3.3 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [16 lines of output]
      C:\Users\devil\AppData\Local\Temp\pip-install-l41w6j4x\mmcv_2b9422e817c74cd2aeab1c11293dc135\setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
        from pkg_resources import DistributionNotFound, get_distribution, parse_version
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\Users\devil\AppData\Local\Temp\pip-install-l41w6j4x\mmcv_2b9422e817c74cd2aeab1c11293dc135\setup.py", line 477, in <module>
          ext_modules=get_extensions(),
        File "C:\Users\devil\AppData\Local\Temp\pip-install-l41w6j4x\mmcv_2b9422e817c74cd2aeab1c11293dc135\setup.py", line 434, in get_extensions
          ext_ops = extension(
        File "E:\automatic\venv\lib\site-packages\torch\utils\cpp_extension.py", line 1077, in CUDAExtension
          library_dirs += library_paths(cuda=True)
        File "E:\automatic\venv\lib\site-packages\torch\utils\cpp_extension.py", line 1211, in library_paths
          paths.append(_join_cuda_home(lib_dir))
        File "E:\automatic\venv\lib\site-packages\torch\utils\cpp_extension.py", line 2419, in _join_cuda_home
          raise OSError('CUDA_HOME environment variable is not set. '
      OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
(venv) PS E:\automatic>

Please note that I have also tried running the above on a different computer as well, just in case, and the same error was encountered.

@vladmandic
Copy link
Owner

ok, so now we have a correct list of packages, but they fail to install due to incompatible cuda detected by mmcv.
i'm reopening the issue and linking open-mmlab/mmyolo#983, open-mmlab/mmcv#2860

@vladmandic vladmandic reopened this Jun 3, 2024
@vladmandic vladmandic added the upstream Fix is required in upstream library label Jun 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
upstream Fix is required in upstream library
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@devils-shadow @vladmandic