Could not load torch: No module named 'torch'

[botduster]

I get this error when I try to install kohya_ss gui after the intial menu.

Kohya_ss GUI setup menu:

0. Cleanup the venv
1. Install kohya_ss gui [torch 1]
2. Install kohya_ss gui [torch 2]
3. Start Kohya_ss GUI in browser
4. Quit

Enter your choice: 1

Be patient, this can take quite some time to complete...

23:13:07-437191 INFO Python 3.10.9 on Windows
23:13:07-455170 INFO nVidia toolkit detected
23:13:07-458163 ERROR Could not load torch: No module named 'torch'

I have the torch module installed locally so I don't know what the issue is.

Any help would be greatly appreciated, thanks

[bmaltais]

Sound like the setup is unable to find the module. Is is just reporting the error and continuing?

[bmaltais]

I will update the code to not report on it during setup as it can be missleading... since when you 1st run the setup there is no torch installed... so no point in telling users.

[tkittich]

I got the same error as OP's on release v21.7.3 and v21.7.2 . setup.bat in Release v21.7.1 does work fine without any error.

[bmaltais]

I got the same error as OP's on release v21.7.3 and v21.7.2 . setup.bat in Release v21.7.1 does work fine without any error.

The code logic was changed between those release... Is it failing the install or just reporting it for you?

[tkittich]

I got the same error as OP's on release v21.7.3 and v21.7.2 . setup.bat in Release v21.7.1 does work fine without any error.

The code logic was changed between those release... Is it failing the install or just reporting it for you?

The installation failed on v21.7.3 with the following output:

`Kohya_ss GUI setup menu:

0. Cleanup the venv
1. Install kohya_ss gui
2. Install cudann files
3. Start Kohya_ss GUI in browser
4. Quit

Enter your choice: 0

Are you sure you want to delete all Python modules installed in the current venv? (y/n): y
18:24:52-400426 INFO Cleaning up all modules from the venv...
18:24:52-793639 INFO Uninstalling: markdown-it-py==2.2.0
18:24:53-253086 INFO Uninstalling: mdurl==0.1.2
18:24:53-654020 INFO Uninstalling: Pygments==2.15.1
18:24:54-360425 INFO Uninstalling: rich==13.4.1

Kohya_ss GUI setup menu:

0. Cleanup the venv
1. Install kohya_ss gui
2. Install cudann files
3. Start Kohya_ss GUI in browser
4. Quit

Enter your choice: 1

1. Torch 1
2. Torch 2
3. Cancel

Enter your choice: 1

18:24:58-632663 INFO Python 3.10.11 on Windows
18:24:58-637201 INFO nVidia toolkit detected
18:24:58-638345 ERROR Could not load torch: No module named 'torch'
18:24:58-639356 INFO Uninstalling package: xformers
18:24:59-024191 INFO Uninstalling package: torchvision
18:24:59-408637 INFO Uninstalling package: torch
18:24:59-788114 INFO Uninstalling package: torch
18:25:00-172997 INFO Uninstalling package: tensorflow
18:25:00-554940 INFO Uninstalling package: tensorflow-estimator
18:25:00-936766 INFO Uninstalling package: tensorflow-intel
18:25:01-314370 INFO Uninstalling package: tensorflow-io-gcs-filesystem
18:25:01-694631 INFO Uninstalling package: triton
18:25:02-070625 INFO Reinstalling package: torch==1.12.1+cu116
torchvision==0.13.1+cu116 --index-url
https://download.pytorch.org/whl/cu116
18:25:59-127584 INFO Reinstalling package:
https://github.com/C43H66N12O12S2/stable-diffusion-webui/releases
/download/f/xformers-0.0.14.dev0-cp310-cp310-win_amd64.whl
18:26:16-425111 INFO Verifying requirements
18:26:16-426130 INFO Installing package: accelerate==0.15.0
18:26:18-068421 INFO Installing package: albumentations==1.3.0
18:26:35-838169 INFO Installing package: altair==4.2.2
18:26:47-794183 INFO Installing package: bitsandbytes==0.35.0
18:26:49-470565 INFO Installing package: dadaptation==3.1
18:26:50-309152 INFO Installing package: diffusers==0.10.2
18:26:53-721618 INFO Installing package: easygui==0.98.3
18:26:54-764816 INFO Installing package: einops==0.6.0
18:26:55-950202 INFO Installing package: fairscale==0.4.13
18:26:57-481516 INFO Installing package: ftfy==6.1.1
18:26:58-553451 INFO Installing package: gradio==3.32.0
18:27:12-372284 INFO Installing package: huggingface-hub==0.13.3
18:27:14-071513 INFO Installing package: lion-pytorch==0.0.6
18:27:15-158961 INFO Installing package: lycoris_lora==0.1.4
18:27:26-645497 INFO Installing package: opencv-python==4.7.0.68
18:27:28-582991 INFO Installing package: pytorch-lightning==1.9.0
18:27:32-854582 INFO Installing package: rich==13.4.1
18:27:34-770305 INFO Installing package: safetensors==0.2.6
18:27:36-282670 INFO Installing package: tensorboard==2.10.1
18:27:43-965531 INFO Installing package: tensorflow==2.10.1
18:28:08-747739 INFO Installing package: timm==0.6.12
18:28:11-453459 INFO Installing package: tk==0.1.0
18:28:12-927627 INFO Installing package: toml==0.10.2
18:28:14-435904 INFO Installing package: transformers==4.26.0
18:28:25-810647 INFO Installing package: voluptuous==0.13.1
18:28:27-297558 INFO Installing package: wandb==0.15.0
18:28:34-261300 INFO Installing package: .
18:28:37-145613 INFO Copying bitsandbytes files...
18:28:37-151618 INFO Configuring accelerate...
╭────────────────────────── Traceback (most recent call last) ───────────────────────────╮
│ D:\theera\aiart\kohya_ss\tools\setup_windows.py:666 in │
│ │
│ 665 setup_logging() │
│ ❱ 666 main_menu() │
│ 667 │
│ │
│ D:\theera\aiart\kohya_ss\tools\setup_windows.py:643 in main_menu │
│ │
│ 642 if choice_torch == '1': │
│ ❱ 643 install_kohya_ss_torch1() │
│ 644 break │
│ │
│ D:\theera\aiart\kohya_ss\tools\setup_windows.py:570 in install_kohya_ss_torch1 │
│ │
│ 569 sync_bits_and_bytes_files() │
│ ❱ 570 configure_accelerate() │
│ 571 # run_cmd(f'accelerate config') │
│ │
│ D:\theera\aiart\kohya_ss\tools\setup_windows.py:151 in configure_accelerate │
│ │
│ 150 ) │
│ ❱ 151 shutil.copyfile( │
│ 152 source_accelerate_config_file, target_config_location │
│ │
│ C:\Program Files\Python310\lib\shutil.py:254 in copyfile │
│ │
│ 253 else: │
│ ❱ 254 with open(src, 'rb') as fsrc: │
│ 255 try: │
╰────────────────────────────────────────────────────────────────────────────────────────╯
FileNotFoundError: [Errno 2] No such file or directory:
'D:\theera\aiart\kohya_ss\tools\config_files\accelerate\default_config.yaml'
PS D:\theera\aiart\kohya_ss>`

[bmaltais]

@tkittich Try downloading the latest release. It should fix this issue.

[tkittich]

@tkittich Try downloading the latest release. It should fix this issue.

The latest release fixed the setup.bat problem. Thanks a lot. ^^

[botduster]

Yes it would fail to install after that, but I just tried the new update and it works, thanks!

[leonyp]

I'm getting same error

[Ehtz]

I had the same problem even with cloning the new koya repo.
What fixed it for me was to clone the repo and in the setup, make sure to press 1 so it can download locally the missing files.

1. Install kohya_ss gui
2. (Optional) Install cudann files (avoid unless you really need it)
3. (Optional) Install specific bitsandbytes versions
4. (Optional) Manually configure accelerate
5. (Optional) Start Kohya_ss GUI in browser
6. Quit

After pressing 1 and files downloaded, restart the setup file and koya opened.

[filipemeneses]

Had this issue because I was running on a conda environment, kohya was using the wrong accelerate, to solve it I forced a install to update the path:

conda activate myenv
pip install accelerate==0.25.0 --force-reinstall --no-deps