internal assert failed -- trying to update all from pinokio comfy ui #145724
Description
🐛 Describe the bug
I'm on windows 11, with nvidia 4090, and playing with comfyUI installed via pinokio.
Everything works well, but when i clicked the "update all" button from the comfyUI's node manager button, i got this message that suggested me to report the bug to pyTorch, so here i am.
Note that i can just restart the comfyUI server and use comfyUI works well after that, so the "bug" is not harmful and only occurs when i try to update all (that's the second time i notice that bug, the first time was also when i try to update all).
So here is my terminal output when starting comfyUI (via pinokio)
Microsoft Windows [Version 10.0.22631.4751]
(c) Microsoft Corporation. All rights reserved.
D:\tools\ai\pinokio\api\comfy.git\app>conda_hook && conda deactivate && conda deactivate && conda deactivate && conda activate base && D:\tools\ai\pinokio\api\comfy.git\app\env\Scripts\activate D:\tools\ai\pinokio\api\comfy.git\app\env && python main.py
[START] Security scan
[DONE] Security scan
## ComfyUI-Manager: installing dependencies done.
** ComfyUI startup time: 2025-01-27 08:11:47.070
** Platform: Windows
** Python version: 3.10.16 | packaged by conda-forge | (main, Dec 5 2024, 14:07:43) [MSC v.1942 64 bit (AMD64)]
** Python executable: D:\tools\ai\pinokio\api\comfy.git\app\env\Scripts\python.exe
** ComfyUI Path: D:\tools\ai\pinokio\api\comfy.git\app
** ComfyUI Base Folder Path: D:\tools\ai\pinokio\api\comfy.git\app
** User directory: D:\tools\ai\pinokio\api\comfy.git\app\user
** ComfyUI-Manager config path: D:\tools\ai\pinokio\api\comfy.git\app\user\default\ComfyUI-Manager\config.ini
** Log path: D:\tools\ai\pinokio\api\comfy.git\app\user\comfyui.log
[notice] A new release of pip is available: 23.0.1 -> 24.3.1
[notice] To update, run: python.exe -m pip install --upgrade pip
[notice] A new release of pip is available: 23.0.1 -> 24.3.1
[notice] To update, run: python.exe -m pip install --upgrade pip
Prestartup times for custom nodes:
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-easy-use
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\rgthree-comfy
17.5 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Manager
Checkpoint files will always be loaded safely.
Total VRAM 24564 MB, total RAM 130780 MB
pytorch version: 2.5.1+cu121
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 4090 : cudaMallocAsync
Using pytorch attention
ComfyUI version: 0.3.12
[Prompt Server] web root: D:\tools\ai\pinokio\api\comfy.git\app\web
Adding D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes to sys.path
Could not find efficiency nodes
[comfyui_controlnet_aux] | INFO -> Using ckpts path: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui_controlnet_aux\ckpts
[comfyui_controlnet_aux] | INFO -> Using symlinks: False
[comfyui_controlnet_aux] | INFO -> Using ort providers: ['CUDAExecutionProvider', 'DirectMLExecutionProvider', 'OpenVINOExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider', 'CoreMLExecutionProvider']
DWPose: Onnxruntime with acceleration providers detected
Loaded ControlNetPreprocessors nodes from D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui_controlnet_aux
Could not find AdvancedControlNet nodes
Could not find AnimateDiff nodes
Could not find IPAdapter nodes
Could not find VideoHelperSuite nodes
Could not load ImpactPack nodes Could not find ImpactPack nodes
[Crystools INFO] Crystools version: 1.21.0
[Crystools INFO] CPU: Intel(R) Core(TM) i9-14900KS - Arch: AMD64 - OS: Windows 10
[Crystools INFO] Pynvml (Nvidia) initialized.
[Crystools INFO] GPU/s:
[Crystools INFO] 0) NVIDIA GeForce RTX 4090
[Crystools INFO] NVIDIA Driver: 551.86
Depthcrafter Nodes Loaded
[ComfyUI-Easy-Use] server: v1.2.7 Loaded
[ComfyUI-Easy-Use] web root: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-easy-use\web_version/v2 Loaded
### Loading: ComfyUI-Impact-Pack (V8.4.1)
[Impact Pack] Wildcards loading done.
Total VRAM 24564 MB, total RAM 130780 MB
pytorch version: 2.5.1+cu121
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 4090 : cudaMallocAsync
### Loading: ComfyUI-Manager (V3.9.4)
### ComfyUI Version: v0.3.12-25-g4f011b9a | Released on '2025-01-26'
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
------------------------------------------
Comfyroll Studio v1.76 : 175 Nodes Loaded
------------------------------------------
** For changes, please see patch notes at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/blob/main/Patch_Notes.md
** For help, please see the wiki at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/wiki
------------------------------------------
Initializing ControlAltAI Nodes
D:\tools\ai\pinokio\api\comfy.git\app\env\lib\site-packages\albumentations\__init__.py:13: UserWarning: A new version of Albumentations is available: 2.0.1 (you have 1.4.15). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
FETCH ComfyRegistry Data: 5/31
WAS Node Suite: Importing styles from `D:\tools\ai\pinokio\api\comfy.git\app\user\default\prompt-styles\sd-styles.csv`.
WAS Node Suite: Styles import complete.
WAS Node Suite: OpenCV Python FFMPEG support is enabled
WAS Node Suite Warning: `ffmpeg_bin_path` is not set in `D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\pr-was-node-suite-comfyui-47064894\was_suite_config.json` config file. Will attempt to use system ffmpeg binaries if available.
WAS Node Suite: Finished. Loaded 220 nodes successfully.
"Art is the mirror that reflects the beauty within us." - Unknown
[rgthree-comfy] Loaded 42 fantastic nodes. 🎉
Traceback (most recent call last):
File "D:\tools\ai\pinokio\api\comfy.git\app\nodes.py", line 2110, in load_custom_node
module_spec.loader.exec_module(module)
File "<frozen importlib._bootstrap_external>", line 883, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\stable-point-aware-3d\__init__.py", line 17, in <module>
from spar3d.models.mesh import QUAD_REMESH_AVAILABLE, TRIANGLE_REMESH_AVAILABLE
File "D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\stable-point-aware-3d\spar3d\models\mesh.py", line 10, in <module>
from jaxtyping import Float, Integer
ModuleNotFoundError: No module named 'jaxtyping'
Cannot import D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\stable-point-aware-3d module for custom nodes: No module named 'jaxtyping'
Import times for custom nodes:
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-styles_csv_loader
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-GGUF
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui_controlnet_aux
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui_controlaltai_nodes
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-frame-interpolation
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_Comfyroll_CustomNodes
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-depthcrafter-nodes
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\websocket_image_save.py
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-liveportraitkj
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui_essentials
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-kjnodes
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-hunyuanvideowrapper
Microsoft Windows [Version 10.0.22631.4751]
(c) Microsoft Corporation. All rights reserved.
D:\tools\ai\pinokio\api\comfy.git\app>conda_hook && conda deactivate && conda deactivate && conda deactivate && conda activate base && D:\tools\ai\pinokio\api\comfy.git\app\env\Scripts\activate D:\tools\ai\pinokio\api\comfy.git\app\env && python main.py
[START] Security scan
[DONE] Security scan
## ComfyUI-Manager: installing dependencies done.
** ComfyUI startup time: 2025-01-27 08:15:27.048
** Platform: Windows
** Python version: 3.10.16 | packaged by conda-forge | (main, Dec 5 2024, 14:07:43) [MSC v.1942 64 bit (AMD64)]
** Python executable: D:\tools\ai\pinokio\api\comfy.git\app\env\Scripts\python.exe
** ComfyUI Path: D:\tools\ai\pinokio\api\comfy.git\app
** ComfyUI Base Folder Path: D:\tools\ai\pinokio\api\comfy.git\app
** User directory: D:\tools\ai\pinokio\api\comfy.git\app\user
** ComfyUI-Manager config path: D:\tools\ai\pinokio\api\comfy.git\app\user\default\ComfyUI-Manager\config.ini
** Log path: D:\tools\ai\pinokio\api\comfy.git\app\user\comfyui.log
[notice] A new release of pip is available: 23.0.1 -> 24.3.1
[notice] To update, run: python.exe -m pip install --upgrade pip
And then when i click the "update all" button here is where the "bug" happen:
#######################################################################
[ComfyUI-Manager] Starting dependency installation/(de)activation for the extension
Downloading https://storage.googleapis.com/comfy-registry/drltdata/comfyui-impact-pack/8.5.1/node.zip to D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\CNR_temp_cc707452-be31-4a13-8364-7cb1c4aed1dd.zip
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.63M/1.63M [00:00<00:00, 7.77MB/s]
Extracted zip file to D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-impact-pack
'D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-impact-pack' is moved to 'D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-impact-pack'
Install: pip packages for 'D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-impact-pack'
[SKIP] Downgrading pip package isn't allowed: scipy (cur=1.15.1)
Install: install script for 'D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-impact-pack'
[!]
[!] WARN: The `COMFYUI_PATH` environment variable is not set. Assuming `D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-impact-pack/../../` as the ComfyUI path.
[!]
[!] WARN: The `COMFYUI_MODEL_PATH` environment variable is not set. Assuming `D:\tools\ai\pinokio\api\comfy.git\app\models` as the ComfyUI path.
### ComfyUI-Impact-Pack: Check dependencies
[!]### ComfyUI-Impact-Pack: Check basic models
Downloading https://dl.fbaipublicfiles.com/segment_anything/sam_vit_b_01ec64.pth to D:\tools\ai\pinokio\api\comfy.git\app\models\sams\sam_vit_b_01ec64.pth
[!] 0%| | 0.00/375M [00:00<?, ?B/s]
[!] 0%| | 983k/375M [00:00<00:38, 9.68MB/s]
[!] 1%| | 1.97M/375M [00:00<00:38, 9.77MB/s]
[!] 1%| | 2.98M/375M [00:00<00:39, 9.45MB/s]
[!] 1%|▌ | 4.03M/375M [00:00<00:37, 9.80MB/s]
[!] 1%|▌ | 5.01M/375M [00:00<00:39, 9.45MB/s]
...
[!] 100%|█████████▌| 375M/375M [00:40<00:00, 9.33MB/s]
[!] 100%|██████████| 375M/375M [00:40<00:00, 9.37MB/s]
### ComfyUI-Impact-Pack: onnx model directory created (D:\tools\ai\pinokio\api\comfy.git\app\models\onnx)
[ComfyUI-Manager] Startup script completed.
#######################################################################
[notice] A new release of pip is available: 23.0.1 -> 24.3.1
[notice] To update, run: python.exe -m pip install --upgrade pip
Prestartup times for custom nodes:
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\rgthree-comfy
0.0 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\comfyui-easy-use
46.8 seconds: D:\tools\ai\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Manager
Checkpoint files will always be loaded safely.
Traceback (most recent call last):
File "D:\tools\ai\pinokio\api\comfy.git\app\main.py", line 136, in <module>
import execution
File "D:\tools\ai\pinokio\api\comfy.git\app\execution.py", line 13, in <module>
import nodes
File "D:\tools\ai\pinokio\api\comfy.git\app\nodes.py", line 22, in <module>
import comfy.diffusers_load
File "D:\tools\ai\pinokio\api\comfy.git\app\comfy\diffusers_load.py", line 3, in <module>
import comfy.sd
File "D:\tools\ai\pinokio\api\comfy.git\app\comfy\sd.py", line 6, in <module>
from comfy import model_management
File "D:\tools\ai\pinokio\api\comfy.git\app\comfy\model_management.py", line 166, in <module>
total_vram = get_total_memory(get_torch_device()) / (1024 * 1024)
File "D:\tools\ai\pinokio\api\comfy.git\app\comfy\model_management.py", line 129, in get_torch_device
return torch.device(torch.cuda.current_device())
File "D:\tools\ai\pinokio\api\comfy.git\app\env\lib\site-packages\torch\cuda\__init__.py", line 940, in current_device
_lazy_init()
File "D:\tools\ai\pinokio\api\comfy.git\app\env\lib\site-packages\torch\cuda\__init__.py", line 319, in _lazy_init
torch._C._cuda_init()
RuntimeError: config[i] == get()->name() INTERNAL ASSERT FAILED at "C:\\actions-runner\\_work\\pytorch\\pytorch\\builder\\windows\\pytorch\\c10\\cuda\\CUDAAllocatorConfig.cpp":230, please report a bug to PyTorch. Allocator backend parsed at runtime != allocator backend parsed at load time
(env) (base) D:\tools\ai\pinokio\api\comfy.git\app>
I noticed that the internal assert failed at C something, while all my install is in the D drive.
That's all i can tell, as i only use the GUI of those tools, i don't know what's going on under the hood.
Hope this helps.
Versions
my env is from pinokio
cc @peterjc123 @mszhanyi @skyline75489 @nbcsm @iremyux @Blackhex