Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How does a single GPU run train? #60

Closed
18022443868 opened this issue Sep 27, 2020 · 0 comments
Closed

How does a single GPU run train? #60

18022443868 opened this issue Sep 27, 2020 · 0 comments

Comments

@18022443868
Copy link

D:\Anaconda3\envs\refinenet\python.exe "C:\Program Files\JetBrains\PyCharm 2020.1.3\plugins\python\helpers\pydev\pydevd.py" --multiproc --qt-support=auto --client 127.0.0.1 --port 54082 --file E:/vSLAM/light-weight-refinenet-master/src/train.py
pydev debugger: process 16648 is connecting
Connected to pydev debugger (build 201.8538.36)
INFO:main: Loaded Segmenter 152, ImageNet-Pre-Trained=True, #PARAMS=62.04M
Traceback (most recent call last):
File "C:\Program Files\JetBrains\PyCharm 2020.1.3\plugins\python\helpers\pydev\pydevd.py", line 1438, in _exec
pydev_imports.execfile(file, globals, locals) # execute the script
File "C:\Program Files\JetBrains\PyCharm 2020.1.3\plugins\python\helpers\pydev_pydev_imps_pydev_execfile.py", line 18, in execfile
exec(compile(contents+"\n", file, 'exec'), glob, loc)
File "E:/vSLAM/light-weight-refinenet-master/src/train.py", line 621, in
main()
File "E:/vSLAM/light-weight-refinenet-master/src/train.py", line 531, in main
best_val, epoch_start = load_ckpt(args.ckpt_path, {"segmenter": segmenter})
File "E:/vSLAM/light-weight-refinenet-master/src/train.py", line 390, in load_ckpt
v.load_state_dict(ckpt[k])
File "D:\Anaconda3\envs\refinenet\lib\site-packages\torch\nn\modules\module.py", line 845, in load_state_dict
self.class.name, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for DataParallel:
Missing key(s) in state_dict: "module.layer2.4.conv1.weight", "module.layer2.4.bn1.weight", "module.layer2.4.bn1.bias", "module.layer2.4.bn1.running_mean", "module.layer2.4.bn1.running_var", "module.layer2.4.conv2.weight", "module.layer2.4.bn2.weight", "module.layer2.4.bn2.bias", "module.layer2.4.bn2.running_mean", "module.layer2.4.bn2.running_var", "module.layer2.4.conv3.weight", "module.layer2.4.bn3.weight", "module.layer2.4.bn3.bias", "module.layer2.4.bn3.running_mean", "module.layer2.4.bn3.running_var", "module.layer2.5.conv1.weight", "module.layer2.5.bn1.weight", "module.layer2.5.bn1.bias", "module.layer2.5.bn1.running_mean", "module.layer2.5.bn1.running_var", "module.layer2.5.conv2.weight", "module.layer2.5.bn2.weight", "module.layer2.5.bn2.bias", "module.layer2.5.bn2.running_mean", "module.layer2.5.bn2.running_var", "module.layer2.5.conv3.weight", "module.layer2.5.bn3.weight", "module.layer2.5.bn3.bias", "module.layer2.5.bn3.running_mean", "module.layer2.5.bn3.running_var", "module.layer2.6.conv1.weight", "module.layer2.6.bn1.weight", "module.layer2.6.bn1.bias", "module.layer2.6.bn1.running_mean", "module.layer2.6.bn1.running_var", "module.layer2.6.conv2.weight", "module.layer2.6.bn2.weight", "module.layer2.6.bn2.bias", "module.layer2.6.bn2.running_mean", "module.layer2.6.bn2.running_var", "module.layer2.6.conv3.weight", "module.layer2.6.bn3.weight", "module.layer2.6.bn3.bias", "module.layer2.6.bn3.running_mean", "module.layer2.6.bn3.running_var", "module.layer2.7.conv1.weight", "module.layer2.7.bn1.weight", "module.layer2.7.bn1.bias", "module.layer2.7.bn1.running_mean", "module.layer2.7.bn1.running_var", "module.layer2.7.conv2.weight", "module.layer2.7.bn2.weight", "module.layer2.7.bn2.bias", "module.layer2.7.bn2.running_mean", "module.layer2.7.bn2.running_var", "module.layer2.7.conv3.weight", "module.layer2.7.bn3.weight", "module.layer2.7.bn3.bias", "module.layer2.7.bn3.running_mean", "module.layer2.7.bn3.running_var", "module.layer3.6.conv1.weight", "module.layer3.6.bn1.weight", "module.layer3.6.bn1.bias", "module.layer3.6.bn1.running_mean", "module.layer3.6.bn1.running_var", "module.layer3.6.conv2.weight", "module.layer3.6.bn2.weight", "module.layer3.6.bn2.bias", "module.layer3.6.bn2.running_mean", "module.layer3.6.bn2.running_var", "module.layer3.6.conv3.weight", "module.layer3.6.bn3.weight", "module.layer3.6.bn3.bias", "module.layer3.6.bn3.running_mean", "module.layer3.6.bn3.running_var", "module.layer3.7.conv1.weight", "module.layer3.7.bn1.weight", "module.layer3.7.bn1.bias", "module.layer3.7.bn1.running_mean", "module.layer3.7.bn1.running_var", "module.layer3.7.conv2.weight", "module.layer3.7.bn2.weight", "module.layer3.7.bn2.bias", "module.layer3.7.bn2.running_mean", "module.layer3.7.bn2.running_var", "module.layer3.7.conv3.weight", "module.layer3.7.bn3.weight", "module.layer3.7.bn3.bias", "module.layer3.7.bn3.running_mean", "module.layer3.7.bn3.running_var", "module.layer3.8.conv1.weight", "module.layer3.8.bn1.weight", "module.layer3.8.bn1.bias", "module.layer3.8.bn1.running_mean", "module.layer3.8.bn1.running_var", "module.layer3.8.conv2.weight", "module.layer3.8.bn2.weight", "module.layer3.8.bn2.bias", "module.layer3.8.bn2.running_mean", "module.layer3.8.bn2.running_var", "module.layer3.8.conv3.weight", "module.layer3.8.bn3.weight", "module.layer3.8.bn3.bias", "module.layer3.8.bn3.running_mean", "module.layer3.8.bn3.running_var", "module.layer3.9.conv1.weight", "module.layer3.9.bn1.weight", "module.layer3.9.bn1.bias", "module.layer3.9.bn1.running_mean", "module.layer3.9.bn1.running_var", "module.layer3.9.conv2.weight", "module.layer3.9.bn2.weight", "module.layer3.9.bn2.bias", "module.layer3.9.bn2.running_mean", "module.layer3.9.bn2.running_var", "module.layer3.9.conv3.weight", "module.layer3.9.bn3.weight", "module.layer3.9.bn3.bias", "module.layer3.9.bn3.running_mean", "module.layer3.9.bn3.running_var", "module.layer3.10.conv1.weight", "module.layer3.10.bn1.weight", "module.layer3.10.bn1.bias", "module.layer3.10.bn1.running_mean", "module.layer3.10.bn1.running_var", "module.layer3.10.conv2.weight", "module.layer3.10.bn2.weight", "module.layer3.10.bn2.bias", "module.layer3.10.bn2.running_mean", "module.layer3.10.bn2.running_var", "module.layer3.10.conv3.weight", "module.layer3.10.bn3.weight", "module.layer3.10.bn3.bias", "module.layer3.10.bn3.running_mean", "module.layer3.10.bn3.running_var", "module.layer3.11.conv1.weight", "module.layer3.11.bn1.weight", "module.layer3.11.bn1.bias", "module.layer3.11.bn1.running_mean", "module.layer3.11.bn1.running_var", "module.layer3.11.conv2.weight", "module.layer3.11.bn2.weight", "module.layer3.11.bn2.bias", "module.layer3.11.bn2.running_mean", "module.layer3.11.bn2.running_var", "module.layer3.11.conv3.weight", "module.layer3.11.bn3.weight", "module.layer3.11.bn3.bias", "module.layer3.11.bn3.running_mean", "module.layer3.11.bn3.running_var", "module.layer3.12.conv1.weight", "module.layer3.12.bn1.weight", "module.layer3.12.bn1.bias", "module.layer3.12.bn1.running_mean", "module.layer3.12.bn1.running_var", "module.layer3.12.conv2.weight", "module.layer3.12.bn2.weight", "module.layer3.12.bn2.bias", "module.layer3.12.bn2.running_mean", "module.layer3.12.bn2.running_var", "module.layer3.12.conv3.weight", "module.layer3.12.bn3.weight", "module.layer3.12.bn3.bias", "module.layer3.12.bn3.running_mean", "module.layer3.12.bn3.running_var", "module.layer3.13.conv1.weight", "module.layer3.13.bn1.weight", "module.layer3.13.bn1.bias", "module.layer3.13.bn1.running_mean", "module.layer3.13.bn1.running_var", "module.layer3.13.conv2.weight", "module.layer3.13.bn2.weight", "module.layer3.13.bn2.bias", "module.layer3.13.bn2.running_mean", "module.layer3.13.bn2.running_var", "module.layer3.13.conv3.weight", "module.layer3.13.bn3.weight", "module.layer3.13.bn3.bias", "module.layer3.13.bn3.running_mean", "module.layer3.13.bn3.running_var", "module.layer3.14.conv1.weight", "module.layer3.14.bn1.weight", "module.layer3.14.bn1.bias", "module.layer3.14.bn1.running_mean", "module.layer3.14.bn1.running_var", "module.layer3.14.conv2.weight", "module.layer3.14.bn2.weight", "module.layer3.14.bn2.bias", "module.layer3.14.bn2.running_mean", "module.layer3.14.bn2.running_var", "module.layer3.14.conv3.weight", "module.layer3.14.bn3.weight", "module.layer3.14.bn3.bias", "module.layer3.14.bn3.running_mean", "module.layer3.14.bn3.running_var", "module.layer3.15.conv1.weight", "module.layer3.15.bn1.weight", "module.layer3.15.bn1.bias", "module.layer3.15.bn1.running_mean", "module.layer3.15.bn1.running_var", "module.layer3.15.conv2.weight", "module.layer3.15.bn2.weight", "module.layer3.15.bn2.bias", "module.layer3.15.bn2.running_mean", "module.layer3.15.bn2.running_var", "module.layer3.15.conv3.weight", "module.layer3.15.bn3.weight", "module.layer3.15.bn3.bias", "module.layer3.15.bn3.running_mean", "module.layer3.15.bn3.running_var", "module.layer3.16.conv1.weight", "module.layer3.16.bn1.weight", "module.layer3.16.bn1.bias", "module.layer3.16.bn1.running_mean", "module.layer3.16.bn1.running_var", "module.layer3.16.conv2.weight", "module.layer3.16.bn2.weight", "module.layer3.16.bn2.bias", "module.layer3.16.bn2.running_mean", "module.layer3.16.bn2.running_var", "module.layer3.16.conv3.weight", "module.layer3.16.bn3.weight", "module.layer3.16.bn3.bias", "module.layer3.16.bn3.running_mean", "module.layer3.16.bn3.running_var", "module.layer3.17.conv1.weight", "module.layer3.17.bn1.weight", "module.layer3.17.bn1.bias", "module.layer3.17.bn1.running_mean", "module.layer3.17.bn1.running_var", "module.layer3.17.conv2.weight", "module.layer3.17.bn2.weight", "module.layer3.17.bn2.bias", "module.layer3.17.bn2.running_mean", "module.layer3.17.bn2.running_var", "module.layer3.17.conv3.weight", "module.layer3.17.bn3.weight", "module.layer3.17.bn3.bias", "module.layer3.17.bn3.running_mean", "module.layer3.17.bn3.running_var", "module.layer3.18.conv1.weight", "module.layer3.18.bn1.weight", "module.layer3.18.bn1.bias", "module.layer3.18.bn1.running_mean", "module.layer3.18.bn1.running_var", "module.layer3.18.conv2.weight", "module.layer3.18.bn2.weight", "module.layer3.18.bn2.bias", "module.layer3.18.bn2.running_mean", "module.layer3.18.bn2.running_var", "module.layer3.18.conv3.weight", "module.layer3.18.bn3.weight", "module.layer3.18.bn3.bias", "module.layer3.18.bn3.running_mean", "module.layer3.18.bn3.running_var", "module.layer3.19.conv1.weight", "module.layer3.19.bn1.weight", "module.layer3.19.bn1.bias", "module.layer3.19.bn1.running_mean", "module.layer3.19.bn1.running_var", "module.layer3.19.conv2.weight", "module.layer3.19.bn2.weight", "module.layer3.19.bn2.bias", "module.layer3.19.bn2.running_mean", "module.layer3.19.bn2.running_var", "module.layer3.19.conv3.weight", "module.layer3.19.bn3.weight", "module.layer3.19.bn3.bias", "module.layer3.19.bn3.running_mean", "module.layer3.19.bn3.running_var", "module.layer3.20.conv1.weight", "module.layer3.20.bn1.weight", "module.layer3.20.bn1.bias", "module.layer3.20.bn1.running_mean", "module.layer3.20.bn1.running_var", "module.layer3.20.conv2.weight", "module.layer3.20.bn2.weight", "module.layer3.20.bn2.bias", "module.layer3.20.bn2.running_mean", "module.layer3.20.bn2.running_var", "module.layer3.20.conv3.weight", "module.layer3.20.bn3.weight", "module.layer3.20.bn3.bias", "module.layer3.20.bn3.running_mean", "module.layer3.20.bn3.running_var", "module.layer3.21.conv1.weight", "module.layer3.21.bn1.weight", "module.layer3.21.bn1.bias", "module.layer3.21.bn1.running_mean", "module.layer3.21.bn1.running_var", "module.layer3.21.conv2.weight", "module.layer3.21.bn2.weight", "module.layer3.21.bn2.bias", "module.layer3.21.bn2.running_mean", "module.layer3.21.bn2.running_var", "module.layer3.21.conv3.weight", "module.layer3.21.bn3.weight", "module.layer3.21.bn3.bias", "module.layer3.21.bn3.running_mean", "module.layer3.21.bn3.running_var", "module.layer3.22.conv1.weight", "module.layer3.22.bn1.weight", "module.layer3.22.bn1.bias", "module.layer3.22.bn1.running_mean", "module.layer3.22.bn1.running_var", "module.layer3.22.conv2.weight", "module.layer3.22.bn2.weight", "module.layer3.22.bn2.bias", "module.layer3.22.bn2.running_mean", "module.layer3.22.bn2.running_var", "module.layer3.22.conv3.weight", "module.layer3.22.bn3.weight", "module.layer3.22.bn3.bias", "module.layer3.22.bn3.running_mean", "module.layer3.22.bn3.running_var", "module.layer3.23.conv1.weight", "module.layer3.23.bn1.weight", "module.layer3.23.bn1.bias", "module.layer3.23.bn1.running_mean", "module.layer3.23.bn1.running_var", "module.layer3.23.conv2.weight", "module.layer3.23.bn2.weight", "module.layer3.23.bn2.bias", "module.layer3.23.bn2.running_mean", "module.layer3.23.bn2.running_var", "module.layer3.23.conv3.weight", "module.layer3.23.bn3.weight", "module.layer3.23.bn3.bias", "module.layer3.23.bn3.running_mean", "module.layer3.23.bn3.running_var", "module.layer3.24.conv1.weight", "module.layer3.24.bn1.weight", "module.layer3.24.bn1.bias", "module.layer3.24.bn1.running_mean", "module.layer3.24.bn1.running_var", "module.layer3.24.conv2.weight", "module.layer3.24.bn2.weight", "module.layer3.24.bn2.bias", "module.layer3.24.bn2.running_mean", "module.layer3.24.bn2.running_var", "module.layer3.24.conv3.weight", "module.layer3.24.bn3.weight", "module.layer3.24.bn3.bias", "module.layer3.24.bn3.running_mean", "module.layer3.24.bn3.running_var", "module.layer3.25.conv1.weight", "module.layer3.25.bn1.weight", "module.layer3.25.bn1.bias", "module.layer3.25.bn1.running_mean", "module.layer3.25.bn1.running_var", "module.layer3.25.conv2.weight", "module.layer3.25.bn2.weight", "module.layer3.25.bn2.bias", "module.layer3.25.bn2.running_mean", "module.layer3.25.bn2.running_var", "module.layer3.25.conv3.weight", "module.layer3.25.bn3.weight", "module.layer3.25.bn3.bias", "module.layer3.25.bn3.running_mean", "module.layer3.25.bn3.running_var", "module.layer3.26.conv1.weight", "module.layer3.26.bn1.weight", "module.layer3.26.bn1.bias", "module.layer3.26.bn1.running_mean", "module.layer3.26.bn1.running_var", "module.layer3.26.conv2.weight", "module.layer3.26.bn2.weight", "module.layer3.26.bn2.bias", "module.layer3.26.bn2.running_mean", "module.layer3.26.bn2.running_var", "module.layer3.26.conv3.weight", "module.layer3.26.bn3.weight", "module.layer3.26.bn3.bias", "module.layer3.26.bn3.running_mean", "module.layer3.26.bn3.running_var", "module.layer3.27.conv1.weight", "module.layer3.27.bn1.weight", "module.layer3.27.bn1.bias", "module.layer3.27.bn1.running_mean", "module.layer3.27.bn1.running_var", "module.layer3.27.conv2.weight", "module.layer3.27.bn2.weight", "module.layer3.27.bn2.bias", "module.layer3.27.bn2.running_mean", "module.layer3.27.bn2.running_var", "module.layer3.27.conv3.weight", "module.layer3.27.bn3.weight", "module.layer3.27.bn3.bias", "module.layer3.27.bn3.running_mean", "module.layer3.27.bn3.running_var", "module.layer3.28.conv1.weight", "module.layer3.28.bn1.weight", "module.layer3.28.bn1.bias", "module.layer3.28.bn1.running_mean", "module.layer3.28.bn1.running_var", "module.layer3.28.conv2.weight", "module.layer3.28.bn2.weight", "module.layer3.28.bn2.bias", "module.layer3.28.bn2.running_mean", "module.layer3.28.bn2.running_var", "module.layer3.28.conv3.weight", "module.layer3.28.bn3.weight", "module.layer3.28.bn3.bias", "module.layer3.28.bn3.running_mean", "module.layer3.28.bn3.running_var", "module.layer3.29.conv1.weight", "module.layer3.29.bn1.weight", "module.layer3.29.bn1.bias", "module.layer3.29.bn1.running_mean", "module.layer3.29.bn1.running_var", "module.layer3.29.conv2.weight", "module.layer3.29.bn2.weight", "module.layer3.29.bn2.bias", "module.layer3.29.bn2.running_mean", "module.layer3.29.bn2.running_var", "module.layer3.29.conv3.weight", "module.layer3.29.bn3.weight", "module.layer3.29.bn3.bias", "module.layer3.29.bn3.running_mean", "module.layer3.29.bn3.running_var", "module.layer3.30.conv1.weight", "module.layer3.30.bn1.weight", "module.layer3.30.bn1.bias", "module.layer3.30.bn1.running_mean", "module.layer3.30.bn1.running_var", "module.layer3.30.conv2.weight", "module.layer3.30.bn2.weight", "module.layer3.30.bn2.bias", "module.layer3.30.bn2.running_mean", "module.layer3.30.bn2.running_var", "module.layer3.30.conv3.weight", "module.layer3.30.bn3.weight", "module.layer3.30.bn3.bias", "module.layer3.30.bn3.running_mean", "module.layer3.30.bn3.running_var", "module.layer3.31.conv1.weight", "module.layer3.31.bn1.weight", "module.layer3.31.bn1.bias", "module.layer3.31.bn1.running_mean", "module.layer3.31.bn1.running_var", "module.layer3.31.conv2.weight", "module.layer3.31.bn2.weight", "module.layer3.31.bn2.bias", "module.layer3.31.bn2.running_mean", "module.layer3.31.bn2.running_var", "module.layer3.31.conv3.weight", "module.layer3.31.bn3.weight", "module.layer3.31.bn3.bias", "module.layer3.31.bn3.running_mean", "module.layer3.31.bn3.running_var", "module.layer3.32.conv1.weight", "module.layer3.32.bn1.weight", "module.layer3.32.bn1.bias", "module.layer3.32.bn1.running_mean", "module.layer3.32.bn1.running_var", "module.layer3.32.conv2.weight", "module.layer3.32.bn2.weight", "module.layer3.32.bn2.bias", "module.layer3.32.bn2.running_mean", "module.layer3.32.bn2.running_var", "module.layer3.32.conv3.weight", "module.layer3.32.bn3.weight", "module.layer3.32.bn3.bias", "module.layer3.32.bn3.running_mean", "module.layer3.32.bn3.running_var", "module.layer3.33.conv1.weight", "module.layer3.33.bn1.weight", "module.layer3.33.bn1.bias", "module.layer3.33.bn1.running_mean", "module.layer3.33.bn1.running_var", "module.layer3.33.conv2.weight", "module.layer3.33.bn2.weight", "module.layer3.33.bn2.bias", "module.layer3.33.bn2.running_mean", "module.layer3.33.bn2.running_var", "module.layer3.33.conv3.weight", "module.layer3.33.bn3.weight", "module.layer3.33.bn3.bias", "module.layer3.33.bn3.running_mean", "module.layer3.33.bn3.running_var", "module.layer3.34.conv1.weight", "module.layer3.34.bn1.weight", "module.layer3.34.bn1.bias", "module.layer3.34.bn1.running_mean", "module.layer3.34.bn1.running_var", "module.layer3.34.conv2.weight", "module.layer3.34.bn2.weight", "module.layer3.34.bn2.bias", "module.layer3.34.bn2.running_mean", "module.layer3.34.bn2.running_var", "module.layer3.34.conv3.weight", "module.layer3.34.bn3.weight", "module.layer3.34.bn3.bias", "module.layer3.34.bn3.running_mean", "module.layer3.34.bn3.running_var", "module.layer3.35.conv1.weight", "module.layer3.35.bn1.weight", "module.layer3.35.bn1.bias", "module.layer3.35.bn1.running_mean", "module.layer3.35.bn1.running_var", "module.layer3.35.conv2.weight", "module.layer3.35.bn2.weight", "module.layer3.35.bn2.bias", "module.layer3.35.bn2.running_mean", "module.layer3.35.bn2.running_var", "module.layer3.35.conv3.weight", "module.layer3.35.bn3.weight", "module.layer3.35.bn3.bias", "module.layer3.35.bn3.running_mean", "module.layer3.35.bn3.running_var".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant