You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Error traceback
If applicable, paste the error trackback here.
2022-01-24 14:42:51,625 - mmgen - INFO - workflow: [('train', 1)], max: 80000 iters
2022-01-24 14:42:51,626 - mmgen - INFO - Checkpoints will be saved to ./work_dirs/experiments/ganISP_cityscapes_rgb2iphone_raw/ckpt/ganISP_cityscapes_rgb2iphone_raw by HardDiskBackend.
Fatal Python error: Segmentation fault
Thread 0x00007f2d2f7fe700 (most recent call first):
Thread 0x00007f2d2ffff700 (most recent call first):
Thread 0x00007f2d7c833700 (most recent call first):
Thread 0x00007f2d7d034700 (most recent call first):
Thread 0x00007f2dcbcdd700 (most recent call first):
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 296 inwait
File "/root/.anaconda3/envs/raw/lib/python3.7/multiprocessing/queues.py", line 224 in _feed
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 870 in run
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 926 in _bootstrap_inner
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 890 in _bootstrap
Thread 0x00007f2dcc4de700 (most recent call first):
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 296 inwait
File "/root/.anaconda3/envs/raw/lib/python3.7/multiprocessing/queues.py", line 224 in _feed
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 870 in run
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 926 in _bootstrap_inner
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 890 in _bootstrap
Thread 0x00007f2dcccdf700 (most recent call first):
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 296 inwait
File "/root/.anaconda3/envs/raw/lib/python3.7/multiprocessing/queues.py", line 224 in _feed
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 870 in run
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 926 in _bootstrap_inner
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 890 in _bootstrap
Thread 0x00007f2dcd4e0700 (most recent call first):
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 296 inwait
File "/root/.anaconda3/envs/raw/lib/python3.7/multiprocessing/queues.py", line 224 in _feed
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 870 in run
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 926 in _bootstrap_inner
File "/root/.anaconda3/envs/raw/lib/python3.7/threading.py", line 890 in _bootstrap
Current thread 0x00007f2f5b591700 (most recent call first):
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/PIL/ImageFile.py", line 509 in _save
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/PIL/PngImagePlugin.py", line 1348 in _save
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/PIL/Image.py", line 2212 in save
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/torchvision/utils.py", line 136 in save_image
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/torch/autograd/grad_mode.py", line 28 in decorate_context
File "/lzh/Project/mmgeneration/mmgen/core/hooks/visualization.py", line 105 in after_train_iter
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/mmcv/runner/dist_utils.py", line 94 in wrapper
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/mmcv/runner/base_runner.py", line 309 in call_hook
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/mmcv/runner/iter_based_runner.py", line 67 in train
File "/root/.anaconda3/envs/raw/lib/python3.7/site-packages/mmcv/runner/iter_based_runner.py", line 134 in run
File "/lzh/Project/mmgeneration/mmgen/apis/train.py", line 199 in train_model
File "tools/train.py", line 164 in main
File "tools/train.py", line 168 in<module>
Bug fix
If you have already identified the reason, you can provide the information here. If you are willing to create a PR to fix it, please also leave a comment here and that would be much appreciated!
Thanks for your error report and we appreciate it a lot.
Checklist
Describe the bug
A clear and concise description of what the bug is.
Reproduction
Run myself code, happended when use MMGenVisualizationHook to save large-scale image(4032x3024) to storage server.
Could be reproducted by:
modified MMGenVisualizationHook
Yes.
Myself dataset.
Environment
python mmgen/utils/collect_env.py
to collect necessary environment information and paste it here.$PATH
,$LD_LIBRARY_PATH
,$PYTHONPATH
, etc.)TorchVision: 0.10.1
OpenCV: 4.5.3
MMCV: 1.4.3
MMGen: 0.5.0+4de90c2
MMCV Compiler: GCC 5.4
MMCV CUDA Compiler: 11.1
Error traceback
If applicable, paste the error trackback here.
Bug fix
If you have already identified the reason, you can provide the information here. If you are willing to create a PR to fix it, please also leave a comment here and that would be much appreciated!
May related to python-pillow/Pillow#4225
Fixed by using cv2:
The text was updated successfully, but these errors were encountered: