Bugs when running on mac

[beasteers]

Wrong device mapping on checkpoint load

Traceback (most recent call last):
  File "/opt/gh/Cutie/interactive_demo.py", line 75, in <module>
    ex = MainController(cfg)
  File "/opt/gh/Cutie/gui/main_controller.py", line 59, in __init__
    self.initialize_networks()
  File "/opt/gh/Cutie/gui/main_controller.py", line 129, in initialize_networks
    model_weights = torch.load(self.cfg.weights)
  File "/opt/miniconda/envs/cutie/lib/python3.10/site-packages/torch/serialization.py", line 1014, in load
    return _load(opened_zipfile,
  File "/opt/miniconda/envs/cutie/lib/python3.10/site-packages/torch/serialization.py", line 1422, in _load
    result = unpickler.load()
  File "/opt/miniconda/envs/cutie/lib/python3.10/site-packages/torch/serialization.py", line 1392, in persistent_load
    typed_storage = load_tensor(dtype, nbytes, key, _maybe_decode_ascii(location))
  File "/opt/miniconda/envs/cutie/lib/python3.10/site-packages/torch/serialization.py", line 1366, in load_tensor
    wrap_storage=restore_location(storage, location),
  File "/opt/miniconda/envs/cutie/lib/python3.10/site-packages/torch/serialization.py", line 381, in default_restore_location
    result = fn(storage, location)
  File "/opt/miniconda/envs/cutie/lib/python3.10/site-packages/torch/serialization.py", line 274, in _cuda_deserialize
    device = validate_cuda_device(location)
  File "/opt/miniconda/envs/cutie/lib/python3.10/site-packages/torch/serialization.py", line 258, in validate_cuda_device
    raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location=torch.device('cpu') to map your storages to the CPU.

Fix:

in main controller do:

model_weights = torch.load(self.cfg.weights, map_location=self.device)

autocast seemingly doesn't work with mps

Traceback (most recent call last):
  File "/opt/gh/Cutie/gui/gui.py", line 411, in on_mouse_press
    self.click_fn(action, ex, ey)
  File "/opt/gh/Cutie/gui/main_controller.py", line 152, in click_fn
    with autocast(self.device, enabled=self.amp and self.device != 'mps'):
  File "/opt/miniconda/envs/cutie/lib/python3.10/site-packages/torch/amp/autocast_mode.py", line 241, in __init__
    raise RuntimeError(
RuntimeError: User specified an unsupported autocast device_type 'mps'

Fix

anywhere autocast is used in main_controller, I did this? idk there's probably a more elegant way

with autocast('cpu' if self.device == 'mps' else self.device, enabled=self.amp and self.device != 'mps'):

[hkchengrex]

Thank you for letting me know. I don't have a Mac device so those functions are all untested.
Can you create a pull request for this if it works?
Thanks again.

[horsto]

The same thing happens under Windows when using 'cpu' :

Using device: cpu
Single object: False
Traceback (most recent call last):
  File "C:\CODE\Cutie\interactive_demo.py", line 75, in <module>
    ex = MainController(cfg)
  File "C:\CODE\Cutie\gui\main_controller.py", line 59, in __init__
    self.initialize_networks()
  File "C:\CODE\Cutie\gui\main_controller.py", line 129, in initialize_networks
    model_weights = torch.load(self.cfg.weights)
  File "C:\Users\hoben\miniconda3\envs\cutie\lib\site-packages\torch\serialization.py", line 1014, in load
    return _load(opened_zipfile,
  File "C:\Users\hoben\miniconda3\envs\cutie\lib\site-packages\torch\serialization.py", line 1422, in _load
    result = unpickler.load()
  File "C:\Users\hoben\miniconda3\envs\cutie\lib\site-packages\torch\serialization.py", line 1392, in persistent_load
    typed_storage = load_tensor(dtype, nbytes, key, _maybe_decode_ascii(location))
  File "C:\Users\hoben\miniconda3\envs\cutie\lib\site-packages\torch\serialization.py", line 1366, in load_tensor
    wrap_storage=restore_location(storage, location),
  File "C:\Users\hoben\miniconda3\envs\cutie\lib\site-packages\torch\serialization.py", line 381, in default_restore_location
    result = fn(storage, location)
  File "C:\Users\hoben\miniconda3\envs\cutie\lib\site-packages\torch\serialization.py", line 274, in _cuda_deserialize
    device = validate_cuda_device(location)
  File "C:\Users\hoben\miniconda3\envs\cutie\lib\site-packages\torch\serialization.py", line 258, in validate_cuda_device
    raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location=torch.device('cpu') to map your storages to the CPU.

[horsto]

A workaround for running it on Mac with MPS is (all in gui/main_controller.py):

[hkchengrex]

Thanks all for the comment. I have updated the autocast and model loading part. Works on Ubuntu CUDA and CPU.

[hkchengrex]

Haven't tested this for Mac -- please feel free to re-open if this fix is not sufficient.