how to use multiple gpus for testing

[zhuolinumd]

Currently I have a machine with multiple GPUs, when I try to run the python scripts (warpper for Caffe) in parallel for feature extraction (feed-foward process), all scripts use the GPU0. What can I do if I want my python script can select the avaliable GPU dynamically? I don't want to manually specify gpu device id in the script. Thank you

[lukeyeager]

👍

Except that I would be happy to set the GPU manually. I just want some control.

[longjon]

Closing as I can't discern a reasonable issue or feature request here; caffe supports GPU selection in Python with caffe.set_device, and GPU selection is always possible for CUDA applications by using CUDA_VISIBLE_DEVICES. Determining available devices seems outside the scope of Caffe. We might be able to provide that as a convenience, but as far as I know there's no robust way to obtain such information.

In general, please ask usage questions on the caffe-users list. Thanks!

[lukeyeager]

caffe supports GPU selection in Python with caffe.set_device

That's all I need, thanks!

[mrgransky]

Having 4 GPUs and Setting

caffe.set_device([0,1,2,3])
caffe.set_mode_gpu()

in TEST phase, gives me this error:

Traceback (most recent call last):
  File "nordland_dl.py", line 23, in <module>
    caffe.set_device([0,1,2,3])
Boost.Python.ArgumentError: Python argument types in
    caffe._caffe.set_device(list)
did not match C++ signature:
    set_device(int)