Some questions about Multi-GPUs

[zyoungDL]

Thanks for sharing your excellent work, but I have a question if I want to run this code with multi-GPUs, how can I modify the code?
By the way, what's your GPU using for training this network, Tesla V100 or others?

[Na-Z]

Thanks for sharing your excellent work, but I have a question if I want to run this code with multi-GPUs, how can I modify the code?

You can leverage Data Parallelism in pytorch to employ multi-gpu. Please refer to https://pytorch.org/tutorials/beginner/former_torchies/parallelism_tutorial.html for the usage.

By the way, what's your GPU using for training this network, Tesla V100 or others?

We used NVIDIA GTX 1080Ti to train our model.