New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallelization error #3

Closed

shubhamagarwal92 opened this issue Jul 10, 2019 · 1 comment

shubhamagarwal92 commented Jul 10, 2019

Hi,

Did you also face this parallelization error while training? This seems to be strange since I am using in fact only one gpu-id!

  File " /home/shubham/rva/visdialch/encoders/modules.py", line 233, in forward
    ques_prob_refine = torch.bmm(ques_gs[:, i, :].view(-1, 1, 2), ques_prob).view(-1, 1, 2) # shape: [batch_size, num_rounds, 2]
RuntimeError: arguments are located on different GPUs at /pytorch/aten/src/THC/generic/THCTensorMathBlas.cu:479

Any suggestions please

The text was updated successfully, but these errors were encountered:

Owner

yuleiniu commented Jul 11, 2019

I haven't faced this problem even with only one gpu. You could try to comment line 178-179 in train.py to avoid the usage of parallelization.

yuleiniu closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment