Multi-GPU size mismatch

[xubenben]

I try to train lm with multi-GPU(In this case, I use 3 GPU) by set "model = torch.nn.DataParallel(model).cuda()", and change "model.init_hidden" to "model.module.init_hidden", then meet error:

It seems that only one GPU's result has been collected, I can't explain what happened.