Skip to content
Permalink
Browse files

Remove nn.DataParallel

Remove multi-GPU support due to inefficient training.
  • Loading branch information...
iyaja committed Apr 17, 2019
1 parent a6294cf commit eb3c84003d8ff8329214a71023fac81475202e28
Showing with 1 addition and 3 deletions.
  1. +1 −3 dawn.py
@@ -63,9 +63,7 @@ def main():
batch_size = 512
train_transforms = [Crop(32, 32), FlipLR(), Cutout(8, 8)]

model = Network(union(net(), losses))
model = nn.DataParallel(model)
model.to(device).half()
model = Network(union(net(), losses)).cuda().half()

print('Warming up cudnn on random inputs')
for size in [batch_size, len(dataset['test']['labels']) % batch_size]:

0 comments on commit eb3c840

Please sign in to comment.
You can’t perform that action at this time.