The resnet18 used has BN layers which needs to be in eval mode to give good results. I'll submit a PR tomorrow. http://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html#sphx-glr-beginner-transfer-learning-tutorial-py