Put the model in train mode in the text classifier tutorial (#112)

Darktex · facebook-github-bot · commit 446c9745945a · 2021-01-08T18:59:04.000-08:00
Summary: Pull Request resolved: #112 PrivacyEngine wants modules to be in train mode, otherwise you may get an obscure err Reviewed By: karthikprasad Differential Revision: D25858498 fbshipit-source-id: 6247d850dd4c7aeaedc5d2265a6e45cab1c6616b
diff --git a/tutorials/building_text_classifier.ipynb b/tutorials/building_text_classifier.ipynb
@@ -560,6 +560,8 @@
     "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n",
     "model = model.to(device)\n",
     "\n",
+    "# Set the model to train mode (HuggingFace models load in eval mode)\n",
+    "model = model.train()\n"
     "# Define optimizer\n",
     "optimizer = torch.optim.AdamW(model.parameters(), lr=5e-4, eps=1e-8)"
    ]

Original file line number	Diff line number	Diff line change
`@@ -560,6 +560,8 @@`
`560`	`560`	`"device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n",`
`561`	`561`	`"model = model.to(device)\n",`
`562`	`562`	`"\n",`
	`563`	`+ "# Set the model to train mode (HuggingFace models load in eval mode)\n",`
	`564`	`+ "model = model.train()\n"`
`563`	`565`	`"# Define optimizer\n",`
`564`	`566`	`"optimizer = torch.optim.AdamW(model.parameters(), lr=5e-4, eps=1e-8)"`
`565`	`567`	`]`