Skip to content

Commit

Permalink
Remove track_grad_norm references
Browse files Browse the repository at this point in the history
  • Loading branch information
ddelange committed May 6, 2023
1 parent ea9da42 commit 88d0664
Showing 1 changed file with 1 addition and 24 deletions.
25 changes: 1 addition & 24 deletions docs/tutorials/multimodal/advanced_topics/customization.ipynb
Expand Up @@ -360,29 +360,6 @@
"```\n"
]
},
{
"cell_type": "markdown",
"id": "02d07866",
"metadata": {},
"source": [
"### optimization.track_grad_norm\n",
"\n",
"Track the p-norm of gradients during training. May be set to ‘inf’ infinity-norm. If using Automatic Mixed Precision (AMP), the gradients will be unscaled before logging them."
]
},
{
"cell_type": "markdown",
"id": "1b60c371",
"metadata": {},
"source": [
"```\n",
"# default used by AutoMM (no tracking)\n",
"predictor.fit(hyperparameters={\"optimization.track_grad_norm\": -1})\n",
"# track the 2-norm\n",
"predictor.fit(hyperparameters={\"optimization.track_grad_norm\": 2})\n",
"```\n"
]
},
{
"cell_type": "markdown",
"id": "abe87d32",
Expand Down Expand Up @@ -1574,4 +1551,4 @@
},
"nbformat": 4,
"nbformat_minor": 5
}
}

0 comments on commit 88d0664

Please sign in to comment.