This repository has been archived by the owner on Mar 11, 2021. It is now read-only.

Add monitoring of gradient magnitude #42

Closed

brilee opened this issue Feb 2, 2018 · 1 comment

Milestone

needed for next 9...

Contributor

brilee commented Feb 2, 2018

We should monitor the norm of the gradient update, the norm of the weights, and the ratio. (If the norm of the gradient gets too small.)

brilee added this to the Begin next summit attempt (V4) milestone

amj modified the milestones: Begin next summit attempt (V4), needed for next 9s run

amj mentioned this issue

Policy and value heads are from AlphaGo Zero, not Alpha Zero glinscott/leela-chess#47

Closed

Contributor Author

brilee commented Feb 7, 2018

Fixed in #63

brilee closed this as completed

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.