Skip to content
forked from guygurari/scope

Making deep learning measurements involving the gradient and the Hessian

License

Notifications You must be signed in to change notification settings

lewkowycz/scope

 
 

Repository files navigation

The Hessian and the gradient in deep networks

Perform measurements involving the gradient, the Hessian, and relations between them. Compute full and partial Hessian spectrum. Support fully-connected / convnet with MNIST / CIFAR10 and various other options (dropout, batch-norm, etc.).

For a minimal install: python3 setup.py develop then python3 scope/train.py --help.

About

Making deep learning measurements involving the gradient and the Hessian

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.5%
  • Shell 0.5%