Skip to content
master
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 

README.md

nn-init-demo

Shows the "vanishing gradient" problem and "dying ReLU" problems, as well as the problems of the activations going to zero if we do the usual "small, random weight" initialization technique. Then we investigate the Xavier init, He init, and Batch normalization techniques for combatting this issue.

About

Demos demonstrations of things that can go wrong when initializing weights

Resources

Releases

No releases published

Packages

No packages published

Languages