ICML17_ReLU

Relevant paper:

An Analytical Formula of Population Gradient for two-layered ReLU network and its Applications in Convergence and Critical Point Analysis
Yuandong Tian
ICML, 2017

link

Usage

Simply run python convergence.py to check the convergence with population gradient. fig_L.py and fig_verify.py can be used to regenerate the figures in the paper.

Dependence

Python, Matplotlib

License

MIT