Compare Activation Function

The log of training process.
Two(Accuracy and Cross entropy loss) from the left.
ReLU, Sigmoid, ReLU with He initialization.

The loss graph of ReLU and Sigmoid.

The loss graph of ReLU with He initialization and without.

Name		Name	Last commit message	Last commit date
Latest commit History 11 Commits
readme		readme
README.md		README.md
relu_he_model.py		relu_he_model.py
relu_model.py		relu_model.py
run.py		run.py
sigmoid_model.py		sigmoid_model.py

Provide feedback