Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Mish #55

Merged
merged 5 commits into from Nov 18, 2019
Merged

[WIP] Mish #55

merged 5 commits into from Nov 18, 2019

Conversation

@raver119
Copy link

raver119 commented Nov 18, 2019

This PR adds Mish activation function + derivative.

Signed-off-by: raver119 <raver119@gmail.com>
@raver119 raver119 requested a review from AlexDBlack Nov 18, 2019
raver119 added 3 commits Nov 18, 2019
Signed-off-by: raver119 <raver119@gmail.com>
Signed-off-by: raver119 <raver119@gmail.com>
Signed-off-by: raver119 <raver119@gmail.com>
Copy link
Member

AlexDBlack left a comment

Implementation looks good, I checked paper for math. I might push up DL4J gradient check as final sanity check though.

libnd4j/include/ops/ops.h Outdated Show resolved Hide resolved
Signed-off-by: raver119 <raver119@gmail.com>
@raver119 raver119 merged commit db7ca95 into master Nov 18, 2019
@raver119 raver119 deleted the r119_mish branch Nov 18, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.