Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Add Mish activation #152

Closed
digantamisra98 opened this issue Nov 21, 2019 · 3 comments
Closed

Feature Request: Add Mish activation #152

digantamisra98 opened this issue Nov 21, 2019 · 3 comments

Comments

@digantamisra98
Copy link

Mish is a new novel activation function proposed in this paper.
It has shown promising results so far and has been adopted in several packages including:

All benchmarks, analysis and links to official package implementations can be found in this repository

It would be nice to have Mish as an option within the activation function group.

This is the comparison of Mish with other conventional activation functions in a SEResNet-50 for CIFAR-10: (Better accuracy and faster than GELU)
se50_1

@hughperkins
Copy link
Owner

hughperkins commented Nov 21, 2019 via email

@digantamisra98
Copy link
Author

@hughperkins will set up one in the next couple of days. Thanks for considering.

@hughperkins
Copy link
Owner

hughperkins commented Nov 21, 2019 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants