Skip to content
This repository has been archived by the owner on Jan 25, 2021. It is now read-only.

Feature Request: Add Mish activation #9

Open
digantamisra98 opened this issue Nov 19, 2019 · 0 comments
Open

Feature Request: Add Mish activation #9

digantamisra98 opened this issue Nov 19, 2019 · 0 comments

Comments

@digantamisra98
Copy link

Mish is a new novel activation function proposed in this paper.
It has shown promising results so far and has been adopted in several packages including:

All benchmarks, analysis and links to official package implementations can be found in this repository

It would be nice to have Mish as an option within the activation function group.

This is the comparison of Mish with other conventional activation functions in a SEResNet-50 for CIFAR-10:
se50_1

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant