-
Notifications
You must be signed in to change notification settings - Fork 7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow custom activation in SqueezeExcitation of EfficientNet #4448
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the PR @kazhang. This is much needed and will allow us to reuse the layer in multiple places. I left a couple of comments, let me know what you think.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks @kazhang!
…#4448) Summary: * allow custom activation in SqueezeExcitation * use ReLU as the default activation * make scale activation parameterizable Reviewed By: datumbox Differential Revision: D31268054 fbshipit-source-id: 0202595934dd3de5364d8ee2713324c4a4c9205e Co-authored-by: Vasilis Vryniotis <datumbox@users.noreply.github.com>
Partially resolves #4333
It would be great to reuse SqueezeExcitation in RegNet implementation(#4403).
cc @datumbox