Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Zero init of conv layers before addition #12

Closed
zhujiagang opened this issue May 22, 2019 · 1 comment
Closed

Zero init of conv layers before addition #12

zhujiagang opened this issue May 22, 2019 · 1 comment

Comments

@zhujiagang
Copy link

Thanks for sharing your excellent work! I haven't run the code but I am curious about the implementation of GCNet. Is the Wv2 of conv layer before addition is initialized to zero to not affect the initial behaviour of the original backbone? This has been implemented in the Non-local net by set the scale of BN as zero.
@zhujiagang
Copy link
Author

zhujiagang commented May 22, 2019 •
edited

Sorry to bother you. I've found it in

GCNet/mmdet/ops/ct/context_block.py

Line 6 in 38b0b8e

def last_zero_init(m):

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@zhujiagang