Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the spatial-wise RSC #3

Closed
YijinHuang opened this issue Sep 3, 2020 · 2 comments
Closed

Question about the spatial-wise RSC #3

YijinHuang opened this issue Sep 3, 2020 · 2 comments

Comments

@YijinHuang
Copy link

I am confused about the spatial-wise RSC. If you apply average pooling to z (final feature map) and feed in the fully connected layer, I believe that for any channel of z, all values in that channel will be the same. Therefore, after an average pooling along channel dimension, all cells in the 7*7 weighting matrix will have the same value too. So, how do you select top p percentage? Did I miss something? Thank you.

@Justinhzy
Copy link
Collaborator

Hi, you are right. For alexnet, z is diretly used to guide muting. For resnet, downsampled middle layer spatial gradients are used to guide muting for z. Now I have seperated the code for alexnet and resnet respectively. Hope it helps.

@YijinHuang
Copy link
Author

Hi, you are right. For alexnet, z is diretly used to guide muting. For resnet, downsampled middle layer spatial gradients are used to guide muting for z. Now I have seperated the code for alexnet and resnet respectively. Hope it helps.

Got it. Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants