Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The padding of I3D model should be symmetrical #32

Open
fjchange opened this issue Sep 18, 2020 · 1 comment
Open

The padding of I3D model should be symmetrical #32

fjchange opened this issue Sep 18, 2020 · 1 comment

Comments

@fjchange
Copy link

fjchange commented Sep 18, 2020

The Module of MaxPool3dTFPadding with kernel_size=(1,3,3), stride(1,2,2) can lead to asymmetrical padding.
It would influence the output feature map, as the bottom right would be usually higher than other part of the feature map.

When I try to input a all zeros tensor into I3D model pretrained on Kinetics-400, someting strange happen, I average pooling the C and T dim and min-max norm to get a picture as below. The bottom right is much higher than other parts.
grad_cam

By checking each layer output, I find out bottom right is usually have higher activation value than other part but not obvious, until mixed_5b block.

I don't know whether it hurt the model's performance, but at least it hurt the Interpretability.

@hassony2
Copy link
Owner

Thank you for raising this issue.

Interesting ! I am not sure whether this is influencing the numerical results as I converted the models by checking that the results were consistent on different images.
I did observe a slight discrepancy with the original model (as reported in the readme) maybe this is related !

Best,

Yana

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants