Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add and SE-add #21

Open
zeroboy123 opened this issue Jul 5, 2021 · 1 comment
Open

add and SE-add #21

zeroboy123 opened this issue Jul 5, 2021 · 1 comment

Comments

@zeroboy123
Copy link

hi!,Dear author:
I see two modules in the Model,add and SE-add.I did SE-add,in Reasoning process,I'm using the same RGB and a different depth as the input,I get the same result, why isn't my depth much affected,Did I input the model in the wrong way?

@danielS91
Copy link
Member

In our experiments, SE-add leads to better results as the features get weighted using and Squeeze-and-Excitation operation before fusing them. Depending on the input, the model can decide which features to emphasize or suppress. Changing this fusion strategy after training for inference/reasoning will break the model. Moreover, all the models we trained make use of complementary information of the depth branch. So, skipping the depth input or presenting another depth image will break the model as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants