Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

two question . #8

Closed
DavidKong96 opened this issue Jun 29, 2021 · 3 comments
Closed

two question . #8

DavidKong96 opened this issue Jun 29, 2021 · 3 comments

Comments

@DavidKong96
Copy link

thanks for your sharing.nice work.
but could you pls show your ablation experiment result? especially the cbam.
and could u pls tell me why you didn't use " c = qk.pow(2).sum(1).unsqueeze(1) “ in the code.
wait for your reply .

@hkchengrex
Copy link
Owner

  1. Haven't tried that before.
  2. We will update the paper later on this. In short, the following softmax will cancel out this term.

@DavidKong96
Copy link
Author

  1. Haven't tried that before.
  2. We will update the paper later on this. In short, the following softmax will cancel out this term.

thank you .

@hkchengrex
Copy link
Owner

Update: We tried without CBAM block and I would say that we don't really need it. We get -0.6 J&F in DAVIS and +0.1 global score in YouTubeVOS -- so nothing really significant. You are welcome to drop this block (see no_cbam branch).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants