Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not exactly similar as the description in your paper #7

Open
marshallixp opened this issue Jul 3, 2017 · 1 comment
Open

Not exactly similar as the description in your paper #7

marshallixp opened this issue Jul 3, 2017 · 1 comment

Comments

@marshallixp
Copy link

I have not found the 1/4 branch (low resolution) in your prototxt, but more important thing is that you used lots of 1x1 convolution instead of 3x3 to reduce the size with a bottleneck shape. Could you share more about your cascade guidance? Thanks a lot.

@howard-mahe
Copy link

howard-mahe commented Jul 6, 2017

Regarding the 1/4 low resolution image, you are right, it is not used in the provided prototxt. Instead there is a kind of hack of the 1/4 branch using the layer:

layer {
  name: "conv3_1_sub4"
  type: "Interp"
  bottom: "conv3_1"
  top: "conv3_1_sub4"
  interp_param {
    shrink_factor: 2
  }
}

icnet

Regarding the succession of 1x1 conv (reduce), 3x3x conv, 1x1 conv (increase), this is a classical ResNet module used for ResNet50+, as described by Kaiming He.

Finally, cascade guidance is just about deeply supervising the training process (see PSPNet article). Auxiliary loss at sub4 (res. 1/4) and sub2 (res. 1/2) permits to inject more gradients for low-level layers and thus improves the training.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants