Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is IBN = MVN_layer in caffe? #4

Closed
math-yyj opened this issue Jul 31, 2018 · 3 comments
Closed

Is IBN = MVN_layer in caffe? #4

math-yyj opened this issue Jul 31, 2018 · 3 comments

Comments

@math-yyj
Copy link

Is IBN layer just "MVN_layer in caffe"?

Thank you very much!

@XingangPan
Copy link
Owner

Instance normalization (IN) layer is "MVN_layer in caffe" plus a scale and shift operation.
IBN layer is half IN half BN.

@math-yyj
Copy link
Author

I see, so it should be MVN_layer + Scale_layer

many thanks again ~

@vd001
Copy link

vd001 commented Aug 30, 2018

I tried to replace the Instance normalization (IN) layer with "MVN_layer + Scale_layer" in caffe, but found the network hard to converge. When i remove every scale layer following MVN(i.e. use MVN layer only), the network converges.
My question is:

  1. If i replace IN with MVN layers only in caffe, does it hurt the generalization or transfer ability of IBN-Net, or is the scale layer really important?
  2. what makes the net hard to converge when IN layer is followed by scale layers?

thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants