Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

稀疏化训练问题 #7

Open
CuberFan opened this issue Aug 9, 2019 · 0 comments
Open

稀疏化训练问题 #7

CuberFan opened this issue Aug 9, 2019 · 0 comments

Comments

@CuberFan
Copy link

CuberFan commented Aug 9, 2019

为什么我稀疏化训练的时候,BN层的gamma系数随着训练的进行,从1到-1震荡,然后又从-1到1震荡,而且所有的gamma系数都同步的震荡变化,根本不会出现离散稀疏的情况。不知道是否有人出现过这种情况?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant