Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于参数问题 #50

Closed
zlj199502 opened this issue Aug 13, 2018 · 1 comment

Comments

@zlj199502
Copy link

@zlj199502 zlj199502 commented Aug 13, 2018

我想问问一个关于学习率的参数,lr_decay_factor是怎么得到呢?

@bilylee

This comment has been minimized.

Copy link
Owner

@bilylee bilylee commented Aug 16, 2018

你好,

这是根据作者的 learning rate schedule 得到的。作者在 50 个 epoch 内,learning rate 从 1e-2 下降到 1e-5,设 x = lr_decay_factor, 则有 1e-2 * x ^ (50 -1) = 1e-5, 求解得到 x = 0.8685113737513527.

@bilylee bilylee closed this Dec 11, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.