Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What are parameters in solver.prototxt? #3

Closed
mjohn123 opened this issue Mar 17, 2017 · 3 comments
Closed

What are parameters in solver.prototxt? #3

mjohn123 opened this issue Mar 17, 2017 · 3 comments

Comments

@mjohn123
Copy link

Thanks for sharing the work. Do you use same parameter settings in the https://github.com/liuzhuang13/DenseNetCaffe for optimization? I ask it because the learning rate of the reference one is so high (about 0.1). In additions, do you get the performance using your prototxt it for CIFAR dataset? Thanks

@shicai
Copy link
Owner

shicai commented Mar 23, 2017

The learning rate is ok for me.
It is quite easy to reproduce the results from the paper.

@mjohn123
Copy link
Author

Thanks. I think the learning rate depends on dataset and solver optimization method.
In all prototxts, the dropout did not use. Did you try to add the dropout as 0.2 in BC model and get the result? How much it improve?

@shicai
Copy link
Owner

shicai commented Mar 23, 2017

I have trained DenseNet on CIFAR10 and ImageNet, and lr=0.1 works for me.
I did not try to use dropout for DenseNet.
You'd better ask the author. @liuzhuang13

@shicai shicai closed this as completed Mar 23, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants