Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

multi-gpus, reproduce loss #15

Open
MissyDu opened this issue Nov 5, 2019 · 1 comment
Open

multi-gpus, reproduce loss #15

MissyDu opened this issue Nov 5, 2019 · 1 comment

Comments

@MissyDu
Copy link

MissyDu commented Nov 5, 2019

I have implmented a multi-gpus version.
1>But I am not sure how to evaluate reproduce to be successful for the search process.What's the correct evaluation accuracy in the training process?
2>And I find the loss is large in the search training process, like this issue mentioned. Is that a normal value for loss? I found it's related with "runtime_lambda_val", and 0.02 is the correct setting for it?
3>And "base_learning_rate" is 0.016, it seem to be small for training from scratch, though it's enlarged by " FLAGS.base_learning_rate * (FLAGS.train_batch_size / 256.0)", and is it the correct setting?

@SUNziwei0527
Copy link

can you give me your code ? please!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants