Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train loss and Validation loss are very high!! #34

Open
Jasonsun1993 opened this issue Apr 10, 2018 · 7 comments
Open

Train loss and Validation loss are very high!! #34

Jasonsun1993 opened this issue Apr 10, 2018 · 7 comments

Comments

@Jasonsun1993
Copy link

I trained the whole LISA dataset, but when the train code was running. I found that the Train loss and Validation loss were up to 2600! Does anybody know what the problem is ??

@xinxueying
Copy link

I have the same problem. The trainning loss at beginning is over 800, and so as the validation loss. And after about 20000 round training, it drop to about 200.

@xinxueying
Copy link

xinxueying commented Apr 10, 2018

I did some edit to some api, so it can train under tensorflow1.4.1 . Besides this, nothing changed.

@Jasonsun1993
Copy link
Author

@xinxueying After training, did you test the images in samples_images folder? Did it have good results?

@xinxueying
Copy link

@Jasonsun1993
Problem solved, I changed the learning rate of training to 0.5 (original code use the default 0.01,which is very small considering training from scratch):
OPT = tf.train.AdadeltaOptimizer()
change to
OPT = tf.train.AdadeltaOptimizer(learning_rate=0.5)

@Jasonsun1993
Copy link
Author

Jasonsun1993 commented Apr 18, 2018

@xinxueying Really? Did you train the whole data set?? How about the results?? Besides, can I have your Wechat number? I want to discuss about this code further.

@zengxyu
Copy link

zengxyu commented May 11, 2018

Have you got the dataset? I can't open the link LISA Traffic Sign Dataset(http://cvrr.ucsd.edu/LISA/lisa-traffic-sign-dataset.html). If you got the dataset, could you please send it to me?

@pageedward
Copy link

@xinxueying what is the val loss when u ended training?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants