Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is the normal train loss #10

Open
zjuDebug opened this issue Sep 19, 2017 · 1 comment
Open

What is the normal train loss #10

zjuDebug opened this issue Sep 19, 2017 · 1 comment

Comments

@zjuDebug
Copy link

hi, @taokong ,great work!
I want to re-implement your experiment, and I have three small issues?

  1. What is the normal train loss when the model converge well?
    mark: When I train ,the loss always 4.0+ before 8w iters, and I test at 8w Iters only got mAp=0.54(train data is 2007trainval + 2013trainval)
  2. I also notice that I can do test in a pascal Titanx , but got CUDNN_STATUS_SUCCESS (8 vs. 0) CUDNN_STATUS_EXECUTION_FAILED error in a TitanX.
  3. Training needs much time, can you give me some advices?
    Thanks in advance!
@HiKapok
Copy link

HiKapok commented Dec 16, 2017

hello, i also want to re-implement this work recently, but the loss always went towards nan after several steps. after carefully check i found the objectness proir(after softmax) will all be 0. did you ever got into problems like this? BTW, what's your learning rate setting?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants