Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wrong Val acc? #2

Closed
hawklucky opened this issue Sep 30, 2016 · 3 comments
Closed

Wrong Val acc? #2

hawklucky opened this issue Sep 30, 2016 · 3 comments

Comments

@hawklucky
Copy link

Thanks for your excellent work! When I trained the model at around 10000 iters, the batch acc of training set is ~96%, but the batch acc of val set is ~ 29%, what's wrong? the training list and val list is the list i used for training in CNN which works well.

@hx173149
Copy link
Owner

Thanks for telling me this problem, I actually didn't make a validation in UCF101 dataset.
I just use this code to a binary classification problem, it works......
I will check this problem after 10.09, I am on my vocation now......
cheers~

@hx173149
Copy link
Owner

@hawklucky Hi I have also found this bug in my experienment, when I get this train accuracy(93.75%):
image
I can only get a low val accuracy(32.8%):
image

I think there must be some over fitting problem, maybe some bad parameter like L2 regular, ExponentialMovingAverage......
I will check where is the problem next days, if you find some bugs you can tell me too, thanks~

@hx173149
Copy link
Owner

hx173149 commented Nov 6, 2016

@hawklucky recently, I have solved this problem. And if you want to get a high acc as same as the caffe version you must fine-tuning from the author's sports1m model. So I have transferred the caffe model to TF model, and fine-tuning this model from UCF101 dataset, and get a 72% acc.
you can download my pretrained model from here:
https://www.dropbox.com/sh/8wcjrcadx4r31ux/AAAkz3dQ706pPO8ZavrztRCca?dl=0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants