Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to reproduce your results #4

Closed
yangjiangeyjg opened this issue Sep 15, 2021 · 4 comments
Closed

How to reproduce your results #4

yangjiangeyjg opened this issue Sep 15, 2021 · 4 comments

Comments

@yangjiangeyjg
Copy link

The first three lines are the result of my own training model:
100 100 34.18 28.70 20.20 13.54 8.17 3.40 1.45
35 70 31.39 26.72 19.16 12.83 7.28 3.66 1.70
35 75 31.38 26.49 19.76 13.25 7.76 3.84 1.81

yours:
1000 1000 68.19 62.43 53.21 44.78 34.10 23.13 13.44

@LeonHLJ
Copy link
Owner

LeonHLJ commented Sep 15, 2021

The first three lines are the result of my own training model:
100 100 34.18 28.70 20.20 13.54 8.17 3.40 1.45 35 70 31.39 26.72 19.16 12.83 7.28 3.66 1.70 35 75 31.38 26.49 19.76 13.25 7.76 3.84 1.81
yours:
1000 1000 68.19 62.43 53.21 44.78 34.10 23.13 13.44

Our training settings are all presented in train_options.py, and there is no training trick in our method, you just need to train our model from scratch. Did you change some hyper-parameters?

@yangjiangeyjg
Copy link
Author

The first three lines are the result of my own training model:
100 100 34.18 28.70 20.20 13.54 8.17 3.40 1.45 35 70 31.39 26.72 19.16 12.83 7.28 3.66 1.70 35 75 31.38 26.49 19.76 13.25 7.76 3.84 1.81
yours:
1000 1000 68.19 62.43 53.21 44.78 34.10 23.13 13.44

Our training settings are all presented in train_options.py, and there is no training trick in our method, you just need to train our model from scratch. Did you change some hyper-parameters?

I didn't change any hyper-parameters. Is the dataset Thumos14reduced-I3D-JOINTFeatures?

@LeonHLJ
Copy link
Owner

LeonHLJ commented Sep 15, 2021

The first three lines are the result of my own training model:
100 100 34.18 28.70 20.20 13.54 8.17 3.40 1.45 35 70 31.39 26.72 19.16 12.83 7.28 3.66 1.70 35 75 31.38 26.49 19.76 13.25 7.76 3.84 1.81
yours:
1000 1000 68.19 62.43 53.21 44.78 34.10 23.13 13.44

Our training settings are all presented in train_options.py, and there is no training trick in our method, you just need to train our model from scratch. Did you change some hyper-parameters?

I didn't change any hyper-parameters. Is the dataset Thumos14reduced-I3D-JOINTFeatures?

Yes, I noticed the last line's result is the same as ours, so I think your features and annotations are right. Maybe you can change the random seed and train again. On our server, for the flow stream, the mAP at IoU 0.1 exceeds 50% after 10 epochs. Hope this information could be helpful to you.

@yangjiangeyjg
Copy link
Author

The first three lines are the result of my own training model:
100 100 34.18 28.70 20.20 13.54 8.17 3.40 1.45 35 70 31.39 26.72 19.16 12.83 7.28 3.66 1.70 35 75 31.38 26.49 19.76 13.25 7.76 3.84 1.81
yours:
1000 1000 68.19 62.43 53.21 44.78 34.10 23.13 13.44

Our training settings are all presented in train_options.py, and there is no training trick in our method, you just need to train our model from scratch. Did you change some hyper-parameters?

I didn't change any hyper-parameters. Is the dataset Thumos14reduced-I3D-JOINTFeatures?

Yes, I noticed the last line's result is the same as ours, so I think your features and annotations are right. Maybe you can change the random seed and train again. On our server, for the flow stream, the mAP at IoU 0.1 exceeds 50% after 10 epochs. Hope this information could be helpful to you.

Thanks for your advice. I didn't realize that random seed is so important for small model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants