Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't reproduce the experimental results #5

Closed
Dami111 opened this issue Sep 20, 2020 · 2 comments
Closed

Can't reproduce the experimental results #5

Dami111 opened this issue Sep 20, 2020 · 2 comments

Comments

@Dami111
Copy link

Dami111 commented Sep 20, 2020

Thanks for your code. I use the code you provide and download the thumos14's feature, but I get the results following, like mAP is 1% less than the results in your paper:

Experiment map@0.3 map@0.4 map@0.5 map@0.6 map@0.7 average map
Paper-I3D 46.9 39.2 30.7 20.8 12.5 30.0
Reproduce-I3D 46.0 38.4 29.7 20.5 12.1 29.3

Could there be any problems?

@xumh-9
Copy link

xumh-9 commented Oct 11, 2020

Thanks for your code. I use the code you provide and download the thumos14's feature, but I get the results following, like mAP is 1% less than the results in your paper:

Experiment map@0.3 map@0.4 map@0.5 map@0.6 map@0.7 average map
Paper-I3D 46.9 39.2 30.7 20.8 12.5 30.0
Reproduce-I3D 46.0 38.4 29.7 20.5 12.1 29.3
Could there be any problems?

Do you train the model for 10000 iters?I can't get the result of paper and my result is more terrible than you.

@Pilhyeon
Copy link
Owner

I have updated the code and the pre-trained model, and now you will get better performances.
Thanks for your interest!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants