Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The mAP of ImageNet is different from that on paper #31

Closed
chenshen03 opened this issue Aug 22, 2019 · 7 comments
Closed

The mAP of ImageNet is different from that on paper #31

chenshen03 opened this issue Aug 22, 2019 · 7 comments

Comments

@chenshen03
Copy link

Can you share the parameters setting on ImageNet?

I follow the settings described on paper, but obtain a bad result:

image

@caozhangjiex
Copy link

The pytorch version of the code perform badly on ImageNet. We do not find the reason yet. Please use the caffe version if you want to run on ImageNet.

@caozhangjiex
Copy link

check caffe directory

@chenshen03
Copy link
Author

chenshen03 commented Aug 22, 2019

I just directly use your pretrained caffe's model to evaluate the mAP on ImageNet, and some results are as follows;

  • 16bit: 0.4643
  • 32bit: 0.5934

However, the results on your paper are as follows:
image

What makes this difference?

@caozhangjie
Copy link
Collaborator

Maybe it is because the caffe framework changes or other reason such as initialization. I'm sure it can reproduce the results at publishing.

@chenshen03
Copy link
Author

I retrained the model and obtain an ideal result. Thank you~

@TreezzZ
Copy link

TreezzZ commented Jan 5, 2020

I retrained the model and obtain an ideal result. Thank you~

请问是如何训练的?我用PyTorch在DSH、DHN和HashNet三个算法上复现,均是在Imagenet数据集上表现奇差。

@chenshen03
Copy link
Author

I retrained the model and obtain an ideal result. Thank you~

请问是如何训练的?我用PyTorch在DSH、DHN和HashNet三个算法上复现,均是在Imagenet数据集上表现奇差。

我之前跑过HashNet的作者提供的PyTorch版本,也自己复现过,但是在ImageNet上表现都不好,但我感觉你的表现好像比我的还更差。不过如果直接跑caffe的版本的话,结果和论文差不多。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants