Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproduce the results on ModelNet40 dataset #8

Closed
YBZh opened this issue Oct 5, 2022 · 1 comment
Closed

Reproduce the results on ModelNet40 dataset #8

YBZh opened this issue Oct 5, 2022 · 1 comment

Comments

@YBZh
Copy link

YBZh commented Oct 5, 2022

Hi, thanks for your contribution. I am trying to reproduce your fine-tuning results on ModelNet40. I follow your suggestion to prepare the ModelNet40 dataset, download your pre-trained models, and use your suggested command for fine-tuning. I conduct the experiments twice. As for the results, one is 93.1 and another is 93.0, which is different from your reported 94.2.

I carefully compare your released log with 94.2 ACC and my log. I find some differences.

  1. In your log, the model is fine-tuned for 250 epochs, while in the released code, the epoch is set as 200.
  2. In your log, batch size is set as 32, while in the released code, the epoch is set as 24.
  3. In your log, num_point is set as 2048 and k is set as 40, while in the released code, the number point is set as 1024 and k is set as 20.

I am wondering which difference plays such an important role in the ModelNet40 evaluation. Could you give me some suggestions? Thanks for your time.

@SimingYan
Copy link
Owner

Hi @YBZh ,

Thanks for pointing this out! I will update the default setting soon.
Your observation is very good! According to my experience, 3rd point is the most important difference. 1 and 2 should not influence too much. Please set num_point to 2048 and k=40 and try again. If you still cannot reproduce the close result, please let me know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants