Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accuracy of VN_DGCNN on the ModelNet40 #6

Closed
AkonLau opened this issue Jul 12, 2021 · 2 comments
Closed

Accuracy of VN_DGCNN on the ModelNet40 #6

AkonLau opened this issue Jul 12, 2021 · 2 comments

Comments

@AkonLau
Copy link

AkonLau commented Jul 12, 2021

Hi,
Thanks for your work and codes. However, when I reproduce your code with the VN_DGCNN model and default parameters, I just got 80.2% in the I/I case and 78.8% in the z/z case. The results are much less than the accuracy reported in the paper.
Are there any details I missed? Could you help us analyze the problem or give more details for discussion?
Thanks a lot!

@FlyingGiraffe
Copy link
Owner

Hi, thanks for the comment!

I was using the DGCNN code framework when generating the results in the paper, but later when publishing the code I merged the models into the PointNet framework for convenience. I quickly skimmed through the code and one reason might be: in DGCNN (and thus same for VN_DGCNN in the paper), the optimizer is SGD withlr=0.1 (see here), but the default optimizer here is Adam with lr=0.001.

I'll double-check with other settings. Thanks again for noticing this!

Best,
Congyue

@AkonLau AkonLau closed this as completed Jul 16, 2021
@GostInShell
Copy link

Thanks for the wonderful code! With the above modification, I achieve the results 73.4% on SO3/SO3. Moreover, I find the training process rather unstable with large fluctuation, comparing to the normal DGCNN and PointNet. Is this usual? If possible, could you please share the training log?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants