Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cann't get the accuracy in the paper #5

Closed
Fridaycoder opened this issue Oct 17, 2019 · 5 comments
Closed

cann't get the accuracy in the paper #5

Fridaycoder opened this issue Oct 17, 2019 · 5 comments

Comments

@Fridaycoder
Copy link

Hi, @fandulu I run the code you provide on SHREC dataset,but I cann't get the accuracy described in the paper,particularly,I got 90.1% on 14 gestures, and 75% on 28 gestures using DD-Net (filters=16),which is lower than the accuracy in the paper ,what's the problem?

@fandulu
Copy link
Owner

fandulu commented Oct 21, 2019

Hello, it seems the accuracies looks like
image
on 28 and
image
on 14 after I did a little fine-tuning.

@Fridaycoder
Copy link
Author

@fandulu Thanks for replying. I got the approximate accuracy as the paper after fine-tuning, so the method benefit mostly from transfer learning?

@fandulu
Copy link
Owner

fandulu commented Oct 21, 2019

It is not a transfer learning since only the SHREC dataset is used. It is my fault to put a high learning rate and fewer epochs on the code. With a proper cyclic learning rate setting, you may even obtain a better performance than my paper claimed. Sorry for this problem.

@Fridaycoder
Copy link
Author

@fandulu OK, I understand. Thank you for replying.

@fandulu fandulu closed this as completed Dec 7, 2019
@chillcloud-dev
Copy link

@Fridaycoder
@fandulu
could you please share your adjustments where you could reach the accuracy of the paper ? The confusion matrix where values are higher than 95% can not be reached with the values provided with the code.
Adjusting the epochs (400) and learning rate (lr = 1e-2) didn't help much

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants