Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some questions about the metrics. #4

Closed
ddghjikle opened this issue Aug 9, 2021 · 5 comments
Closed

Some questions about the metrics. #4

ddghjikle opened this issue Aug 9, 2021 · 5 comments

Comments

@ddghjikle
Copy link

Hi, thanks very much for the codes. Recently, I have re-generated the released codes under the default setting. However, I cannot find the metrics presented in your paper. It seems that the released codes can only compute the metrics of the global network or each local network. Therefore, could you please tell us which metric is used in your paper?

@QinbinLi
Copy link
Owner

QinbinLi commented Aug 9, 2021

Hi @ddghjikle ,

We use the top 1 test accuracy of the global network on the global test dataset as the metric in our paper (e.g., line 167 of main.py).

@ddghjikle
Copy link
Author

Thank you very much.

@QinbinLi
Copy link
Owner

QinbinLi commented Aug 9, 2021

Hi @ddghjikle ,

Sorry that I just referred to the wrong code. It should be line 533 of main.py. Line 167 is the test accuracy of the local model.

@ddghjikle
Copy link
Author

ddghjikle commented Aug 9, 2021 via email

@QinbinLi
Copy link
Owner

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants