Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MetaFed hyperparameters? #2

Closed
Buhua-Liu opened this issue Aug 5, 2022 · 1 comment
Closed

MetaFed hyperparameters? #2

Buhua-Liu opened this issue Aug 5, 2022 · 1 comment

Comments

@Buhua-Liu
Copy link

Buhua-Liu commented Aug 5, 2022

Hi,

Thanks for sharing the code. The hyperparameters for fedmeta seems missing in the run.sh, so I just run python main.py --alg metafed --dataset medmnist --iters 300 --wk_iters 1 --non_iid_alpha 0.1 --model_momentum 0.3, and I got an average accuracy 54.53. But the accuracy in the benchmark is 83.87, and which is 90.81 in Table 3 of your paper.

image

Thanks for your attention!

@lw0517
Copy link
Collaborator

lw0517 commented Aug 6, 2022

Thank you for your question. We have revised run.sh. Please refer to the latest version. Please utilize the same splits of data and the same environment for re-implementations. This open-source library did not exist when we performed experiments on MetaFed. Therefore, there might be some differences in results due to different environments, data splits, and some other factors.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants