Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question about cosineCE #5

Closed
Z-ZHHH opened this issue Jan 13, 2022 · 3 comments
Closed

question about cosineCE #5

Z-ZHHH opened this issue Jan 13, 2022 · 3 comments
Labels
reproducibility Issue related to reproducibility

Comments

@Z-ZHHH
Copy link

Z-ZHHH commented Jan 13, 2022

I have run the CIFAR-100-Imb100 experiment_no=0.2, i got this results which is different from that in the paper.

CIFAR100 Imb100 val-toatal val-many val-med val-few
Seed1 CosineCE 0.403 0.676 0.379 0.112
Seed2 CosineCE 0.403 0.670 0.396 0.101
Seed3 CosineCE 0.405 0.680 0.380 0.113
Seed10 CosineCE 0.4051 0.6737 0.3923 0.1067
Seed20 CosineCE 0.3968 0.6754 0.3909 0.7867
Seed30 CosineCE 0.4045 0.6811 0.378 0.1127

rahulvigneswaran added a commit that referenced this issue Jan 17, 2022
@Angelina1996
Copy link

Hi Z-ZHHH, could you please guide how did you execute the code, for me it is generating an error with the following error.
with open('default_config.yaml') as f:
FileNotFoundError: [Errno 2] No such file or directory: 'default_config.yaml'.
In fact, default_config.yaml file is present in the current directory.
Cheers,
Angelina

@rahulvigneswaran
Copy link
Owner

@Z-ZHHH Sorry about the super delayed reply. We faced similar issues when replicating other paper results too. The cifar100-lt is sketchy and the final results seem very sensitive to randomness. To combat this, we recommend you to use the saved data_target tuples at https://github.com/rahulvigneswaran/TailCalibX/tree/master/libs/data/CIFAR100_LT

@rahulvigneswaran
Copy link
Owner

@Angelina1996 Are you still facing this issue?

@rahulvigneswaran rahulvigneswaran added bug Something isn't working reproducibility Issue related to reproducibility and removed bug Something isn't working labels Nov 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
reproducibility Issue related to reproducibility
Projects
None yet
Development

No branches or pull requests

3 participants