Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

测试中训练集和测试集选择的问题 #1

Closed
SuperLuckyQiu opened this issue Oct 19, 2023 · 1 comment
Closed

测试中训练集和测试集选择的问题 #1

SuperLuckyQiu opened this issue Oct 19, 2023 · 1 comment

Comments

@SuperLuckyQiu
Copy link

For the test at the end of training, why would you use the one loaded from the training set instead of the train_test_loader, instead of the test_loader loaded from the test set, and the accuracy of the test from the training set is not accurate, right?

@shijxcs
Copy link
Owner

shijxcs commented Oct 19, 2023

Thank you for your concern. The test() function defaults to using the test_loader since the parameter mode is default set to "test".

The train_test_loader is only used when adding an option test_train True. For instance, if you run python main.py -d imagenet_lt -m clip_vit_b16_peft test_train True, you will obtain the training accuracy on ImageNet-LT. This can be used for comparing training/test accuracy, as presented in Table 8 in our paper. Aside from this, all results are calculated from the test set.

@shijxcs shijxcs closed this as completed Jan 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants