Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Results not reproducible #1

Open
bhat-prashant opened this issue Nov 18, 2022 · 1 comment
Open

Results not reproducible #1

bhat-prashant opened this issue Nov 18, 2022 · 1 comment

Comments

@bhat-prashant
Copy link

Dear authors,

I am trying to reproduce your results on Seq-CIFAR100 with multiple runs with different seeds.
I see some of the issues in your code. The CL model has three heads namely: one for SSL, one for classification and one for rotation prediction. However, the paper does not talk about the rotation prediction. Could you give more intuition how rotation prediction actually helps and how much is the boost coming from such an auxiliary task? Please let me know.

Without the rotation prediction, results drop by quite a lot and are on par with DER++. Please let me know how this can be fixed.

@lijincm
Copy link
Owner

lijincm commented Nov 19, 2022

Please refer to our reference [Ji et al., 2021a] Zhong Ji, Jin Li, QiangWang, et al. Complementary calibration: Boosting general continual learning with collaborative distillation and self-supervision. arXiv preprint arXiv: 2109.02426, 2021. https://arxiv.org/abs/2109.02426
The latest version will be released after acceptance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants