-
Notifications
You must be signed in to change notification settings - Fork 13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
reproduce cifar10 #3
Comments
Hi @YunYunan and @LTH14 , please guide or share the link to supplementary material. It would be great if you could share the code for reproducing the results on Cifar and INat datasets on my email: robertangelina92@gmail.com |
Hi, thanks for your interest! Please refer to this supplementary material
-- I submitted with the CVPR camera ready but I don't know why it does not
appear online. For Cifar you need to replace the moco framework with
supcon. For inat you can simply change the imagenet-LT to inat. Hope this
helps.
…On Tue, Jul 25, 2023 at 11:20 PM Angelina1996 ***@***.***> wrote:
Hi @YunYunan and @LTH14 <https://github.com/LTH14> , please guide or
share the link to supplementary material. It would be great if you could
share the code for reproducing the results on Cifar and INat datasets on my
email: ***@***.***
Cheers
—
Reply to this email directly, view it on GitHub
<#3 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AFJD3KAZ54ZXHVZXIRPZRH3XSCEH3ANCNFSM5Z4OTBTA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Hi, thanks for your interest! Please refer to this supplementary material
-- I submitted with the CVPR camera ready but I don't know why it does not
appear online. For Cifar you need to replace the moco framework with supcon
https://github.com/HobbitLong/SupContrast. For inat you can simply change
the imagenet-LT to inat. Hope this helps.
…On Wed, Jul 26, 2023 at 10:22 AM Tianhong Li ***@***.***> wrote:
Hi, thanks for your interest! Please refer to this supplementary material
-- I submitted with the CVPR camera ready but I don't know why it does not
appear online. For Cifar you need to replace the moco framework with
supcon. For inat you can simply change the imagenet-LT to inat. Hope this
helps.
On Tue, Jul 25, 2023 at 11:20 PM Angelina1996 ***@***.***>
wrote:
> Hi @YunYunan and @LTH14 <https://github.com/LTH14> , please guide or
> share the link to supplementary material. It would be great if you could
> share the code for reproducing the results on Cifar and INat datasets on my
> email: ***@***.***
> Cheers
>
> —
> Reply to this email directly, view it on GitHub
> <#3 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AFJD3KAZ54ZXHVZXIRPZRH3XSCEH3ANCNFSM5Z4OTBTA>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
|
Thanks so much, Tianhong, for the reply. Could you exactly guide me about the line where I have to replace moco with supcon framework? I already know about supcon, however, supcon uses a different loss function than yours (TSC). I am a bit confused about this. Any help regarding this will be highly appreciated. |
Our implementation in Cifar is not based on the moco and imagenet
framework, so it could be hard to directly adapt the released code to
Cifar. Our implementation in Cifar is based on this repo:
https://github.com/HobbitLong/SupContrast. You need to replace the supcon
losses file with the targeted supcon loss
https://github.com/HobbitLong/SupContrast/blob/master/losses.py. I don't
have a clean version of the Cifar repo, but I can share with you the tsc
loss implementation. Hope it can make your reproduction easier.
Best
Tianhong
…On Thu, Jul 27, 2023 at 4:23 AM Angelina1996 ***@***.***> wrote:
Thanks so much, Tianhong, for the reply. Could you exactly guide me about
the line where I have to replace moco with supcon framework? I already know
about supcon, however, supcon uses a different loss function than yours
(TSC). I am a bit confused about this. Any help regarding this will be
highly appreciated.
Cheers
—
Reply to this email directly, view it on GitHub
<#3 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AFJD3KFKXLVZWT3U7BWITZ3XSIQPHANCNFSM5Z4OTBTA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Thanks so much, Tianhong, for your kind help. It makes sense to me now. Could you share the TSC loss, I want to reproduce the results on CIFAR. |
Please see the attachment of the previous email
…On Fri, Jul 28, 2023 at 3:11 AM Angelina1996 ***@***.***> wrote:
Thanks so much, Tianhong, for your kind help. It makes sense to me now.
Could you share the TSC loss, I want to reproduce the results on CIFAR.
—
Reply to this email directly, view it on GitHub
<#3 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AFJD3KEB5SQN4PVLHNFFPIDXSNQ2TANCNFSM5Z4OTBTA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Thanks, Tianhong, for your help. It is still unclear as the attachments or the links you have provided are for Supcon loss but not for targetted soupcon loss (TSC), moreover I am wondering how the targetted centres are calculated in Cifar dataset. |
On CIFAR10, since the number of classes is smaller than the output
dimension for contrastive loss, the targets can be directly computed
without using gradient descent (see section 3.1 of the paper). Here is the
main function we use to use target, hope it helps:
…On Sun, Jul 30, 2023 at 10:04 PM Angelina1996 ***@***.***> wrote:
Tianhong
Thanks, Tianhong, for your help. It is still unclear as the attachments or
the links you have provided are for Supcon loss but not for targetted
soupcon loss (TSC), moreover I am wondering how the targetted centres are
calculated in Cifar dataset.
—
Reply to this email directly, view it on GitHub
<#3 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AFJD3KCMBNHHMWGD5OY7JTDXS4HB3ANCNFSM5Z4OTBTA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
I have applied the setting for the Cifar dataset as you suggested. However, the performance accuracies are far less than the results claimed in the paper. Would you mind sharing the code for reproducing the Cifar Dataset? |
Hi Yun, I am wondering if you managed to reproduce the Cifar dataset results. I have tried but the results are far less than the claimed results in the paper. |
Hi, it seems there are some discrepancies between email and the Github reply -- I thought the attachment in the email apply will also appear here. I just uploaded the uncleaned main python file and loss file for TSC in the repo here. I'm sorry that I haven't really got time to clean it up. Hope it helps. |
|
Thanks, Tianhong, |
|
Please check the cifar_dirty sub directory. It should contain every necessary file. |
Dear Tianhong, Could you please, provide the missing files |
Just uploaded. This file would be also easy to generate, as there is a analytical optimal solution for target positions when the number of classes <= output dimension. |
Hi, did you finally reproduce the cifar10 code? If so, could you please provide me with a copy of your code? |
Hi, thank you for the code.
Could you please provide your cifar10 code for reproducing? I have followed your supplemental material and run the code for 1000 epochs for pretraining (Moco based). But the result is still lower than the number in the paper. I'm wondering if using SimCLR as you claimed in the paper will reach higher accuracy? Have you compared Moco and Simclr structures on CIFAR? It would be great if you could share that part of the code.
Thank you very much for your time.
The text was updated successfully, but these errors were encountered: