Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Results about semisupervised_TU PROTEINS experiments #14

Closed
OrdinaryCrazy opened this issue Feb 23, 2021 · 4 comments
Closed

Results about semisupervised_TU PROTEINS experiments #14

OrdinaryCrazy opened this issue Feb 23, 2021 · 4 comments

Comments

@OrdinaryCrazy
Copy link

I follow the instructions in readme, but I can not achieve 0.7417 accuracy in paper on PROTEINS dataset, I only get about 0.73

@yyou1996
Copy link
Collaborator

Hi @OrdinaryCrazy,

Thanks for your interest in our work. (1) Did you perform hyper-parameter tuning as suggested? If not, this might help (see the instruction following from README). (2) Did you try other datasets and compare the performance?

lr in pre-training should be tuned from {0.01, 0.001, 0.0001} and model_epoch in finetuning (this means the epoch checkpoint loaded from pre-trained model) from {20, 40, 60, 80, 100}.

@OrdinaryCrazy
Copy link
Author

Thank you, tuning pretraining lr to 0.01 makes the PROTEINS's mean accuracy result come close to 0.74, although there are a lot variance among pretrained models.

@ha-lins
Copy link

ha-lins commented May 19, 2021

Hi @OrdinaryCrazy @yyou1996 ,

Could you pls tell me how to run the semi-supervised setting with label rate = 10%, i.e., how to tune the label rate? Thanks!

@yyou1996
Copy link
Collaborator

Hi @ha-lins,

Please see the instruction here https://github.com/Shen-Lab/GraphCL/tree/master/semisupervised_TU#graphcl-with-sampled-augmentations. Just set the flag --semi_split as 10 when finetuning.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants