-
Notifications
You must be signed in to change notification settings - Fork 55
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Reproduce result of usa-airports #3
Comments
Hi @larry2020626 , Glad to help you reproduce the result. Please kindly provide the following information:
In addition, did you try other datasets/tasks? Please feel free to provide more datapoints/screenshots. Thanks! |
Thanks very much for your reply! I adopt E2E model, running on CUDA 10.0 here is what I do:
2.to pretrain:
3.For downstream tasks:
Thanks! |
Hi @larry2020626 , Thanks for your reply. The main reason is that your experiments correspond to the GCC (E2E, freeze) model, while "68.3" is the result of GCC (E2E, full). For the difference, please see the Freezing vs. full fine-tuning paragraph at the beginning of page 6. To obtain the "full" (finetuning) result, please run Besides, you can use batch size 1024 in paper instead of 256 but that will take even longer for pretraining. In that case, the result is |
Thanks!@qibinc , really appreciate your help. |
Hi Larry, I'm glad it worked for you. Feel free to raise more issues if you encounter other problems. Closing this. |
Hi,Thank you for releasing your code. I am currently trying to reproduce the result of node classification experiment on US-Airport dataset, while I can't get as high as 68.3%. Is there any techniques I can use to get higher accuracy? Thanks!
The text was updated successfully, but these errors were encountered: