Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to reproduce the results #3

Open
kaansancak opened this issue Jul 12, 2023 · 3 comments
Open

Unable to reproduce the results #3

kaansancak opened this issue Jul 12, 2023 · 3 comments

Comments

@kaansancak
Copy link
Contributor

Hi, I am unable to reproduce the results reported in the paper. I downloaded the datasets from GRAND+ and applied the preprocessing mentioned in the paper. See this. These are the results I get: 75.32 on Amazon2M, 0.4652 on Aminer, and 0.8965 on reddit. I followed the split instructions as well. Can you provide your splits for this data? Also the code provided here is not enough to reproduce the results. Your code assumes that the data is preprocessed and saved with its train/val/test masks. Although, there is no such split provided in GRAND+. Can you provide some clarifications?

@guangnianchenai
Copy link
Collaborator

Hi, please set renormalize=True when you download data from GRAND+.

@kaansancak
Copy link
Contributor Author

Thanks! This resolves the problem. I opened a PR: #4

@zzyzeyuan
Copy link

Thanks! This resolves the problem. I opened a PR: #4

Hi, I just downloaded this data from Google Drive and got nearly same results (75.32 on Amazon2M, 0.4652 on Aminer, and 0.8965 on reddit).

But I can't find where to set renormalize=True when I download datasets. Could you give me some hints?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants