Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

clustering reproduce question #2

Closed
sakura8999 opened this issue Sep 30, 2023 · 3 comments
Closed

clustering reproduce question #2

sakura8999 opened this issue Sep 30, 2023 · 3 comments

Comments

@sakura8999
Copy link

Hello, I conducted the clustering experiments on the DBLP dataset , but the scores are lower than the results reported in your paper.
The best epoch is: 293[clustering] nmi: [.7192, .92] ari: [.768, .092]
Are there any other factors I should pay attention to besides the parameters you recommended? thank you.

9607174b0f02aff079ad6deaa265418
@jhqi
Copy link

jhqi commented Dec 5, 2023

Hello, I conducted the clustering experiments on the DBLP dataset , but the scores are lower than the results reported in your paper. The best epoch is: 293[clustering] nmi: [.7192, .92] ari: [.768, .092] Are there any other factors I should pay attention to besides the parameters you recommended? thank you.

9607174b0f02aff079ad6deaa265418

hi, I've also reproduced the clustering task on DBLP. I directly used the code given by the author below:
python main.py --dataset dblp --task clustering --use_cfg

and I got a quite poor result, even much lower than yours. Is there anything I need to modify on the author's code? plz

I didn't do anything to the source code. And it seems that the author has fixed the random seed in the code. But my training state is different from yours:
微信截图_20231205195524

@sakura8999
Copy link
Author

sakura8999 commented Apr 4, 2024 via email

@zyq-bupt
Copy link

截屏2024-09-11 17 26 40 I get this. It's higher than yours but still lower than that reported in the paper. I use the default parameters. Here is my device configuration, maybe it will be useful to you:4090*1, pytorch==2.1.0, cuda==12.1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants