Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code for evaluation on MEGC2021 benchmark? #3

Closed
xjtupanda opened this issue Nov 4, 2022 · 2 comments
Closed

Code for evaluation on MEGC2021 benchmark? #3

xjtupanda opened this issue Nov 4, 2022 · 2 comments

Comments

@xjtupanda
Copy link

Thanks for the great work. I noticed that there's only evaluation code for SAMM-Challenge and CAS(ME)^3, would you please also provide the counterpark for SAMM-LV and CAS(ME)^2 for reproduction on the F1-score results for those datasets?

@genbing99
Copy link
Owner

genbing99 commented Nov 5, 2022

Hi, I have lost the network weights to reproduce the results that are shared in the paper.
Due to time constraints, I tried to rerun the codes again with other configurations, but the results obtained are lower than the reported ones. Hope you can understand.
The jupyter notebook file which consists of all steps is in the link:
https://drive.google.com/file/d/16sUEb3RmIaDh-IvrcT6L9sRHGuG-t6mJ/view?usp=sharing
Note that I used a high learning rate in this notebook, so the val_loss values in the graph fluctuated. A slightly better result and a nicer loss graph can be obtained if a lower learning rate is used.

@xjtupanda
Copy link
Author

Hi, I have lost the network weights to reproduce the results that are shared in the paper. Due to time constraints, I tried to rerun the codes again with other configurations, but the results obtained are lower than the reported ones. Hope you can understand. The jupyter notebook file which consists of all steps is in the link: https://drive.google.com/file/d/16sUEb3RmIaDh-IvrcT6L9sRHGuG-t6mJ/view?usp=sharing

Thank you so much for your patience and kindness!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants