Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ACE复现结果 #3

Closed
kk19990709 opened this issue Jun 18, 2022 · 2 comments
Closed

ACE复现结果 #3

kk19990709 opened this issue Jun 18, 2022 · 2 comments

Comments

@kk19990709
Copy link

kk19990709 commented Jun 18, 2022

您好,我根据https://github.com/nlpcl-lab/ace2005-preprocessing 的数据进行划分,分数只有72。使用您的划分标准,可以复现出合理的结果。
请问为什么会存在这种差异?您数据集划分的依据是什么?
感谢!

@Buted
Copy link
Owner

Buted commented Jun 22, 2022

我们当时先根据https://github.com/nlpcl-lab/ace2005-preprocessing 的数据进行划分,发现很多已有方法都无法达到预期效果。于是我们意识到可能是数据的具体划分问题,实验中不同划分方式最终的结果的确会有差异。但在随机几次以后仍然很难复现那些方法,就采用了最后一次随机划分作为论文实验的划分。

@kk19990709
Copy link
Author

感谢解答!我们也发现事件检测的很多论文都无法达到预期效果。
很喜欢你们的工作!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants