Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question about ADE dataset #15

Closed
zgq7799 opened this issue Mar 11, 2020 · 2 comments
Closed

Question about ADE dataset #15

zgq7799 opened this issue Mar 11, 2020 · 2 comments

Comments

@zgq7799
Copy link

zgq7799 commented Mar 11, 2020

Hi,
What should I do to get the overlapping and non-overlapping results of the ADE dataset?
@markus-eberts
Copy link
Member

Hi,
the option to get the non-overlapping results was not included in the GitHub code. I added it in commit
7ca6278. You can now set 'no_overlapping=True' in your config file. Note that it is not clear to us how previous (mainly BILOU-based) approaches handled overlapping entities for NER evaluation. We remove these entities from the ground truth as well as the predictions to compute the NER metrics.

To reproduce the results of our paper, you should train/test the model on every split and average the results.

@markus-eberts markus-eberts mentioned this issue May 9, 2020
Closed
@markus-eberts
Copy link
Member

Please leave a comment if the issue is still unsolved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@markus-eberts @zgq7799