Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluators fail if the input is not POS-tagged #41

Open
logological opened this issue Jun 24, 2015 · 5 comments
Open

Evaluators fail if the input is not POS-tagged #41

logological opened this issue Jun 24, 2015 · 5 comments

Comments

@logological
Copy link
Member

Originally reported on Google Code with ID 41

The cluster evaluator assumes the input is POS-tagged, and fails in getTestAndGoldResults()
if it is not.  This is because it stores results in a hash table keyed by part of speech;
since the POS is null we get a NullPointerException.

The problem may exist for other evaluators as well.

Reported by tristan.miller@nothingisreal.com on 2013-10-16 10:45:07

@logological
Copy link
Member Author

Attached test case.

Reported by tristan.miller@nothingisreal.com on 2013-10-16 10:49:41


- _Attachment: [ClusterEvaluatorTest.java](https://storage.googleapis.com/google-code-attachments/dkpro-wsd/issue-41/comment-1/ClusterEvaluatorTest.java)_

@logological
Copy link
Member Author

Problem also affects AbstractSingleExactMatchEvaluator

Reported by tristan.miller@nothingisreal.com on 2013-10-17 12:40:35

@logological
Copy link
Member Author

Possible solution would be to add a new element to the POS enumeration to represent
none/unknown POS.  However, we would need to carefully check the rest of our code to
make sure nothing relies on there being only "real" parts of speech.

Reported by tristan.miller@nothingisreal.com on 2013-10-17 12:49:01

  • Labels added: Priority-High
  • Labels removed: Priority-Medium

@logological
Copy link
Member Author

Reported by tristan.miller@nothingisreal.com on 2013-11-20 15:03:32

  • Labels removed: Milestone-Release1.0

@logological
Copy link
Member Author

Reported by tristan.miller@nothingisreal.com on 2014-11-04 11:45:25

  • Labels added: Priority-Critical
  • Labels removed: Priority-High

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant