Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create and implement a NERDataHandler class that establishes a common method to process labeled NER data in Spark NLP #12

Closed
luca-martial opened this issue Nov 24, 2022 · 0 comments
Assignees
Labels
Priority: ⚠️Critical Needs to be done ASAP

Comments

@luca-martial
Copy link
Contributor

luca-martial commented Nov 24, 2022

The new NERDataHandler class will include:

  • Write and read methods
  • Storing docs indexes
  • Easily filtering
  • Converting inputs to match library requirements

It will go under nlptest/data_handlers/

The first version of this class will support robustness testing/fixing in Spark NLP, but adaptability to other tasks and libraries should be kept in mind when developing it.

@luca-martial luca-martial changed the title Create a NERDataHandler class that establishes a common method to process labeled NER data in Spark NLP Create and implement a NERDataHandler class that establishes a common method to process labeled NER data in Spark NLP Nov 24, 2022
@alierenak alierenak self-assigned this Dec 6, 2022
@luca-martial luca-martial added Priority: ⚠️Critical Needs to be done ASAP and removed high priority labels Dec 9, 2022
@luca-martial luca-martial closed this as not planned Won't fix, can't repro, duplicate, stale Jan 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Priority: ⚠️Critical Needs to be done ASAP
Projects
None yet
Development

No branches or pull requests

2 participants