Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Named entities vs noun chunks #43

Open
jaidevd opened this issue Feb 11, 2020 · 0 comments
Open

Named entities vs noun chunks #43

jaidevd opened this issue Feb 11, 2020 · 0 comments
Assignees
Labels
bug Something isn't working nlp Issues related to NLP and smartness.

Comments

@jaidevd
Copy link
Member

jaidevd commented Feb 11, 2020

nlg.utils.ner wrongly clubs named entities and nouns together. This is a problem because NEs undergo a literal search, whereas nouns should undergo a lemmatized search.

E.g. "Inception is a good movie."
Here the word "movie", if it appears in an inflected form in the dataframe, will not be correctly templatized because NER clubs it with NEs like "Inception".

@jaidevd jaidevd added bug Something isn't working nlp Issues related to NLP and smartness. labels Feb 11, 2020
@jaidevd jaidevd self-assigned this Feb 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working nlp Issues related to NLP and smartness.
Projects
None yet
Development

No branches or pull requests

1 participant