Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Confidence and start/stop index in NER #1127

Closed
Grossmend opened this issue Feb 10, 2020 · 2 comments
Closed

Confidence and start/stop index in NER #1127

Grossmend opened this issue Feb 10, 2020 · 2 comments

Comments

@Grossmend
Copy link

Good day!

It is possible return from NER model confidence and (or) start/stop position entities?
By default model return ["x_tokens", "y_pred"]

@yoptar
Copy link
Contributor

yoptar commented Feb 14, 2020

Hi @Grossmend,

  1. It is possible to return probabilities for NER models based on BERT: you can set the return_probas option to true in the configuration, remove the last tag_vocab component from the pipeline and rename y_pred_ind to y_pred in bert_sequence_tagger’s out field.
  2. There is no way at this moment to return start/stop positions as the model works with tokenized text. You can however tokenize your inputs beforehand remembering start and stop positions for every token and then match those with the model outputs.

@Grossmend
Copy link
Author

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants