Skip to content

Flesh out tools for using confidence when drafting #779

@mshannon-sil

Description

@mshannon-sil

More features need to be added to SILNLP to support the use of confidence scores in the translate step. Currently, a .confidences.tsv file is created when translating which keeps track of the confidence scores for each verse and each token in each verse. We're missing the following functionality:

  1. Inserting verse confidence scores into the draft itself, so that the info is all in one place for the translator to look at.
  2. The ability to obtain a chapter confidence score during the translation step. Currently this can only be done through running diff_predictions.py with --chapter, but diff_predictions requires the presence of test data.
  3. The ability to obtain a book confidence score during the translation step. Currently, this can only be done through running test.py with --score-by-book, which requires test data.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestpipeline 6: inferIssue related to using a trained model to translate.

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions