Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transcriptions with false negatives should not be graded #8

Open
KatieProchilo opened this issue Jun 17, 2019 · 0 comments
Open

Transcriptions with false negatives should not be graded #8

KatieProchilo opened this issue Jun 17, 2019 · 0 comments
Assignees
Labels
task Actionable work item
Projects

Comments

@KatieProchilo
Copy link
Collaborator

Here is an example of an utterance that is a false negative:

  • expectedTranscription: "all right that's one milkshake"
  • actualTranscription: "all right that's one milk_shake"

The important pieces of this utterance have clearly been picked up correctly by the speech service, but grading as it currently stands doesn't take into account these "false negatives."

Each transcription object should have something similar to a falseNegative field. Responses that are false negatives should not be taken into account when grading.

@KatieProchilo KatieProchilo self-assigned this Jun 17, 2019
@KatieProchilo KatieProchilo added the task Actionable work item label Jun 17, 2019
@KatieProchilo KatieProchilo added this to To do in Prototype via automation Jun 17, 2019
@Joll59 Joll59 moved this from To do to In progress in Prototype Jul 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
task Actionable work item
Projects
No open projects
Prototype
  
In progress
Development

No branches or pull requests

1 participant