Skip to content

PriMock57 dictation evaluation subset, revision 1

Choose a tag to compare

@github-actions github-actions released this 06 Nov 01:35
Immutable release. Only release title and notes can be modified.

PriMock57 dictation evaluation subset, revision 1

60 utterances that name 26 drugs (85 occurrences) and 16 spans with no clinician speech, cut from PriMock57 and stored as 16 kHz mono FLAC with their transcripts. Biorouter's Tier 1 accuracy test reads it.

File primock57-subset-r1.tar
Size 7567360 bytes
SHA-256 2776a659f659181f9a4aa67c98d47bf531ad0c904623f9e77d075a714af599e1
Source https://github.com/babylonhealth/primock57 at cd2ac707ad03cb4d2531f4ec6b90c659bf4357c5
License CC-BY-4.0; see ATTRIBUTION.md

Selection

  • Source: PriMock57 at commit cd2ac707ad03cb4d2531f4ec6b90c659bf4357c5, the commit the 2026-11-04 research run read.
  • Speech: one TextGrid interval each, 2 to 25 s, no <UNSURE> or <UNIN/> tag, naming at least one of the 26 drugs in terms.json. All 44 clinician channel utterances that pass this filter, and 16 of the 35 patient channel utterances that pass it, chosen by hand in the research run to favour rarer drugs.
  • Each utterance runs from its interval's start minus 0.25 s to its end plus 0.25 s.
  • Gaps: empty clinician intervals of at least 3.5 s, cut from 0.3 s inside the interval, at most 8 s. 10 room tone spans (both channels silent) and 6 other party spans (only the patient speaks), drawn by the research run with Python's random.seed(7).
  • Both hand choices are pinned by list in eval/primock57-subset/selection.json, with the SHA-256 of every TextGrid read and of every clip's WAV as the research run recorded it. The builder refuses any difference.
  • Totals: 60 utterances (44 clinician, 16 patient), 420.6 s; 85 occurrences of 26 drugs; 16 gaps, 80.0 s.

Biorouter never downloads this release at run time; only its accuracy tests read it.

Published by the publish-model workflow from catalog commit 4a25254841046754d28844050854e6274893111b. Run: https://github.com/BaranziniLab/biorouter-models/actions/runs/42144716832