Repository navigation
PriMock57 dictation evaluation subset, revision 1
Immutable
release. Only release title and notes can be modified.
PriMock57 dictation evaluation subset, revision 1
60 utterances that name 26 drugs (85 occurrences) and 16 spans with no clinician speech, cut from PriMock57 and stored as 16 kHz mono FLAC with their transcripts. Biorouter's Tier 1 accuracy test reads it.
| File | primock57-subset-r1.tar |
| Size | 7567360 bytes |
| SHA-256 | 2776a659f659181f9a4aa67c98d47bf531ad0c904623f9e77d075a714af599e1 |
| Source | https://github.com/babylonhealth/primock57 at cd2ac707ad03cb4d2531f4ec6b90c659bf4357c5 |
| License | CC-BY-4.0; see ATTRIBUTION.md |
Selection
- Source: PriMock57 at commit cd2ac707ad03cb4d2531f4ec6b90c659bf4357c5, the commit the 2026-11-04 research run read.
- Speech: one TextGrid interval each, 2 to 25 s, no
<UNSURE>or<UNIN/>tag, naming at least one of the 26 drugs in terms.json. All 44 clinician channel utterances that pass this filter, and 16 of the 35 patient channel utterances that pass it, chosen by hand in the research run to favour rarer drugs. - Each utterance runs from its interval's start minus 0.25 s to its end plus 0.25 s.
- Gaps: empty clinician intervals of at least 3.5 s, cut from 0.3 s inside the interval, at most 8 s. 10 room tone spans (both channels silent) and 6 other party spans (only the patient speaks), drawn by the research run with Python's random.seed(7).
- Both hand choices are pinned by list in eval/primock57-subset/selection.json, with the SHA-256 of every TextGrid read and of every clip's WAV as the research run recorded it. The builder refuses any difference.
- Totals: 60 utterances (44 clinician, 16 patient), 420.6 s; 85 occurrences of 26 drugs; 16 gaps, 80.0 s.
Biorouter never downloads this release at run time; only its accuracy tests read it.
Published by the publish-model workflow from catalog commit 4a25254841046754d28844050854e6274893111b. Run: https://github.com/BaranziniLab/biorouter-models/actions/runs/42144716832