Repository navigation
Release 0.50.21
Install
Docker
docker pull ghcr.io/jedwards1230/earmark:0.50.21Helm
helm install earmark oci://ghcr.io/jedwards1230/charts/earmark --version 0.50.21earmark v0.50.21 Release Notes
This patch release fixes the ASR pilot's --self-check so it verifies transcription on a real English clip instead of silence. It also adds an output-language check that flags non-English transcription windows.
Features
--self-check-audio PATH: a new option that selects the clip used by--self-check. The expected text is read from the same path with a.txtsuffix. The default is the bundledrunner/testdata/selfcheck_en.flac, a 5.9 s LibriSpeech dev-clean utterance (CC BY 4.0).
Bug Fixes
--self-checknow transcribes real English speech. It previously transcribed 5 seconds of silence. The code comments note that Granite answered silence with a Spanish sentence, so the old check did not verify English transcription. The check now decodes the bundled clip through the normal ffmpeg path, compares the transcript with the reference text using word error rate (threshold 0.35), and reports the results in its JSON output.--self-checkexit behavior changed. It exits6when the transcript is not English, is degenerate, or exceeds the WER threshold. It exits2when the clip or its.txtfile is missing. Scripts that expected exit0after a silent-input check should handle these codes.- Non-English windows are flagged during runs. A transcription window whose text does not look English is marked degenerate with reason
language, and it appears in the track's out-file. The check uses common function words for English, Spanish, French, German and Portuguese, and flags text that is mostly non-Latin script. It does not judge text shorter than 8 tokens.
Improvements
- Deployment files for
--self-check.testdata/selfcheck_en.flacandselfcheck_en.txtmust be installed next topilot.py. Their sha256 hashes are listed inrunner/testdata/README.md. Without these files,--self-checkexits with code2. - Documentation.
runner/README.mddocuments thelanguagedegenerate reason, the new self-check output fields, and exit code6.
Commits
- chore(earmark): bump chart version to 0.50.21 (5025a3e)
- fix(runner): pilot self-check on real English speech; flag non-English windows (#222) (870c5fc)
Full Changelog: v0.50.20...v0.50.21