Skip to content

Release 0.50.21

Choose a tag to compare

@github-actions github-actions released this 03 Nov 21:18
· 7 commits to main since this release

Install

Docker

docker pull ghcr.io/jedwards1230/earmark:0.50.21

Helm

helm install earmark oci://ghcr.io/jedwards1230/charts/earmark --version 0.50.21

earmark v0.50.21 Release Notes

This patch release fixes the ASR pilot's --self-check so it verifies transcription on a real English clip instead of silence. It also adds an output-language check that flags non-English transcription windows.

Features

  • --self-check-audio PATH: a new option that selects the clip used by --self-check. The expected text is read from the same path with a .txt suffix. The default is the bundled runner/testdata/selfcheck_en.flac, a 5.9 s LibriSpeech dev-clean utterance (CC BY 4.0).

Bug Fixes

  • --self-check now transcribes real English speech. It previously transcribed 5 seconds of silence. The code comments note that Granite answered silence with a Spanish sentence, so the old check did not verify English transcription. The check now decodes the bundled clip through the normal ffmpeg path, compares the transcript with the reference text using word error rate (threshold 0.35), and reports the results in its JSON output.
  • --self-check exit behavior changed. It exits 6 when the transcript is not English, is degenerate, or exceeds the WER threshold. It exits 2 when the clip or its .txt file is missing. Scripts that expected exit 0 after a silent-input check should handle these codes.
  • Non-English windows are flagged during runs. A transcription window whose text does not look English is marked degenerate with reason language, and it appears in the track's out-file. The check uses common function words for English, Spanish, French, German and Portuguese, and flags text that is mostly non-Latin script. It does not judge text shorter than 8 tokens.

Improvements

  • Deployment files for --self-check. testdata/selfcheck_en.flac and selfcheck_en.txt must be installed next to pilot.py. Their sha256 hashes are listed in runner/testdata/README.md. Without these files, --self-check exits with code 2.
  • Documentation. runner/README.md documents the language degenerate reason, the new self-check output fields, and exit code 6.

Commits

  • chore(earmark): bump chart version to 0.50.21 (5025a3e)
  • fix(runner): pilot self-check on real English speech; flag non-English windows (#222) (870c5fc)

Full Changelog: v0.50.20...v0.50.21