Skip to content

Release 0.50.26

Choose a tag to compare

@github-actions github-actions released this 05 Nov 19:17
· 2 commits to main since this release

Install

Docker

docker pull ghcr.io/jedwards1230/earmark:0.50.26

Helm

helm install earmark oci://ghcr.io/jedwards1230/charts/earmark --version 0.50.26

Summary

This patch release adds a "one spelling per book" pass to the decide step, which keeps a book's findings from applying two different spellings of the same name. It also bumps the Helm chart and app version to 0.50.26.

Features

One spelling per book in earmark decide

The decide step now checks each book's findings for contradictory spellings. Previously, the judge could propose one name in two spellings (for example, ilmas and ilmis for the same name in one book), and each finding was decided on its own. The pass runs after the model is asked and before conflicts are ranked, in both dry runs and --yes runs.

For each applied finding or audio-liftable hold whose differing words sound alike, the pass does the following:

  • Held spelling_conflict: the book's findings propose two or more spellings for the same name, and none is established.
  • Held spelling_off_established: the book has an established spelling, and the finding targets a different one. The established spelling comes from the book's applied findings or, if none exist, from a spelling that at least two pilot transcripts each contain at least three times, with no competing spelling in any pilot.
  • Applied spelling_established: a no_evidence hold is promoted only when an applied finding already established the same original-to-spelling pair. Pilot agreement never promotes a finding.

Rejects, duplicates, rung-0 failures, and other holds are not changed. Each affected decision records its group in finding_events.detail (rung spelling), so you can audit it. No database migration is required.

Usage:

  • Preview with earmark decide --book "<dir>" --json (without --yes) and check reasons.spelling_conflict, reasons.spelling_off_established, and reasons.spelling_established. A dry run still makes model calls, which are cached and write to fn_calls.
  • After a --yes run, count the pass's decisions with:
    SELECT reason, count(*) FROM finding_events WHERE kind = 'decision' AND recipe_id = '<id>' AND detail->>'rung' = 'spelling' GROUP BY reason
  • Undo a run with earmark decide revert --recipe <id>. The pass's holds and promotions are part of that recipe and revert with it.

Things to know:

  • The decide step's step_version is now 4, so this creates a new decide recipe. Earlier decisions are re-checked under the new recipe rather than treated as final.
  • Books over a read cap (50,000 live findings, 5,000 pilot rows, or 200,000 chunks) are skipped and logged. The run continues, and the report counts the skipped books (spelling_skipped_books, also printed in the text output).
  • In paged --yes runs, a junk target rejected only on a later page cannot undo a hold written on an earlier page. A paged run can therefore hold more findings than a dry run of the same book, but it never applies more.
  • The audio-vote rung (--audio-vote) does not run the spelling pass. Findings held by the pass are not lifted by audio votes.
  • Holds are final for a given recipe. A spelling_* hold is reconsidered only under the next decide recipe.

Improvements

  • Helm chart version and appVersion are now 0.50.26.
  • The decide recipe parameters now include spelling_rule (one_spelling@v1) and spelling_min_pilot (3).
  • CONTRACT.md and DATABASE_SCHEMA.md document the spelling pass, its reasons, and the detail format.

Commits

  • chore(earmark): bump chart version to 0.50.26 (625382b)
  • feat(decide): one spelling per book pass (should_apply step 4) (#227) (b8fa6c4)

Full Changelog: v0.50.25...v0.50.26