Skip to content

Lexicon data v3

Choose a tag to compare

@vacuum-in vacuum-in released this 18 Oct 03:31
· 3 commits to main since this release

Data for uk-tts-frontend/deploy/install.sh.

file what
lexicon-serving.tar the lexicon the stress API reads (2,662,237 readings; stress_lookup, active_dataset, import_run, contextual_stress_candidate), gzip CSV per table with a row-by-row digest in MANIFEST.tsv; import with wiki-stress/db/lexicon_archive.sh import
lexicon-assets.tar.gz the API lookup tables: suffix table, dictionary defaults, counted-form nouns (unchanged from data-v1)

Changes from data-v2:

  • Dataset 16 replaces dataset 15: 99,470 out-of-lexicon word forms (was 51,298) with the stress heard in audiobook narration and YouTube speech. New in this version: 48,470 words heard only on YouTube were classified by an LLM (standard word, name, slang, surzhyk, or misheard); misheard and undecided words are left out. Served by default (SUPPLEMENTARY_DATASETS=5,7,9,10,12,13,16).

Measured on the running service with this data: words the lexicon lacks, stress heard in 3,018 Common Voice recordings 81.05% (data-v2: 80.19%); 200 most frequent ambiguous forms of Common Voice 95.88%; modern-text gold 97.97% (data-v2: 98.07%, four words differ); lang-uk words / heteronyms 96.13% / 84.62%.

Built from the Ukrainian Wiktionary (CC BY-SA 4.0), ukrainian-word-stress (MIT), the lang-uk heteronyms dictionary, reviewed corrections, and stress heard in recordings (word forms and their stress only; no audio or text). Checksums in SHA256SUMS.