Lexicon data v2

Data for uk-tts-frontend/deploy/install.sh.

file	what
lexicon-serving.tar	the lexicon the stress API reads (2,614,145 readings; stress_lookup, active_dataset, import_run, contextual_stress_candidate), gzip CSV per table with a row-by-row digest in MANIFEST.tsv; import with wiki-stress/db/lexicon_archive.sh import
lexicon-assets.tar.gz	the API lookup tables: suffix table, dictionary defaults, counted-form nouns (unchanged from data-v1)

Changes from data-v1:

• Added dataset 15: 51,298 out-of-lexicon word forms (names, rare and new words) with the stress heard in audiobook narration and YouTube speech, pooled over occurrences and checked for spelling; served by default (SUPPLEMENTARY_DATASETS=5,7,9,10,12,13,15).
• Removed the datasets the API does not serve (the superseded first import and experimental ones): 2,996,968 -> 2,614,145 readings. What the API answers is unchanged; the archive is 79 MB instead of 91 MB.

Measured on the running service with this data: 200 most frequent ambiguous forms of Common Voice 95.88%, modern-text gold 98.07%, lang-uk words / heteronyms 96.10% / 84.62%.

Built from the Ukrainian Wiktionary (CC BY-SA 4.0), ukrainian-word-stress (MIT), the lang-uk heteronyms dictionary, reviewed corrections, and stress heard in recordings (word forms and their stress only; no audio or text). Checksums in SHA256SUMS.