Skip to content

v0.3.0 — multilingual parsing

Choose a tag to compare

View all tags
@AndyFooBlah AndyFooBlah released this 26 Jul 08:51
· 17 commits to main since this release
v0.3.0
e1343fd

Six languages, corpus-first: English 84.3% (1,031 cases), Spanish 96.0% (579), French 89.9% (406), German 97.5% (157), Japanese 95.7% (393), Chinese 95.4% (175) on imported Recognizers-Text conformance corpora — 2,486/2,741 gradeable cases, all per-language CI regression baselines.

  • Language registry dispatched by the context locale; unknown locales fall back to English
  • makeLatinRules factory (exported) for Latin-script languages: lexicon-parameterized grammar incl. ranges, durations, word-number dates, scoped weeks, end-of boundaries
  • CJK support: per-character tokenization, fullwidth normalization, kanji/hanzi numerals, era years (令和/民国…), bespoke ja/zh rule modules
  • Corpus inversion tool (reverse cases derived from forward cases), domain packs (0.2.0) carried forward
  • French corpus: 231 upstream ref-mismatch artifacts excluded at import, counted and documented
  • Known engine gaps tracked: #14 (invalid-date completion), #15 (multilingual-surfaced gaps)

Note: describe() rendering remains English; localized rendering is the next milestone.

Assets 2
Loading