Skip to content

v1.7.1

Choose a tag to compare

View all tags
@thettwe thettwe released this 02 Jun 11:20
· 29 commits to develop since this release
v1.7.1
9074fe6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Opt-in syllable-span probe

v1.7.1 adds an opt-in, frozen-encoder syllable-span probe that improves Myanmar spell-check detection recall on broken-compound, over-segmentation, and consonant-substitution errors. Three strategies share one small model with a single inference per sentence. Default behavior is unchanged — the probe is off unless its config flags are enabled.

Added

  • New public strategies in myspellchecker.core.validation_strategies: ProbeBoostedCompoundStrategy, ProbeSegmenterRescueStrategy, ProbeValidationStrategy.
  • Frozen-encoder probe engine under myspellchecker.algorithms.probe.
  • Opt-in config flags (use_probe_corrector / use_probe_compound / use_probe_segmenter_rescue, or the MSC_USE_PROBE_* environment variables) with tunable confidence thresholds and dictionary-frequency floors; all default off.

Benchmark (probe enabled)

Spelling composite 0.6436 → 0.6561 (+0.0125): +47 true positives, recall +3.2pp, top-1 accuracy +1.7pp. Default behavior (probe off) is unchanged.

Compatibility

No change to default behavior; existing deployments are unaffected unless the probe flags are enabled. The probe model artifact (~430 MB) is required at runtime only when the flags are enabled.

Full changelog: see CHANGELOG.md.

Assets 2
Loading