-
Notifications
You must be signed in to change notification settings - Fork 5
morphology notes
This document ports and curates Java wiki Morphology Notes for ZemberekDotNet.
The original Java page is a long engineering backlog of ambiguity edge cases and design questions. This .NET version keeps the same spirit, but groups items into actionable categories.
Related references:
Use this page as:
- a backlog of morphology decisions,
- a quality radar for high-ambiguity surfaces,
- a bridge between linguistic discussion and executable tests.
These are recurring ambiguity clusters that should be reviewed with corpus-driven evidence.
- Noun to Verb zero-derivation overgeneration
- Example family: forms like noun + Zero->Verb + agreement/copula chains.
- Risk: linguistically odd but formally valid analyses increase ambiguity.
- Pronoun and quantifier behavior
-
kimse,herkes,öbür, demonstratives and reflexives produce many edge cases. - Risk: permissive rules improve recall but can add false positives.
- Compound and possessive interactions
- CompoundP3sg words and plural/possessive combinations can produce multiple parses.
- Risk: parser may allow additional analyses not desired in downstream tasks.
- Proper noun suffix policies
- Apostrophe behavior, Equ/derivational suffix constraints, capitalization handling.
- Risk: mismatch between orthographic conventions and parser acceptance.
- Verb derivation chain complexity
- Aorist/Narr/Past/Cond combinations, Able/Neg stacking, Inf->Noun->Verb chains.
- Risk: large ambiguity spaces and occasional unnatural candidates.
When deciding whether to keep or restrict a parse path:
- Keep if:
- It appears in real corpus data,
- It improves disambiguation outcomes,
- It is consistent with existing accepted forms.
- Restrict if:
- It mostly creates false positives,
- It appears only as typographical or tokenization artifacts,
- It causes severe ambiguity explosion with minimal real gain.
- Defer if:
- It requires broad linguistic redesign,
- Java behavior is also unresolved,
- no stable evaluation benchmark exists yet.
For each candidate rule change:
- Add one positive test in morphology tests.
- Add one negative test for likely false-positive shape.
- Re-run affected test groups.
- Record decision and rationale here.
Suggested test location patterns:
- analysis behavior:
ZemberekDotNet.Morphology.Tests/Analysis - ambiguity robustness:
ZemberekDotNet.Morphology.Tests/Ambiguity
Examples of tracked open items (non-exhaustive):
- Informal morphology forms (for some colloquial variants) are still incomplete.
- Certain proper noun and derivation edge cases require stricter constraints.
- Some derivational naming and morpheme grouping semantics remain discussion points.
See project status tracking for current priority order.
- Pronoun + quantifier morphology consistency matrix.
- Compound P3sg plural/possessive ambiguity policy.
- Zero-derivation restrictions for low-frequency false positives.
- Informal morphology completion with dedicated corpus examples.
This page does not attempt to replicate each raw Java note line-by-line. It provides a maintainable .NET engineering version of the same backlog intent.
Getting Started
Module Reference
- Morphology Notes
- Additions and Release Notes
- Morphemes Reference
- Classification Training Guide
- Normalization Guide
- Proper Nouns and Named Entities
- Text Dictionary Rules
API Parity & Migration
Reference
Roadmap