OpenNLP 3.0.0-M5

What's Changed

• Merge shell tests into the Java CI pipeline by @rzo1 in #1120
• OPENNLP-1856: Update JUnit to 6.1.1 by @dependabot[bot] in #1129
• OPENNLP-1855: Move to Apache Parent 39 by @dependabot[bot] in #1131
• OPENNLP-1858: Add ASF allowlist-check workflow for GitHub Actions by @rzo1 in #1133
• OPENNLP-1860: Unicode normalization engine — CharClass, rungs, Dimension, confusables by @krickert in #1108
• OPENNLP-1861: Offset/alignment layer — Alignment, AlignedText, buildAligned by @krickert in #1109
• OPENNLP-1871: Add the stopword-list BSD section to the binary distribution LICENSE by @krickert in #1140
• OPENNLP-1859: Add tests for BilouCodec encode/decode and outcome compatibility by @vasiliy-mikhailov in #1135
• OPENNLP-1862: UAX #29 word tokenizer — WordSegmenter, WordTokenizer, WordType by @krickert in #1110
• OPENNLP-1873: Update ONNX runtime to 1.27.0 by @dependabot[bot] in #1143
• OPENNLP-1874: Update Log4J to 2.26.1 by @dependabot[bot] in #1144
• OPENNLP-1863: Layered Term model — Term, TermAnalyzer by @krickert in #1111
• OPENNLP-1864: Per-language NormalizationProfile registry by @krickert in #1149
• OPENNLP-205: Refactor the end-of-sentence position to span mapping in SentenceDetectorME by @krickert in #1141
• OPENNLP-1865: Support offset-safe input normalization in the DL components by @krickert in #1105
• OPENNLP-1881: Upgrade & Pin Pester in GH action by @rzo1 in #1159
• OPENNLP-1866: Update Dev Manual on Unicode normalization and the UAX #29 tokenizer by @krickert in #1106
• OPENNLP-1882: Stop excluding stemmer tests and fix stale Turkish expectations by @krickert in #1162
• OPENNLP-1856: Update JUnit to 6.1.2 by @dependabot[bot] in #1172
• OPENNLP-1233: Link the POS and chunk tag references by @jerry317395616 in #1170
• OPENNLP-587: Document the Entity Linker framework by @jerry317395616 in #1169
• OPENNLP-244: Document the BioNLP converter by @jerry317395616 in #1175
• OPENNLP-1742: Use the MaxEnt training default for NameFinderME by @jerry317395616 in #1171
• OPENNLP-1868: Add Unicode full case folding to text normalization by @krickert in #1138
• OPENNLP-1869: Support offset-aware bidirectional emoji and emoticon expansion and contraction by @krickert in #1164
• OPENNLP-1890: Allowlist based class Instantiation by @subbudvk in #1178
• OPENNLP-1890: Allowlist based class Instantiation in StreamFactory / StringInterners by @rzo1 in #1179
• OPENNLP-1876: Replace regex with cursor scans in the legacy CharSequenceNormalizers by @krickert in #1151
• OPENNLP-1875: Align whitespace handling with the Unicode White_Space property by @krickert in #1150
• OPENNLP-1891: Harden Deserialization in BaseModel by @subbudvk in #1185
• OPENNLP-1878: Non-breaking performance follow-up for normalization and tokenization hot paths by @krickert in #1161
• OPENNLP-1892 : Precompile Tag patterns to avoid repeated pattern compilation by @subbudvk in #1187
• OPENNLP-1883: Make stemmers thread-safe, add StemmerFactory and per-thread stem caching by @krickert in #1163
• OPENNLP-1870: Add opt-in emoji annotations for NameFinder, Doccat, and Sentiment by @krickert in #1177

New Contributors

• @jerry317395616 made their first contribution in #1170

Full Changelog:

• JIRA release notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311215&version=12357221
• GitHub delta: opennlp-3.0.0-M4...opennlp-3.0.0-M5