Sudachi version 0.4.0
This release includes a new sentence boundary detector and a bug fix.
- Add a new sentence boundary detector
- Add
Tokenizer#tokenizeSentences - Add
SentenceDetector - The CLI makes sentence boundary disambiguation
- Add
- Fix a bug causing normalized characters to be misaligned