Skip to content

Sudachi version 0.4.0

Choose a tag to compare

@kazuma-t kazuma-t released this 05 Apr 04:51
· 347 commits to develop since this release

This release includes a new sentence boundary detector and a bug fix.

  • Add a new sentence boundary detector
    • Add Tokenizer#tokenizeSentences
    • Add SentenceDetector
    • The CLI makes sentence boundary disambiguation
  • Fix a bug causing normalized characters to be misaligned