v2.0.0
Summary
- Improve stability when dealing with long and short text (by separate the splitting logic based on language SET {ZH_JA, KO, OTHERS}
- add parameter for whether to merge over, (default is
True, when set toFalse, this part will been separated in result substring)- newline
- digit
- punctuation (allow to set no need to merge punctuation
List[str])
What's Changed
- Close #23 by @DoodleBears in #24
Full Changelog: v1.4.1...v2.0.0