ringo is japanese word separator.
final ringo = await Ringo.init();
final tokenized = ringo.tokenize('吾輩はRingoである');
print('tokenized: $tokenized');
tokenized: [吾輩, は, Ringo, である]
- Simple word separation(Japanese)
- Unknown word processing
- Build own dictionary(Create DoubleArray from TrieTree)
- Fast dictionary search(DoubleArray Algorithm)
- MorphologicalAnalysis(Lattice Algorithm)
ringoは日本語の分かち書きをします．(今後，形態素解析もサポートする予定です)