ringo

ringo is japanese word separator.

Usage

final ringo = await Ringo.init();
final tokenized = ringo.tokenize('吾輩はRingoである');
print('tokenized: $tokenized');

tokenized: [吾輩, は, Ringo, である]

⚡️ Features

• Simple word separation(Japanese)
• Unknown word processing
• Build own dictionary(Create DoubleArray from TrieTree)
• Fast dictionary search(DoubleArray Algorithm)

Upcoming Features

• MorphologicalAnalysis(Lattice Algorithm)

Contributing

---

ringoは日本語の分かち書きをします．(今後，形態素解析もサポートする予定です)