KyTea Tokenizer for nltk

2011/09/09 chezou

JPKyteaTokenizer is Japanese tokenizer with KyTea for nltk.

It's depends on KyTea and Mykytea-python.

KyTea is developed by KyTea Development Team

Detailed information of KyTea can be found at http://www.phontron.com/kytea

Install Dependencies

You need install KyTea and Mykytea-python before build.

See 'test_kyteatokenizer.py' as a sample program.

MIT License

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
README.md		README.md
kyteatokenizer.py		kyteatokenizer.py
test_kyteatokenizer.py		test_kyteatokenizer.py