Skip to content

Release v4.6.5
Compare
Choose a tag to compare
@himkt himkt released this 23 May 03:24
v4.6.5
d1c1787
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Thanks to the contiribution by @altescy, Konoha v6.4.5 supports UniDic for MeCab!

>>> from konoha import WordTokenizer
>>> # [important] you have to include `unidic` in file path
>>> tk = WordTokenizer(system_dictionary_path="mecab/dict/mecab-unidic")
>>> tk.tokenize("オレンジジュースを飲む")
[オレンジ, ジュース, を, 飲む]

#core feature

  • Support UniDic format for MeCabTokenizer (#132) thanks @altescy!

#documentation

  • Add colab badge (#130)
  • chore: Fix typo in README (#124)

#integration

  • Upgrade dependency for AllenNLP (#131)

#other

  • Refactoring: cleanup word_tokenizers (#129)
  • Cleanup Dockerfiles (#125)

#api

  • Use app.state for caching objects (#128)
  • Use --factory to launch app server with factory-style imports (#127)
  • Return detailed information of token in konoha API (#126)
Assets 2