Skip to content

Adjust token fix

Choose a tag to compare

View all tags
@kaldan007 kaldan007 released this 22 Mar 12:28
· 147 commits to master since this release
v0.8.2
98af430
  • Adjusted tokens using rules in adjustment directory is assigned to token list to be return by the tokenize method of WordTokenizer class.
  • Updated test case of adjust token.
Assets 2
Loading