v0.8.10

Fix

• sent-tokenizer: Normalised sentence is included in sentence tokens (7cf455d)
• NO_POS typos (5d521a8)
• Auto release (65b0931)
• Auto release (159d39e)
• Auto release (c961147)
• Auto release (1d56341)
• Auto release (b48e017)
• Auto release (ab9cf0a)
• trie: Non inflectible word type error bug fix (36ad9ca)
• tokenize: Another case of unexpected skip of syl (deacd59)
• tokenize: Syl of remove word getting skipped unexpectly (161445e)
• split_affixztion: Keyerror bug fix by using pop method to delete items (a981693)
• adjusttoken: Rules having invalid index are not considered and error msg is shown in that case (bfe6218)
• WordTokenizer: Adjusted token list assigned to token list returned by tokenize method (dc898a9)
• Set config kwargs to None (04eaa9f)
• Select on .tsv files in dialect pack (e24369a)
• Set part_lemmas attr to WordTokenizer (56734a1)
• Running test under coverage (69b2334)
• Use fully directory base config (b292077)
• Use full directory base config (38107fe)
• Skip rules when populating trie (a16ef54)

Documentation

• Custome dialect pack usage (802cbef)
• Add config class (f5c2242)
• Add architecture dg & workflow of botok (fda2025)
• Add title and description (a019ca9)
• Setup the docs (c6c4229)
• Update the usage (046747b)