#

englishtokenizer

Here is 1 public repository matching this topic...

kiarashrahmani / English-Persian-Tokenizer

This project is a simple tokenizer for text processing that can tokenize both Persian and English words.

nlp tokenizer nltk persiantokenizer englishtokenizer

Updated Nov 13, 2023
Python

Improve this page

Add a description, image, and links to the englishtokenizer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the englishtokenizer topic, visit your repo's landing page and select "manage topics."