GitHub - andrefs/Lingua-EN-Tokenizer-Offsets: Finds word (token) boundaries, and returns their offsets.

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
lib/Lingua/EN/Tokenizer		lib/Lingua/EN/Tokenizer
t		t
.gitignore		.gitignore
dist.ini		dist.ini
weaver.ini		weaver.ini

About

Finds word (token) boundaries, and returns their offsets.

No packages published