RichText does not ignore punctuation #1

Open
alvaro-cuesta opened this Issue Sep 28, 2012 · 0 comments

Comments

Projects
None yet
1 participant
Owner

alvaro-cuesta commented Sep 28, 2012

Generated RichText should ignore punctuation signs like ., ,, /, !, ', -, etc. when tokenizing.

pona. is not a single word :bowtie:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment