Skip to content
This repository has been archived by the owner on May 29, 2020. It is now read-only.

require spaces around emoticon tokeniziation #28

Open
mwmitchell opened this issue Jan 1, 2016 · 1 comment
Open

require spaces around emoticon tokeniziation #28

mwmitchell opened this issue Jan 1, 2016 · 1 comment

Comments

@mwmitchell
Copy link

Maybe an option? Would be useful to not parse things like foo:(asdf) as an emoticon and instead require that there be a space (or begin/end of line) like blah foo :) etc..

@jasonbaldridge
Copy link
Member

I'd recommend checking out the tokenization support we have in the lib-text library we open sourced from People Pattern:

https://github.com/peoplepattern/lib-text

Note that chalk isn't in active development at the moment. (Sorry!)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants