Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

CPTokeniser should be able to work on a stream of input rather than the whole NSString #4

beelsebob opened this Issue Apr 3, 2011 · 0 comments


None yet
1 participant

beelsebob commented Apr 3, 2011

This would allow it to begin tokenising mid way through downloading content, rather than requiring it all to be in memory before beginning.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment