Tokenizer now uses full available length of tweet
There was a bug in the message tokenizer which caused it to break tweets before it had to. It now uses as much of the 140 characters as possible
There was a bug in the message tokenizer which caused it to break tweets before it had to. It now uses as much of the 140 characters as possible