9f997f61c477816b06b842ec353094299afe0cae speedmax subjective@gmail.com http://github.com/taf2/rb-brill-tagger/commit/4156832ba00426c2dc0f72393afea03f3a7d5a58 4156832ba00426c2dc0f72393afea03f3a7d5a58 2009-10-07T06:50:22-07:00 2009-10-07T06:50:22-07:00 fix unicode handling issue in tokenizer 6f346ae155da0fb88f644b0cd73f23952b901f78 speedmax subjective@gmail.com