Join GitHub today
GitHub is home to over 20 million developers working together to host and review code, manage projects, and build software together.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
|Failed to load latest commit information.|
== Overview A string tokenizer based on Ferret::Analysis::StandardAnalyzer. I made some improvements for better text analysis. == Install sudo gem sources -a http://gems.github.com (you only have to do this once) sudo gem install feedbackmine-ferret_tokenizer == Usage require 'ferret_tokenizer' t = FerretTokenizer.new '@feedbackmine, I LOVE this!!! :-)' while (tok = t.next) p tok end == Follow us on twitter http://twitter.com/feedbackmine