Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
A string tokenizer based on Ferret::Analysis::StandardAnalyzer.
C Ruby
branch: master

This branch is 2 commits ahead, 2 commits behind feedbackmine:master

Fetching latest commit…

Cannot retrieve the latest commit at this time

Failed to load latest commit information.
ext
test
Manifest.txt
README.txt
Rakefile
ferret_tokenizer.gemspec

README.txt

== Overview
A string tokenizer based on Ferret::Analysis::StandardAnalyzer. I made some improvements for better text analysis.

== Install

sudo gem sources -a http://gems.github.com   (you only have to do this once)
sudo gem install feedbackmine-ferret_tokenizer

== Usage

require 'ferret_tokenizer'
t = FerretTokenizer.new '@feedbackmine, I LOVE this!!! :-)'
while (tok = t.next)
  p tok
end

== Follow us on twitter

http://twitter.com/feedbackmine

Something went wrong with that request. Please try again.