added list of stopwords, much more aggressive than before, feel free …

…to use your own
alienrobotwizard · Apr 29, 2011 · fa9ad21 · fa9ad21
1 parent 16f0b5f
commit fa9ad21
Show file tree

Hide file tree

Showing 3 changed files with 425 additions and 3 deletions.
diff --git a/FIXME.txt b/FIXME.txt
@@ -1,2 +1 @@
-- text tokenizer needs some aggressive filtering of stopwords. Look at other Lucene analyzers
 - standardize the way jars are dealt with, using relative paths in the scripts themselves is crufty and doesn't scale