Find file History
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
..
Failed to load latest commit information.
lib
README.markdown
llr.pig
llr2.pig
set_pig_classpath.rc

README.markdown

apply log likelihood ratio

see this blog post

requires mahout libs, at least the following dependencies, on pig classpath

export PIG_CLASSPATH=/home/mat/dev/collocations/llr/lib/google-collections-1.0-rc2.jar:/home/mat/dev/collocations/llr/lib/mahout-math-0.6-SNAPSHOT.jar

also requires unigrams and bigrams from mutual info experiment

at least

pig -f extract_ngrams.pig
pig -f ngram_freq_and_count.pig

then run llr.pig

pig -f llr.pig