Big update prepping for Book and Tarball release.

[jpatanooga]

Working CLI
Fixed Issues where CLI would spit out error messages, now shows usage mechanics
New prefixes for properties file ("canova.") to allow for mixed workflow property files
Full CLI support for Text, CSV, Image, and Custom InputFormats
Lots of new unit tests
New set of examples in repo for out of the box things to try
New TF-IDF vectorization pipeline, new tokenization, new TF-IDF formula, more unit tests
Normalization for all pipelines
Shuffle mode for output of all pipelines
Added basic set of transforms for post processing vectors after the InputFormat has pulled the data
New TextInputFormat for the general text TF-IDF pipeline to fix some basic issues
Fixed issue in SVMLightRecordWriter where zero values were being written out

Comments

• there are places this thing could be cleaner, but it works well enough for a alpha-RC for now
• further refactoring at this point is premature due to the fact that we dont have the timeseries/audio/video pipelines done yet (and the parallelization work is not done yet either). Would be a pointless exercise at this point.

TODO for Next PR:

1. Finish SVMLightInputFormat / RecordReader (parallelization / hdfs / split) changes
2. Finish Maven Assembly that generates the release tarball