Permalink
Commits on Apr 26, 2010
  1. Explicitly disable map speculative execution, since LzoIndexOutputFor…

    …mat doesn't work with it.
    
    This could be fixed, but would require writing a proper OutputCommiter. Patches welcome.
    
    Bumps version to 0.4.2
    toddlipcon committed Apr 26, 2010
Commits on Apr 23, 2010
  1. Bump version to 0.4.1

    toddlipcon committed Apr 23, 2010
  2. Fix bug where the compressed direct buf len in decompressor was impro…

    …perly reset when direct buf wasn't loaded
    
    Thanks to Zheng Shao for bug report and test case
    toddlipcon committed Apr 23, 2010
Commits on Apr 12, 2010
Commits on Apr 8, 2010
  1. IOUtils.readFully throws IOException, not EOFException on EOF. Add ou…

    …r own version that throws EOF
    
    This fixes unit tests.
    todd committed Apr 8, 2010
  2. Fix bug where LZO header or block header data may fall on read boundary

    HDFS's read() call can return less data than asked for if
    the header falls on a block boundary. We need to read the
    data fully.
    todd committed Apr 8, 2010
Commits on Apr 7, 2010
Commits on Apr 1, 2010
  1. Attempt to fix the compressed/decompressed issue with lzo indexing, a…

    …nd change the default buffer sizes everywhere in the codecs.
    kevinweil committed Apr 1, 2010
Commits on Feb 15, 2010
Commits on Feb 14, 2010
Commits on Jan 26, 2010
  1. Merge commit 'kw/master' into distributedindexer

    Conflicts:
    	lib/hadoop-0.20.0-dev-core.jar
    	lib/hadoop-0.20.1+152-core.jar
    	lib/hadoop-core-0.20.1+133.jar
    toddlipcon committed Jan 26, 2010
Commits on Jan 11, 2010
  1. Bump the version number.

    kevinweil committed Jan 11, 2010
  2. Borrowing from Todd Lipcon's great work, added a distributed lzo inde…

    …xer. It indexes lzo files in a map reduce job, one mapper per file, using custom input and output formats. Moving the indexing computation away from a local process is a big step forward. Thanks Todd.
    kevinweil committed Jan 11, 2010
Commits on Dec 31, 2009
Commits on Dec 29, 2009
  1. Merge commit 'origin/master'

    Conflicts:
    	src/java/com/hadoop/compression/lzo/LzoIndex.java
    toddlipcon committed Dec 29, 2009
Commits on Nov 16, 2009
  1. Expose the tmp filename the index writes to so that it can be cleaned…

    … up upon failure, and use the proper Path api for appending to filenames.
    kevinweil committed Nov 16, 2009
Commits on Nov 6, 2009
Commits on Nov 4, 2009
  1. Make LzoIndex.createIndex properly cleanup after itself on failure, a…

    …nd fix some formatting in the javadoc.
    kevinweil committed Nov 4, 2009
Commits on Nov 1, 2009
  1. Add idea projects to .gitignore, add build properties to jar, and log…

    … build's git revision once upon static load.
    kevinweil committed Nov 1, 2009
Commits on Oct 30, 2009