LZ4BlockInputStream lz4-java-1.1.1 needs to read fully

[gabeki]

java.io.IOException: Stream is corrupted
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:159)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:123)
at org.apache.commons.io.IOUtils.read(IOUtils.java:2454)
at org.apache.commons.io.IOUtils.read(IOUtils.java:2476)

I think this line

in.read(compressedBuffer, 0, HEADER_LENGTH);

needs to read fully.

[jpountz]

You are perfectly right. I fixed this issue a few days ago in the Git repository and will try to make a bugfix release as soon as possible (but likely after March, 15th since I'm on vacation right now...).

Thanks for the bug report, don't hesitate to let me know if you find any other bug!

[stevenschlansker]

I believe this fix has still not been released? This makes LZ4-Java's streams basically useless, as seems to always fail decompression. A release would be much appreciated!

[jpountz]

Hi Steven. I just release version 1.1.2 (http://repo1.maven.org/maven2/net/jpountz/lz4/lz4/1.1.2/) that contains this fix. Thanks for the remainder and sorry for the delay!

[stevenschlansker]

Thanks!

[Tagar]

Might be the same problem as described apache/spark#15632 ?
https://issues.apache.org/jira/browse/SPARK-18105