Deprecate LZ4, introduce new LZ4_RAW

[asfimport]

The currently implemented LZ4 compression is based on the hadoop codec which is now deprecated (see details at PARQUET-1996). Also, a new, properly specified LZ4 compression (LZ4_RAW) has been introduced in the format.

The idea is to use the new LZ4_RAW compression for all cases when we currently use LZ4 and introduce a new configuration where the user would be able to switch to the deprecated behavior in case of the selected codec is LZ4.

For LZ4_RAW we will need to add the proper libs that will provide the officially specified LZ4 raw format.

Reporter: Gabor Szadovszky / @gszadovszky

_{Note: This issue was originally created as PARQUET-2032. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
cc @emkornfield

[asfimport]

Antoine Pitrou / @pitrou:
I presume this is for parquet-mr?

[asfimport]

Gabor Szadovszky / @gszadovszky:
Yep, I've missed to add the correct component. Thanks for watching :)

[pitrou]

It seems like this was done in https://issues.apache.org/jira/browse/PARQUET-2196 . Should this be closed?

[wgtmac]

I think so. Let me close it. Thanks @pitrou!