Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C++] Support LZO compression #28219

Open
asfimport opened this issue Apr 16, 2021 · 4 comments
Open

[C++] Support LZO compression #28219

asfimport opened this issue Apr 16, 2021 · 4 comments

Comments

@asfimport
Copy link

I have some code that supports arrow compression with LZO and am willing to contribute. However, I do understand there is a license concern w.r.t using lzo library since it's under GPL2. I am not sure if you can take the change set.

Reporter: Haowei Yu / @sfc-gh-hyu

Note: This issue was originally created as ARROW-12430. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Antoine Pitrou / @pitrou:
Indeed, the license issue is a bit tricky. It is not clear whether making use of the LZO APIs absolutely requires adherence to the GPL by Arrow itself.

The GNU readline library (GPL-licensed) is in a similar situation and it states that you may make use of it inside software licensed under any GPL-compatible license (the Apache license 2.0 is GPL-compatible according to the FSF). However, the FSF contradicts its own advice in the GPL FAQ.

If you feel strongly about this feature, you should probably contact the LZO author and ask them their position, because that is what matters.

Note that, in any case, we would not distribute binaries with LZO enabled; you would have to compile Arrow yourself for that.

@asfimport
Copy link
Author

Haowei Yu / @sfc-gh-hyu:
Ah ok, I really want arrow to support LZO since right now I have to keep the diff somewhere and patch those diff whenever I need to upgrade arrow version, which is painful. I don't need need binary distribution, I can compile arrow by myself, that is fine.

@asfimport
Copy link
Author

Antoine Pitrou / @pitrou:
Is it for Parquet? Otherwise I'm not sure what you'd need it for.

@asfimport
Copy link
Author

Haowei Yu / @sfc-gh-hyu:
Yes, it's for parquet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant