feature flag to statically link liblzma

[universalmind303]

Is your feature request related to a problem or challenge?

datafusion automatically dynamically links lzma if you have the compression feature enabled due to the dependency on xz2

Describe the solution you'd like

add a new feature to statically link lzma, or at the very least document the workaround provided below.

Describe alternatives you've considered

You can manually statically link by adding the following to your cargo.toml

lzma-sys = { version = "*", features = ["static"] }

Additional context

some bugs caused by this

• fix(deps): remove dynamic linking to 'lzma' GlareDB/glaredb#2631
• bug(python): unable to install on mac Darwin 22.4.0 arm64 due to dynamic linking to 'liblzma' lancedb/lance#1912

[guojidan]

Can we add xz2 = { version = "0.1", optional = true, features = ["static"] } into https://github.com/apache/arrow-datafusion/blob/main/datafusion/core/Cargo.toml#L100 ? 😕 cc @alamb

[alamb]

It would certainly be good to add a feature flag (though it might be better to simply always statically link?)

I think statically linking by default makes sense to me and is consistent with most of the rest of the rust ecosystem / crates.

[universalmind303]

@alamb i agree. Statically linking by default makes a lot of sense & greatly simplifies things for downstream users. Happy to make this change if you want to assign issue to me.