You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I haven't fully investigated this yet, but I have found that while compression (e.g. ZSTD) is respected in DoPut requests on the client side, it does not appear to propagate through DoGet requests. This may be a bug or by design, but I think it should be possible for the client to request that compression be employed when serving a DoGet
David Li / @lidavidm: @wesm the way it was set up, there's no propagation - what the client sets is independent of what the server sets. In this case setting write options for DoGet doesn't make much sense as you're not writing any Arrow data. That is confusing/inconvenient, but building negotiation into Flight is a separate task (did we file a Jira for that/should we just use this one?).
Wes McKinney / @wesm:
Right, but I didn't see a way to set the IpcWriteOptions for the server side of handling the RPC, or did I miss it? That seems like a functional gap if so
David Li / @lidavidm:
Given we've kicked this can down the road a few times: I think we can close it? Compression can be specified server-side, but there's no built-in negotiation (and in ARROW-10351 it's been hard to find a case where compression is beneficial). Or else we can adjust this JIRA to be about implementing negotiation.
I haven't fully investigated this yet, but I have found that while compression (e.g. ZSTD) is respected in DoPut requests on the client side, it does not appear to propagate through DoGet requests. This may be a bug or by design, but I think it should be possible for the client to request that compression be employed when serving a DoGet
Reporter: Wes McKinney / @wesm
Note: This issue was originally created as ARROW-9601. Please see the migration documentation for further details.
The text was updated successfully, but these errors were encountered: