Flight Data Store : memory mapped file [JAVA and Python]

[asfimport]

There are limited references for Arrow Flight implementation/examples for DataStores.

For holding huge data it may require to choose memory mapped file/file system instead of unsafe memory buffer.

It will be great if any there is any reference in this direction for JAVA and Python API.

 

And also the possibility if this is feasible with performance.

 

Reporter: Vinay

_{Note: This issue was originally created as ARROW-7280. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
This is less of a concrete, actionable issue and more of a discussion item. I suggest you emit your suggestion on the dev mailing-list: https://mail-archives.apache.org/mod_mbox/arrow-dev/