[Python] Experiment with zero-copy pickling

[asfimport]

PEP 574 has an implementation ready and a PyPI-available backport (at https://pypi.org/project/pickle5/ ). Adding experimental support for it would allow for zero-copy pickling of Arrow arrays, columns, etc.

I think it mainly involves implementing reduce_ex on the Buffer class, as described in https://www.python.org/dev/peps/pep-0574/#producer-api

In addition, the consumer API added by PEP 574 could be used in Arrow's serialization layer, to avoid or minimize copies when serializing foreign objects.

Reporter: Antoine Pitrou / @pitrou
Assignee: Antoine Pitrou / @pitrou

PRs and other links:

• GitHub Pull Request #2161

_{Note: This issue was originally created as ARROW-2660. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
Issue resolved by pull request 2161
#2161