Skip to content

Commit

Permalink
[SPARK-46080][PYTHON] Upgrade Cloudpickle to 3.0.0
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?

This PR proposes to upgrade Cloudpickle from 2.2.1 to 3.0.0.

### Why are the changes needed?

It includes official support of Python 3.12 (cloudpipe/cloudpickle#517)

### Does this PR introduce _any_ user-facing change?

It includes official support of Python 3.12 (cloudpipe/cloudpickle#517)

### How was this patch tested?

Relies on cloudpickle's unittests. Existing test cases should pass too.

Closes #43989 from HyukjinKwon/SPARK-46080.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
  • Loading branch information
HyukjinKwon authored and dongjoon-hyun committed Nov 24, 2023
1 parent 4be5e21 commit d3d35ab
Show file tree
Hide file tree
Showing 3 changed files with 988 additions and 1,270 deletions.
20 changes: 15 additions & 5 deletions python/pyspark/cloudpickle/__init__.py
Original file line number Diff line number Diff line change
@@ -1,8 +1,18 @@
from pyspark.cloudpickle import cloudpickle # noqa
from pyspark.cloudpickle.cloudpickle import * # noqa
from pyspark.cloudpickle.cloudpickle_fast import CloudPickler, dumps, dump # noqa

# Conform to the convention used by python serialization libraries, which
# expose their Pickler subclass at top-level under the "Pickler" name.
Pickler = CloudPickler
__doc__ = cloudpickle.__doc__

__version__ = '2.2.1'
__version__ = "3.0.0"

__all__ = [ # noqa
"__version__",
"Pickler",
"CloudPickler",
"dumps",
"loads",
"dump",
"load",
"register_pickle_by_value",
"unregister_pickle_by_value",
]
Loading

0 comments on commit d3d35ab

Please sign in to comment.