Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML][PYTHON][SPARK-12834][BACKPORT] Change ser/de of JavaArray and JavaList #10941

Closed

Commits on Jan 27, 2016

  1. [SPARK-12834] Change ser/de of JavaArray and JavaList

    https://issues.apache.org/jira/browse/SPARK-12834
    
    We use `SerDe.dumps()` to serialize `JavaArray` and `JavaList` in `PythonMLLibAPI`, then deserialize them with `PickleSerializer` in Python side. However, there is no need to transform them in such an inefficient way. Instead of it, we can use type conversion to convert them, e.g. `list(JavaArray)` or `list(JavaList)`. What's more, there is an issue to Ser/De Scala Array as I said in https://issues.apache.org/jira/browse/SPARK-12780
    
    Author: Xusen Yin <yinxusen@gmail.com>
    
    Closes apache#10772 from yinxusen/SPARK-12834.
    yinxusen authored and jkbradley committed Jan 27, 2016
    Configuration menu
    Copy the full SHA
    4a621bc View commit details
    Browse the repository at this point in the history