-
Notifications
You must be signed in to change notification settings - Fork 28.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-9408] [PySpark] [MLlib] Refactor linalg.py to /linalg #7731
Conversation
@mengxr This breaks code on my machine, but I can't figure out why. :( |
Test build #38738 has finished for PR 7731 at commit
|
@MechCoder I think you need to add |
That does not work as well. I tried locally (I pushed it still).
Do you think it's some issue with serialization and deserialization? |
Where is |
I added those but still it does not work. I also changed , but it should not matter (but did not push) pyUDT to pyspark.mllib.linalg.local.MatrixUDT and @classmethod def module(cls): to pyspark.mllib.local.linalg but it still gives the same error. |
Test build #38760 has finished for PR 7731 at commit
|
Yeah, I've been working on this as well, and I've run into the same serialization issues. |
@MechCoder @dusenberrymw Thanks for testing! I will take a look. |
I refactored linalg.py to a folder /linalg so that future updates like
distributed.py
can be made easily.