Skip to content
This repository has been archived by the owner on May 12, 2021. It is now read-only.

[PIO-176] Hack in build.sbt for switching between Spark 1.x and 2.x s… #475

Closed
wants to merge 2 commits into from
Closed

[PIO-176] Hack in build.sbt for switching between Spark 1.x and 2.x s… #475

wants to merge 2 commits into from

Conversation

saurabh3091
Copy link
Contributor

  • Removed unmanagedSourceDirectories in data module
  • refactored sqlSession code blocks to use SparkSession instead of SqlContext
  • removed PPythonEventStore.scala as it was not being used anywhere.

@saurabh3091
Copy link
Contributor Author

Please review and let me know if I missed anything.
Thanks a lot for your support guys.

@marevol
Copy link
Member

marevol commented Oct 2, 2018

PPythonEventStore is used in python/pypio.

@shimamoto
Copy link
Member

Yeah, it's necessary for python/pypio for now. We can probably remove it after supporting Spark ML natively.

@saurabh3091 saurabh3091 closed this Oct 3, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@saurabh3091 @marevol @shimamoto