Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PySpark support for Kaggle. #125

Closed
komal436 opened this issue Nov 5, 2017 · 2 comments
Closed

PySpark support for Kaggle. #125

komal436 opened this issue Nov 5, 2017 · 2 comments

Comments

@komal436
Copy link

komal436 commented Nov 5, 2017

Can Kaggle docker support PySpark? PySpark can help to do transformation easily.
@nerdcha
Copy link
Contributor

nerdcha commented Nov 5, 2017

Integration with Spark and other external ETL tools is something we're eager to support in the near future. Thanks for the suggestion!

@nerdcha nerdcha closed this as completed Nov 5, 2017
@kmader
Copy link
Contributor

kmader commented May 1, 2018

@komal436 since pyspark is pip installable now you should be able to install it now using the new special settings panel in Kaggle Kernels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@kmader @komal436 @nerdcha