Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark 1.5.0 support on EMR 3.x and EMR 4.x #160

Closed
mkanchwala opened this issue Sep 9, 2015 · 10 comments
Closed

Spark 1.5.0 support on EMR 3.x and EMR 4.x #160

mkanchwala opened this issue Sep 9, 2015 · 10 comments

Comments

@mkanchwala
Copy link

Release Candidates for the Spark 1.5.x.

http://spark.apache.org/releases/spark-release-1-5-0.html

@abhibond
Copy link

Waiting for this release on EMR. Lots of feature updates that we want to use in our production pipelines.

@njvijay
Copy link

njvijay commented Sep 18, 2015

I need Spark 1.5.x support on EMR 4.x asap.

@MarioCerdan
Copy link

Same here! Spark 1.5 + EMR is gonna be the best! :)

@sixers
Copy link

sixers commented Sep 22, 2015

Maybe someone can fork it and add support for 1.5?

It seems that we only needed small changes in Spark itself to make 1.4.1 work on EMR:
apache/spark@branch-1.4...christopherbozeman:bozemanc-v1.4.0.

Is this true for all previous releases?

@drudim
Copy link

drudim commented Sep 24, 2015

+1 for the feature

@danoyoung
Copy link

+2 for the feature

@christopherbozeman
Copy link
Contributor

Spark 1.5 on EMR is coming soon to release 4.x. Please watch https://forums.aws.amazon.com/forum.jspa?forumID=52 for announcement.

@ankurmitujjain
Copy link

Cool 👍

@MarioCerdan
Copy link

Hi everyone!

emr-4.1.0 has spark 1.5

yeeah

@christopherbozeman
Copy link
Contributor

Spark 1.5 out with release 4.1.0. https://forums.aws.amazon.com/ann.jspa?annID=3279

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants