Bump Spark 2 build to Spark 2.1.0 #1330

Closed
fnothaft opened this Issue Dec 29, 2016 · 2 comments

Projects

None yet

2 participants

@fnothaft
Member

No description provided.

@fnothaft fnothaft added a commit to fnothaft/adam that referenced this issue Dec 29, 2016
@fnothaft fnothaft [ADAM-1330] Move to Spark 2.1.0.
Resolves #1330.
030deb4
@heuermh
Member
heuermh commented Dec 29, 2016 edited

ok to push this off until 0.22.0? We should do a deep dive into the transitive dependency changes between 1.x and 2.1.x and make sure we're not introducing any conflicts. E.g., I seem to recall there is/was a Kryo inconsistency recently (#955).

@fnothaft
Member

@heuermh I'm OK with pushing off to 0.22.0 if you'd like. That being said, this change is just to the Spark 2 build, not to the default (Spark 1) build, which remains pegged to 1.6.2. Not sure if that changes your opinion.

@fnothaft fnothaft added a commit to fnothaft/adam that referenced this issue Dec 29, 2016
@fnothaft fnothaft [ADAM-1330] Move to Spark 2.1.0.
Resolves #1330.
aa9ae9b
@heuermh heuermh modified the milestone: 0.22.0 Jan 10, 2017
@fnothaft fnothaft added a commit to fnothaft/adam that referenced this issue Jan 11, 2017
@fnothaft fnothaft [ADAM-1330] Move to Spark 2.1.0.
Resolves #1330.
a504edd
@heuermh heuermh closed this in #1332 Jan 12, 2017
@heuermh heuermh added a commit that referenced this issue Jan 12, 2017
@fnothaft @heuermh fnothaft + heuermh [ADAM-1330] Move to Spark 2.1.0.
Resolves #1330.
a9594cd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment