New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resolved Path java serialization issue in HadoopGeoTiffRDD #2105

Merged
merged 1 commit into from Mar 31, 2017

Conversation

Projects
None yet
3 participants
@jbouffard
Contributor

jbouffard commented Mar 29, 2017

Currently, HadoopGeoTiffRDD has an issue where setting both maxTileSize and numPartitions causes the reading to fail. This is due to a serialization problem where the default serializer cannot serialize/deserialize org.apache.hadoop.fs.Path. To fix this problem, the Paths were converted to URIs during the transformation of the input key.

This resolves #2103

Resolved repartitioning issue with HadoopGeoTiffRDD
Signed-off-by: jbouffard <jbouffard@azavea.com>

@jbouffard jbouffard force-pushed the jbouffard:hadoopgeotiffrdd-fix branch from 974718b to 871c16f Mar 29, 2017

@pomadchin pomadchin changed the title from Resolved Repartitioning issue with HadoopGeoTiffRDD to Resolved Path java serialization issue in HadoopGeoTiffRDD Mar 29, 2017

@lossyrob lossyrob added this to the 1.1 milestone Mar 29, 2017

@jbouffard

This comment has been minimized.

Contributor

jbouffard commented Mar 29, 2017

@lossyrob This is ready for review.

@lossyrob lossyrob merged commit 80f92b2 into locationtech:master Mar 31, 2017

2 checks passed

continuous-integration/travis-ci/pr The Travis CI build passed
Details
ip-validation
Details
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment