Add GeoSpark Core Python API #394 #417
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jiayuasu
pushed a commit
that referenced
this pull request
Feb 3, 2020
* Fix Issue, unread block data (#408) * Add GeoSpark core Python API, version beta. * Fix issue with additional else statement. * Add WkbReader to direct imports, Fix issue with version tests. * Add geo_pyspark version 0.3.0. * Add geo_pyspark version 0.3.0. * Update wheel file for geo_pyspark version 0.3.0. * Improve serialization process for GeoSpark Python. * Fix Issue with Adapter import. * Create example notebook for GeoPysparkSQL and GeoPysparkCore. * Delete ShowCase Notebook.ipynb * Update GeoSparkCore example notebook. * Update code for DataBricks platform support. * Add support for collect SpatialPartitionedRDD. * Add persist possibility to indexedRDD. * Add support for serializing rawSpatialRDD. * Update wheel file for geo_pyspark version 0.3.0. # Conflicts: # docs/tutorial/geospark-python.md # mkdocs.yml
jiayuasu
pushed a commit
that referenced
this pull request
Feb 3, 2020
* Fix Issue, unread block data (#408) * Add GeoSpark core Python API, version beta. * Fix issue with additional else statement. * Add WkbReader to direct imports, Fix issue with version tests. * Add geo_pyspark version 0.3.0. * Add geo_pyspark version 0.3.0. * Update wheel file for geo_pyspark version 0.3.0. * Improve serialization process for GeoSpark Python. * Fix Issue with Adapter import. * Create example notebook for GeoPysparkSQL and GeoPysparkCore. * Delete ShowCase Notebook.ipynb * Update GeoSparkCore example notebook. * Update code for DataBricks platform support. * Add support for collect SpatialPartitionedRDD. * Add persist possibility to indexedRDD. * Add support for serializing rawSpatialRDD. * Update wheel file for geo_pyspark version 0.3.0. # Conflicts: # docs/tutorial/geospark-python.md # mkdocs.yml
|
@Imbruced Hi Pawel, thank you very much for this PR and thank you for your hard work. Having said that, I have noticed a couple of things that we should do in order to draw GeoSpark 1.3.0 release. As we agreed, GeoSpark 1.3.0 will include two separate parts, Scala/Java API (which are jars hosted on Maven Central) and Python (which are packages hosted on PyPi) First of all, I have made a cut on GeoSpark Scala/Java API on core, SQL and Viz components, for Spark 2.1, 2.2., 2.3+. You now can find them on Maven Central. For GeoSpark RDD Python and SQL Python API,
Does this make sense? Please feel free to correct me. |
|
Hi,
|
|
GeoSpark Python is available on PyPi https://pypi.org/project/geo-pyspark/ :) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Is this PR related to a proposed Issue?
#394
What changes were proposed in this PR?
GeoSpark Core Python API
How was this patch tested?
over 400 unit tests (some of them are rewritten from GeoSpark Java/Scala code)
Did this PR include necessary documentation updates?
Yes, docs/tutorial/geo_spark_core_python.md