Spatial Analysis on Spark

A short and simple introduction for Apache Spark in Python and some helpful python pacakges, such as pandas, geoPandas, folium. Main contents are referenced by the tutorials given by Shoaib Burq during the GeoPython 2016.

• Basic Spark operations - RDD and DataFrame http://nbviewer.jupyter.org/github/yuzzfeng/spatialSpark/blob/master/Montagsrunde_basics.ipynb

• Spark Demo with point count per cell http://nbviewer.jupyter.org/github/yuzzfeng/spatialSpark/blob/master/PointInCellCounter.ipynb

• Spatial Join Analysis http://nbviewer.jupyter.org/github/yuzzfeng/spatialSpark/blob/master/Montagsrunde_SpatialSpark.ipynb

• Twitter Demo with folium https://cdn.rawgit.com/yuzzfeng/spatialSpark/807bbf7a/demo.html

• Reference:

1. https://spark.apache.org/docs/1.6.1/programming-guide.html
2. http://simin.me/projects/spatialspark/
3. https://github.com/sabman/PySparkGeoAnalysis