Initial code for OAM tiling.

.gitignore

@@ -0,0 +1,31 @@
+
+
+project/boot
+project/plugins/project
+project/plugins/target
+project/target
+target
+.ensime
+\#*#
+*~
+.#*
+.lib
+*.aux.xml
+*.jar
+*.crc
+*.log
+_SUCCESS
+
+*.pyc
+.project
+.classpath
+.cache
+.settings
+.history
+.idea
+.DS_Store
+*.iml
+*.swp
+*.swo
+*.sublime-*
+.vagrant

README.md

@@ -0,0 +1,8 @@
+## Notes:
+
+Chunker (step1) generates the reprojected image, in web mercator tiles that are 1024 x 1024.
+It passes through the extent, resolution and tile layout.
+
+The Tiler generates an object that, given all images resolution, extents and layouts, can create
+filters per image that will allow us to filter only those tiles that require tiling at a specific
+zoom level.

step1/README.md

@@ -0,0 +1,18 @@
+To run this on EMR, do something akin to the following (with buckets changed as appropriate):
+
+```bash
+aws emr create-cluster \
+  --name "NED Conversion" \
+  --log-uri s3://ned-13arcsec.openterrain.org/logs/ \
+  --release-label emr-4.0.0 \
+  --use-default-roles \
+  --auto-terminate \
+  --ec2-attributes KeyName=stamen-keypair \
+  --applications Name=Spark \
+  --instance-groups \
+    InstanceCount=1,InstanceGroupType=MASTER,InstanceType=m3.xlarge \
+    InstanceCount=4,BidPrice=0.200,InstanceGroupType=CORE,InstanceType=c3.2xlarge \
+  --bootstrap-action Path=s3://ned-13arcsec.openterrain.org/spark/bootstrap.sh \
+  --steps Name=NED,ActionOnFailure=CONTINUE,Type=Spark,Args=[--deploy-mode,cluster,s3://ned-13arcsec.openterrain.org/spark/chunk.py] \
+  --configurations file://./emr.json
+```

step1/bootstrap.sh

@@ -0,0 +1,7 @@
+#!/bin/sh -e
+
+sudo yum-config-manager --enable epel
+sudo yum -y install geos proj proj-nad proj-epsg
+sudo ln -s /usr/lib64/libproj.so.0 /usr/lib64/libproj.so
+curl http://data.stamen.com.s3.amazonaws.com/cloudatlas/gdal-1.11.2-amz1.tar.gz | sudo tar zxf - -C /usr/local
+sudo GDAL_CONFIG=/usr/local/bin/gdal-config pip-2.7 install boto3 rasterio mercantile psutil