GP tool to launch CDH on EC2 from ArcMap
Java Other
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
src/main
.gitignore
README.md
clazzpath.awk
clazzpath.sh
pom.xml

README.md

WhirrToolbox

Launch CDH on EC2 from ArcMap in under 5 minutes

Getting started without packaging

Unzip the content of this zip file into C:\Program Files (x86)\ArcGIS\Desktop10.1\java\lib\ext.

Add this toolbox to ArcMap.

Compiling and packaging

Make sure to install arcobjects.jar in your local maven repo. You can typically find it in C:\Program Files (x86)\ArcGIS\Desktop10.1\java\lib.

$ mvn install:install-file -Dfile=arcobjects.jar -DgroupId=com.esri -DartifactId=arcobjects -Dversion=10.1 -Dpackaging=jar -DgeneratePom=true

Clone the project and package:

$ mvn clean package

Installing the extension in ArcMap

Copy from the target folder the WhirrToolbox-1.1-SNAPSHOT.jar file and the libs folder into the C:\Program Files (x86)\ArcGIS\Desktop10.1\java\lib\ext folder.

Before starting ArcMap, you have to adjust the ArcGIS JVM Heap values. Run as administrator JavaConfigTool located in C:\Program Files (x86)\ArcGIS\Desktop10.1\bin

JavaConfigTool

Check out this to see how to add a Toolbox and a Tool to ArcMap.

Start ArcMap. Create a toolbox named 'WhirrToolbox' and add LaunchClusterTool, DestroyClusterTool and ClusterPropertiesTool.

WhirrToolbox

LaunchClusterTool

LunchClusterTool

Sample cluster.propertiers file

whirr.provider=aws-ec2
whirr.identity=my-aws-access-key-id
whirr.credential=my-aws-secret-access-key
whirr.cluster-name=hadoopcluster
whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode,3 hadoop-datanode+hadoop-tasktracker
whirr.public-key-file=/Users/mraad/mypublickey
whirr.private-key-file=/Users/mraad/myprivatekey
whirr.env.repo=cdh4
whirr.hadoop.install-function=install_cdh_hadoop
whirr.hadoop-configure-function=configure_cdh_hadoop
whirr.hardware-id=m1.large
whirr.image-id=us-east-1/ami-ccb35ea5
whirr.location-id=us-east-1

DestroyClusterTool

DestroyClusterTool

ClusterPropertiesTool

ClusterPropertiesTool

Converts the cluster properties into Hadoop properties