Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Elastic Map Reduce fixes #5

Merged
merged 2 commits into from May 13, 2011

Conversation

Projects
None yet
2 participants

I made a couple of changes to the emr runner to fix the formatting of arguments to the elastic-mapreduce script, specifically:

All the extra arguments to hadoop, like partition and sort_keys, need to have --arg in front of each white-space separated part of the argument, as I found out on the AWS forums (https://forums.aws.amazon.com/thread.jspa?messageID=233040&#233040)
Also changed the key pair arguments to comply with the requirements of the elastic-mapreduce launcher.

James Kebinger added some commits May 9, 2011

Change emr runner to precede each white space separated hadoop argmen…
…t with a separate --arg

Change keypair setting to key_pair so the EMR command correctly contains 'key-pair' argument instead of 'keypair'

mrflip pushed a commit that referenced this pull request May 13, 2011

Merge pull request #5 from jkebinger/master
Elastic Map Reduce fixes

@mrflip mrflip merged commit 7a06b4f into infochimps-labs:master May 13, 2011

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment