Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws emr create-cluster configurations format vs emr dashboard #1502

Closed
d136o opened this issue Sep 13, 2015 · 1 comment

Comments

@d136o
Copy link

commented Sep 13, 2015

The options passed via the json file specified with the --configurations option need to be one of:

Classification, Configurations, Properties

consistent with the capitalization above. This is true of versions 1.7.47 and 1.8.3.

However, if you try to launch the same cluster via the EMR dashboard you will not be able to launch unless the words are lower cased.

This is using EMR 4.0.0 and attempting to configure a spark cluster with the following options:

[{"classification":"spark","properties":{"maximizeResourceAllocation":"true"}},{"classification":"mapred-site","properties":{"mapred.output.direct.EmrFileSystem":"true","mapred.output.direct.NativeS3FileSystem":"true"}}]

In other words:

  • options must be lowercased when passed via text box in the dashboard
  • options must be capitalized when passed via json file when using aws cli

The two seem inconsistent.

@rayluo rayluo added the question label Sep 14, 2015
@rayluo

This comment has been minimized.

Copy link
Contributor

commented Sep 14, 2015

What you described about the CLI behavior is true, and the capitalization complies with the example documented here and here. I would like to suggest you to bring this question up in Amazon EMR Forum. I believe there are more EMR users and experts there who can help you more efficiently.

@jamesls jamesls closed this Sep 18, 2015
@diehlaws diehlaws added guidance and removed question labels Jan 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants
You can’t perform that action at this time.