Skip to content

Commit

Permalink
Update to latest models
Browse files Browse the repository at this point in the history
  • Loading branch information
aws-sdk-python-automation committed Dec 27, 2023
1 parent ee6e3f2 commit 4b77cdf
Show file tree
Hide file tree
Showing 2 changed files with 34 additions and 0 deletions.
5 changes: 5 additions & 0 deletions .changes/next-release/api-change-emr-98054.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
{
"type": "api-change",
"category": "``emr``",
"description": "Update emr client to latest version"
}
29 changes: 29 additions & 0 deletions botocore/data/emr/2009-03-31/service-2.json
Original file line number Diff line number Diff line change
Expand Up @@ -630,6 +630,18 @@
],
"documentation":"<p>RunJobFlow creates and starts running a new cluster (job flow). The cluster runs the steps specified. After the steps complete, the cluster stops and the HDFS partition is lost. To prevent loss of data, configure the last step of the job flow to store results in Amazon S3. If the <a>JobFlowInstancesConfig</a> <code>KeepJobFlowAliveWhenNoSteps</code> parameter is set to <code>TRUE</code>, the cluster transitions to the WAITING state rather than shutting down after the steps have completed. </p> <p>For additional protection, you can set the <a>JobFlowInstancesConfig</a> <code>TerminationProtected</code> parameter to <code>TRUE</code> to lock the cluster and prevent it from being terminated by API call, user intervention, or in the event of a job flow error.</p> <p>A maximum of 256 steps are allowed in each job flow.</p> <p>If your cluster is long-running (such as a Hive data warehouse) or complex, you may require more than 256 steps to process your data. You can bypass the 256-step limitation in various ways, including using the SSH shell to connect to the master node and submitting queries directly to the software running on the master node, such as Hive and Hadoop.</p> <p>For long-running clusters, we recommend that you periodically store your results.</p> <note> <p>The instance fleets configuration is available only in Amazon EMR releases 4.8.0 and later, excluding 5.0.x versions. The RunJobFlow request can contain InstanceFleets parameters or InstanceGroups parameters, but not both.</p> </note>"
},
"SetKeepJobFlowAliveWhenNoSteps":{
"name":"SetKeepJobFlowAliveWhenNoSteps",
"http":{
"method":"POST",
"requestUri":"/"
},
"input":{"shape":"SetKeepJobFlowAliveWhenNoStepsInput"},
"errors":[
{"shape":"InternalServerError"}
],
"documentation":"<p>You can use the <code>SetKeepJobFlowAliveWhenNoSteps</code> to configure a cluster (job flow) to terminate after the step execution, i.e., all your steps are executed. If you want a transient cluster that shuts down after the last of the current executing steps are completed, you can configure <code>SetKeepJobFlowAliveWhenNoSteps</code> to false. If you want a long running cluster, configure <code>SetKeepJobFlowAliveWhenNoSteps</code> to true.</p> <p>For more information, see <a href=\"https://docs.aws.amazon.com/emr/latest/ManagementGuide/UsingEMR_TerminationProtection.html\">Managing Cluster Termination</a> in the <i>Amazon EMR Management Guide</i>.</p>"
},
"SetTerminationProtection":{
"name":"SetTerminationProtection",
"http":{
Expand Down Expand Up @@ -4848,6 +4860,23 @@
"type":"list",
"member":{"shape":"SessionMappingSummary"}
},
"SetKeepJobFlowAliveWhenNoStepsInput":{
"type":"structure",
"required":[
"JobFlowIds",
"KeepJobFlowAliveWhenNoSteps"
],
"members":{
"JobFlowIds":{
"shape":"XmlStringList",
"documentation":"<p>A list of strings that uniquely identify the clusters to protect. This identifier is returned by <a href=\"https://docs.aws.amazon.com/emr/latest/APIReference/API_RunJobFlow.html\">RunJobFlow</a> and can also be obtained from <a href=\"https://docs.aws.amazon.com/emr/latest/APIReference/API_DescribeJobFlows.html\">DescribeJobFlows</a>.</p>"
},
"KeepJobFlowAliveWhenNoSteps":{
"shape":"Boolean",
"documentation":"<p>A Boolean that indicates whether to terminate the cluster after all steps are executed.</p>"
}
}
},
"SetTerminationProtectionInput":{
"type":"structure",
"required":[
Expand Down

0 comments on commit 4b77cdf

Please sign in to comment.