Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[New]: Use capacity reservations with EMR instance fleets #30346

Open
abhijitvikash opened this issue Mar 30, 2023 · 5 comments
Open

[New]: Use capacity reservations with EMR instance fleets #30346

abhijitvikash opened this issue Mar 30, 2023 · 5 comments
Labels
enhancement Requests to existing resources that expand the functionality or scope. question A question about existing functionality; most questions are re-routed to discuss.hashicorp.com. service/ec2 Issues and PRs that pertain to the ec2 service. service/emr Issues and PRs that pertain to the emr service.

Comments

@abhijitvikash
Copy link

abhijitvikash commented Mar 30, 2023

Description

Hi,
I am not able to find terraform documentation for the using Capacity Reservation with or without EMR Instance Fleet :
https://docs.aws.amazon.com/emr/latest/ManagementGuide/on-demand-capacity-reservations.html

Can you please help with this.

Thanks,
Abhijit Vikash

Requested Resource(s) and/or Data Source(s)

aws_emr_cluster
aws_ec2_capacity_reservation

Potential Terraform Configuration

resource "aws_ec2_capacity_reservation" "default" {
  instance_type     = "m6gd.16xlarge"
  instance_platform = "Linux/UNIX"
  availability_zone = "us-east-1c"
  instance_count    = var.core_count
}

resource "aws_emr_cluster" "cluster" {
  name          = local.cluster_identifier
  release_label = var.emr_version
  applications  = var.emr_apps
  log_uri       = "s3n://${var.logs_bucket}/"

  termination_protection            = false
  keep_job_flow_alive_when_no_steps = true
  capacity_reservation_id = aws_ec2_capacity_reservation.default.id
.
.
.
}

References

https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/emr_cluster.html
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/ec2_capacity_reservation
https://docs.aws.amazon.com/emr/latest/ManagementGuide/on-demand-capacity-reservations.html

Would you like to implement a fix?

None

@abhijitvikash abhijitvikash added the needs-triage Waiting for first response or review from a maintainer. label Mar 30, 2023
@github-actions
Copy link

Community Note

Voting for Prioritization

  • Please vote on this issue by adding a 👍 reaction to the original post to help the community and maintainers prioritize this request.
  • Please see our prioritization guide for information on how we prioritize.
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request.

Volunteering to Work on This Issue

  • If you are interested in working on this issue, please leave a comment.
  • If this would be your first contribution, please review the contribution guide.

@github-actions github-actions bot added service/ec2 Issues and PRs that pertain to the ec2 service. service/emr Issues and PRs that pertain to the emr service. labels Mar 30, 2023
@abhijitvikash
Copy link
Author

Can anyone please update on this issue. This is blocking our work. Thank you.

@breathingdust breathingdust added question A question about existing functionality; most questions are re-routed to discuss.hashicorp.com. and removed needs-triage Waiting for first response or review from a maintainer. labels Apr 11, 2023
@AdamTylerLynch
Copy link
Collaborator

Related: #34151 , needs to be addressed when this ticket is worked.

@AdamTylerLynch
Copy link
Collaborator

Potential Terraform Config:


"LaunchSpecifications": 
    {"OnDemandSpecification": {
        "AllocationStrategy": "lowest-price",
        "CapacityReservationOptions":
         {
            "UsageStrategy": "use-capacity-reservations-first"
         }
       }
    }
    ```

@AdamTylerLynch AdamTylerLynch added the enhancement Requests to existing resources that expand the functionality or scope. label Nov 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Requests to existing resources that expand the functionality or scope. question A question about existing functionality; most questions are re-routed to discuss.hashicorp.com. service/ec2 Issues and PRs that pertain to the ec2 service. service/emr Issues and PRs that pertain to the emr service.
Projects
None yet
Development

No branches or pull requests

3 participants