[Feature] EMR Studio with EMR on EKS using managed endpoint

[victorgu-github]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?

Describe the solution you would like

Describe alternatives you have considered

Additional context

[lmouhib]

This is available in the cdk construct for the analytics reference construct

…

On Wed 21 Dec 2022 at 19:24, Victor Gu ***@***.***> wrote: Community Note - Please vote on this issue by adding a 👍 reaction <https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/> to the original issue to help the community and maintainers prioritize this request - Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request - If you are interested in working on this issue or have submitted a pull request, please leave a comment What is the outcome that you are trying to reach? Describe the solution you would like Describe alternatives you have considered Additional context — Reply to this email directly, view it on GitHub <#86>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABDYTMOOC4DJXEN6XCFWQ53WONKQBANCNFSM6AAAAAATF6TWPI> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[victorgu-github]

@lmouhib EMR Studio? which part is for that? thx

[victorgu-github]

As pointed by @lmouhib, the CDK solution can be found at https://awslabs.github.io/data-on-eks/blog/Data%20Platform%20with%20AWS%20CDK
@vara-bonthu do we need a terraform solution? if not, we can close this issue.

[vara-bonthu]

It would be nice to show EMR Studio with one of the pattern using Terraform.

[vara-bonthu]

We might not need another blueprint for this. We can add this to Workshop content with a sub module to create EMR Studio and sample tests

[github-actions]

This issue has been automatically marked as stale because it has been open 30 days
with no activity. Remove stale label or comment or this issue will be closed in 10 days

[youngjeong46]

I want to revisit this issue if possible- I have a customer interested in leveraging EMR on EKS with Karpenter but have issues with actually provisioning the endpoint due to the Security Group of Karpenter not attaching to the endpoint ALB.

My thought was to use the existing blueprint with an example script that runs to manually attach the SG to the ALB so that the endpoint provisions successfully. But long term, it would be great to explore the possibility of automating (possibly collaborating with the Karpenter team)

[vara-bonthu]

@youngjeong46 Has this been resolved? Can we close this issue?

[youngjeong46]

Yes, we can close issue, resolved with PR #261

[github-actions]

This issue has been automatically marked as stale because it has been open 30 days
with no activity. Remove stale label or comment or this issue will be closed in 10 days