Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create EMR Notebook execution operators #14962

Closed
rliuamzn opened this issue Mar 23, 2021 · 5 comments · Fixed by #28312
Closed

Create EMR Notebook execution operators #14962

rliuamzn opened this issue Mar 23, 2021 · 5 comments · Fixed by #28312
Assignees
@syedahsn
Labels
good first issue kind:feature Feature Requests provider:amazon-aws AWS/Amazon - related issues

Comments

@rliuamzn
Copy link

Description

Similar to EMR Jobflow operator and EMR Jobflow sensor, we should add operator and sensor that interact with EMR Notebook execution and abstracts all amazon logic from the airflow user.

Use case / motivation
This will allow airflow users use operator and sensor built for EMR Notebook execution.

Are you willing to submit a PR?
Yes. We already have some code to start with.

Related Issues
Not tightly related, but we would like to follow the same standard/pattern with the feature request for EKS operator
@rliuamzn rliuamzn added the kind:feature Feature Requests label Mar 23, 2021
@boring-cyborg
Copy link

boring-cyborg bot commented Mar 23, 2021

Thanks for opening your first issue here! Be sure to follow the issue template!

@mik-laj
Copy link
Member

mik-laj commented Mar 23, 2021

Yes. We already have some code to start with.

LGTM. Feel free to submit a PR.

@mik-laj mik-laj added the provider:amazon-aws AWS/Amazon - related issues label Mar 23, 2021
rliuamzn added a commit to rliuamzn/airflow that referenced this issue Jul 13, 2021
@rliuamzn
Add support for EMR Notebook Execution (apache#14962)
031632c
rliuamzn added a commit to rliuamzn/airflow that referenced this issue Jul 13, 2021
@rliuamzn
Add support for EMR Notebook Execution (apache#14962)
ef48150
@shubham22
Copy link

FYI @syedahsn is working on this and will submit a PR in the next few days.

@syedahsn
Copy link
Contributor

syedahsn commented Nov 4, 2022

Can this issue be assigned to me? Thanks!

@Taragolis Taragolis linked a pull request Dec 17, 2022 that will close this issue
EMR Notebook operator #28312
Merged
@Taragolis
Copy link
Contributor

Better late than never 🥳

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@syedahsn syedahsn

Labels
good first issue kind:feature Feature Requests provider:amazon-aws AWS/Amazon - related issues
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

EMR Notebook operator aws-mwaa/upstream-to-airflow
7 participants
@potiuk @Taragolis @mik-laj @eladkal @rliuamzn @shubham22 @syedahsn