-
Notifications
You must be signed in to change notification settings - Fork 54
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
airflow-provider-vdk: Example DAG #847
Conversation
This change includes an example DAG demonstrating how to use the VDKOperator to run a data job through an Airflow DAG. Testing done: executed through Airflow UI against deployed control-service successfully Signed-off-by: Gabriel Georgiev <gageorgiev@vmware.com>
projects/vdk-plugins/airflow-provider-vdk/vdk_provider/example_dags/example_vdk.py
Outdated
Show resolved
Hide resolved
projects/vdk-plugins/airflow-provider-vdk/vdk_provider/example_dags/example_vdk.py
Show resolved
Hide resolved
projects/vdk-plugins/airflow-provider-vdk/vdk_provider/example_dags/example_vdk.py
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
) | ||
|
||
job2 = VDKOperator( | ||
conn_id="tms-example_vdk_connection", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why different conn ids?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That was a mistake that I've fixed and forgot to push.
from airflow import DAG | ||
from vdk_provider.operators.vdk import VDKOperator | ||
|
||
with DAG( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's add comments explaining what is going on.
This change includes an example DAG demonstrating
how to use the VDKOperator to run a data job through
an Airflow DAG.
Testing done: executed through Airflow UI against
deployed control-service successfully
Signed-off-by: Gabriel Georgiev gageorgiev@vmware.com