-
Notifications
You must be signed in to change notification settings - Fork 16.6k
Closed
Labels
Description
Description
Alibaba Cloud AnalyticDB for MySQL Data Lakehouse Edition (V3.0) uses the same Spark development method for batch applications and SQL applications.[1]
We want to provide operator/hook/sensor to enable Airflow users using AnalyticDB Spark.
reference:
[1] https://www.alibabacloud.com/help/en/analyticdb-for-mysql/latest/spark-offline-application-development
Use case/motivation
- implement custom operator/hook/sensor for AnalyticDB Spark.
- enable users to schedule AnalyticDB Spark Batch/SQL applications by DAGs. Such as follow.
- AnalyticDB Spark hooks provides log/Web UI url/application status for users.
Related issues
None
Are you willing to submit a PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
Reactions are currently unavailable