Description
In Spark Kubernetes operator we have hard-coded API group and version for spark application k8s object:
|
group="sparkoperator.k8s.io", |
|
version="v1beta2", |
|
plural="sparkapplications", |
I think it is not good, because we can have situation that some custom or not opensource Spark k8s operators can have different API group and version (like
sparkoperator.mydomain.com instead of
sparkoperator.k8s.io).
Use case / motivation
User have got installed custom or commercial Spark Kubernetes operator and he wants to launch DAG with SprkKubernetesOperator from providers. User cannot do that without this implemented feature.
Are you willing to submit a PR?
Yes
Related Issues
No
Description
In Spark Kubernetes operator we have hard-coded API group and version for spark application k8s object:
airflow/airflow/providers/cncf/kubernetes/operators/spark_kubernetes.py
Lines 63 to 65 in b23a4cd
I think it is not good, because we can have situation that some custom or not opensource Spark k8s operators can have different API group and version (like
sparkoperator.mydomain.cominstead ofsparkoperator.k8s.io).Use case / motivation
User have got installed custom or commercial Spark Kubernetes operator and he wants to launch DAG with
SprkKubernetesOperatorfrom providers. User cannot do that without this implemented feature.Are you willing to submit a PR?
Yes
Related Issues
No