[Merged by Bors] - Airflow demo with spark-k8s

[adwk67]

Description

Add an airflow job executing and monitoring a spark-k8s job to the demo.

Review Checklist

• Code contains useful comments
• (Integration-)Test cases added (or not applicable)
• Documentation added (or not applicable)
• Changelog updated (or not applicable)
• Cargo.toml only contains references to git tags (not specific commits or branches)

Once the review is done, comment bors r+ (or bors merge) to merge. Further information

[sbernauer]

Worked fine, awesome!

[sbernauer]

When i now run in the default Namespace spark_pi_submit throws

HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"namespaces \"test-spark-k8s-cr-def\" not found","reason":"NotFound","details":{"name":"test-spark-k8s-cr-def","kind":"namespaces"},"code":404}

I'm trying something....

[sbernauer]

Ok, my test didn't work

[adwk67]

When i now run in the default Namespace spark_pi_submit throws

HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"namespaces \"test-spark-k8s-cr-def\" not found","reason":"NotFound","details":{"name":"test-spark-k8s-cr-def","kind":"namespaces"},"code":404}

I'm trying something....

This worked for me (see earlier comment & screenshot)

[sbernauer]

Ok, giving it another try

[adwk67]

Now using same namespace as demo:

• non-default:

• default:

[sbernauer]

Nice, thanks a lot!

[adwk67]

bors merge

[bors]

Pull request successfully merged into main.

Build succeeded:

• Run Rustfmt