add application name as env var to driver and executor pods for SparkKubernetesOperator

[Shrividya]

• added spark application name to both driver and executor components in template body
• custom object launcher already had a value for the env under spec["item"]. The application name is added along with the k8_spec env var.
• tests added accordingly -changelog.rst updated.

• closes: Add SPARK_APPLICATION_NAME env variable to driver and executor pods when using SparkKubernetesOperator #43801
• related: Add SPARK_APPLICATION_NAME env variable to driver and executor pods when using SparkKubernetesOperator #43801

---

Was generative AI tooling used to co-author this PR?

• Yes

Generated-by: Claude(Anthropic) following the guidelines - used for review, debugging failing tests and suggesting fixes for test failures iteratively

---

• Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
• For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
• When adding dependency, check compliance with the ASF 3rd Party License Policy.
• For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

[tardunge]

@Shrividya Thanks, this will keep the driver and executor pod names consistent with this env var. Thanks for your contribution.

[jscheffl]

@Shrividya This PR has been converted to draft because it does not yet meet our Pull Request quality criteria.

Issues found:

• ❌ Pre-commit / static checks: Failing: CI image checks / Static checks. Run prek run --from-ref main locally to find and fix issues. See Pre-commit / static checks docs.
• ❌ Provider tests: Failing: provider distributions tests / Compat 2.11.1:P3.10:, provider distributions tests / Compat 3.0.6:P3.10:, provider distributions tests / Compat 3.1.8:P3.10:, Non-DB tests: providers / Non-DB-prov::3.10:amazon...google. Run provider tests with breeze run pytest <provider-test-path> -xvs. See Provider tests docs.
• ❌ Kubernetes tests: Failing: Low dep tests: providers / All-prov:LowestDeps:14:3.10:cncf.kubernetes. See the K8s testing documentation. See Kubernetes tests docs.

What to do next:

• The comment informs you what you need to do.
• Fix each issue, then mark the PR as "Ready for review" in the GitHub UI - but only after making sure that all the issues are fixed.
• There is no rush — take your time and work at your own pace. We appreciate your contribution and are happy to wait for updates.
• Maintainers will then proceed with a normal review.

Converting a PR to draft is not a rejection — it is an invitation to bring the PR up to the project's standards so that maintainer review time is spent productively. There is no rush — take your time and work at your own pace. We appreciate your contribution and are happy to wait for updates. If you have questions, feel free to ask on the Airflow Slack.

[jscheffl]

Crossing fingers CI is green, then good to merge in my view.