Skip to content

[SPARK-58335][K8S][TESTS] Add SparkKubernetesClientFactorySuite#57513

Closed
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-58335
Closed

[SPARK-58335][K8S][TESTS] Add SparkKubernetesClientFactorySuite#57513
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-58335

Conversation

@dongjoon-hyun

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR aims to add SparkKubernetesClientFactorySuite to test SparkKubernetesClientFactory.createKubernetesClient, covering the patterns of its production call sites: master URL/namespace/API version propagation, per-ClientType timeouts, OAuth token and TLS file handling under all auth conf prefixes, the default service account CA cert fallback, spark.kubernetes.trust.certificates, the retry backoff limit system property, and spark.kubernetes.context selection.

Why are the changes needed?

SparkKubernetesClientFactory is a @Stable @DeveloperApi but had no test coverage.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs with the newly added test suite.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Fable 5

@uros-b

uros-b commented Jul 24, 2026

Copy link
Copy Markdown
Member

Thank you @dongjoon-hyun!

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Thank you, @uros-b !

dongjoon-hyun added a commit that referenced this pull request Jul 25, 2026
### What changes were proposed in this pull request?

This PR aims to add `SparkKubernetesClientFactorySuite` to test `SparkKubernetesClientFactory.createKubernetesClient`, covering the patterns of its production call sites: master URL/namespace/API version propagation, per-`ClientType` timeouts, OAuth token and TLS file handling under all auth conf prefixes, the default service account CA cert fallback, `spark.kubernetes.trust.certificates`, the retry backoff limit system property, and `spark.kubernetes.context` selection.

### Why are the changes needed?

`SparkKubernetesClientFactory` is a `Stable` `DeveloperApi` but had no test coverage.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs with the newly added test suite.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Fable 5

Closes #57513 from dongjoon-hyun/SPARK-58335.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit 4a5bb95)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
dongjoon-hyun added a commit that referenced this pull request Jul 25, 2026
### What changes were proposed in this pull request?

This PR aims to add `SparkKubernetesClientFactorySuite` to test `SparkKubernetesClientFactory.createKubernetesClient`, covering the patterns of its production call sites: master URL/namespace/API version propagation, per-`ClientType` timeouts, OAuth token and TLS file handling under all auth conf prefixes, the default service account CA cert fallback, `spark.kubernetes.trust.certificates`, the retry backoff limit system property, and `spark.kubernetes.context` selection.

### Why are the changes needed?

`SparkKubernetesClientFactory` is a `Stable` `DeveloperApi` but had no test coverage.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs with the newly added test suite.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Fable 5

Closes #57513 from dongjoon-hyun/SPARK-58335.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit 4a5bb95)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
dongjoon-hyun added a commit that referenced this pull request Jul 25, 2026
### What changes were proposed in this pull request?

This PR aims to add `SparkKubernetesClientFactorySuite` to test `SparkKubernetesClientFactory.createKubernetesClient`, covering the patterns of its production call sites: master URL/namespace/API version propagation, per-`ClientType` timeouts, OAuth token and TLS file handling under all auth conf prefixes, the default service account CA cert fallback, `spark.kubernetes.trust.certificates`, the retry backoff limit system property, and `spark.kubernetes.context` selection.

### Why are the changes needed?

`SparkKubernetesClientFactory` is a `Stable` `DeveloperApi` but had no test coverage.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs with the newly added test suite.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Fable 5

Closes #57513 from dongjoon-hyun/SPARK-58335.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit 4a5bb95)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
dongjoon-hyun added a commit that referenced this pull request Jul 25, 2026
This PR aims to add `SparkKubernetesClientFactorySuite` to test `SparkKubernetesClientFactory.createKubernetesClient`, covering the patterns of its production call sites: master URL/namespace/API version propagation, per-`ClientType` timeouts, OAuth token and TLS file handling under all auth conf prefixes, the default service account CA cert fallback, `spark.kubernetes.trust.certificates`, the retry backoff limit system property, and `spark.kubernetes.context` selection.

`SparkKubernetesClientFactory` is a `Stable` `DeveloperApi` but had no test coverage.

No.

Pass the CIs with the newly added test suite.

Generated-by: Claude Fable 5

Closes #57513 from dongjoon-hyun/SPARK-58335.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit 4a5bb95)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Merge Summary:

Posted by merge_spark_pr.py

@dongjoon-hyun
dongjoon-hyun deleted the SPARK-58335 branch July 25, 2026 00:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants