Skip to content

[SPARK-56646][K8S][DOCS] Document K8s executor resize and recovery mode configs#55584

Closed
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-56646
Closed

[SPARK-56646][K8S][DOCS] Document K8s executor resize and recovery mode configs#55584
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-56646

Conversation

@dongjoon-hyun
Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR documents K8s executor resize and recovery mode configs for Apache Spark 4.2.0.

  • spark.kubernetes.executor.resizeInterval
  • spark.kubernetes.executor.resizeThreshold
  • spark.kubernetes.executor.resizeFactor
  • spark.kubernetes.allocation.recoveryMode.enabled

The three executor.resize* configurations are consumed by org.apache.spark.scheduler.cluster.k8s.ExecutorResizePlugin.

Why are the changes needed?

To improve the documentation.

Does this PR introduce any user-facing change?

No. Documentation-only update.

How was this patch tested?

Manual verification:

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Code (Opus 4.7)

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-56646] Document K8s executor resize and recovery mode configs [SPARK-56646][K8S][DOCS] Document K8s executor resize and recovery mode configs Apr 28, 2026
@dongjoon-hyun
Copy link
Copy Markdown
Member Author

dongjoon-hyun commented Apr 28, 2026

@dongjoon-hyun
Copy link
Copy Markdown
Member Author

Could you review this PR, @peter-toth ? This is the first part of docs.

@dongjoon-hyun
Copy link
Copy Markdown
Member Author

Thank you, @peter-toth . Merged to master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants