Skip to content

[SPARK-58038][DOCS] Fix to use Hadoop 3.5 in PySpark installation guide and Spark Connect overview#57124

Closed
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-58038
Closed

[SPARK-58038][DOCS] Fix to use Hadoop 3.5 in PySpark installation guide and Spark Connect overview#57124
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-58038

Conversation

@dongjoon-hyun

@dongjoon-hyun dongjoon-hyun commented Jul 8, 2026

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR updates the outdated Hadoop version references from 3.3 to 3.5 in the PySpark installation guide and the Spark Connect overview.

Why are the changes needed?

Apache Spark has used Hadoop 3.5.0 since SPARK-55657, but these documents still refer to Hadoop 3.3.

Does this PR introduce any user-facing change?

No. This is a documentation-only change.

How was this patch tested?

Manual review.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Fable 5

@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Thank you, @pan3793 .

dongjoon-hyun added a commit that referenced this pull request Jul 8, 2026
…e and Spark Connect overview

### What changes were proposed in this pull request?

This PR updates the outdated Hadoop version references from `3.3` to `3.5` in the PySpark installation guide and the Spark Connect overview.

### Why are the changes needed?

Apache Spark has used Hadoop 3.5.0 since SPARK-55657, but these documents still refer to Hadoop 3.3.
- #54448

### Does this PR introduce _any_ user-facing change?

No. This is a documentation-only change.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Fable 5

Closes #57124 from dongjoon-hyun/SPARK-58038.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit e76c29d)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
dongjoon-hyun added a commit that referenced this pull request Jul 8, 2026
…e and Spark Connect overview

### What changes were proposed in this pull request?

This PR updates the outdated Hadoop version references from `3.3` to `3.5` in the PySpark installation guide and the Spark Connect overview.

### Why are the changes needed?

Apache Spark has used Hadoop 3.5.0 since SPARK-55657, but these documents still refer to Hadoop 3.3.
- #54448

### Does this PR introduce _any_ user-facing change?

No. This is a documentation-only change.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Fable 5

Closes #57124 from dongjoon-hyun/SPARK-58038.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit e76c29d)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun

Copy link
Copy Markdown
Member Author

Merge Summary:

Posted by merge_spark_pr.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants