Skip to content

docs: update Spark version support and add version compatibility page#4138

Merged
andygrove merged 2 commits intoapache:mainfrom
andygrove:spark-version-docs
Apr 28, 2026
Merged

docs: update Spark version support and add version compatibility page#4138
andygrove merged 2 commits intoapache:mainfrom
andygrove:spark-version-docs

Conversation

@andygrove
Copy link
Copy Markdown
Member

Summary

  • Promote Spark 4.0.2 from experimental to the supported versions list
  • Add Spark 4.1.1 and 4.2.0-preview4 as experimental versions
  • Add download links for Spark 4.1 and 4.2 jars
  • Remove "(Experimental)" label from Spark 4.0 download link
  • Add a new "Spark Version Compatibility" page to the compatibility guide documenting known issues per Spark version (3.4, 3.5, 4.0, 4.1, 4.2)
  • Update README to reflect the new version support

Test plan

  • Verify docs build successfully
  • Review version tables in installation guide
  • Review new spark-versions.md page renders correctly
  • Verify compatibility guide toctree includes the new page

🤖 Generated with Claude Code

andygrove and others added 2 commits April 28, 2026 16:53
Promote Spark 4.0.2 to the supported versions list, add Spark 4.1.1
and 4.2.0-preview4 as experimental, and add a new Spark version
compatibility page documenting known issues per version.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Copy link
Copy Markdown
Contributor

@coderfender coderfender left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@andygrove andygrove marked this pull request as ready for review April 28, 2026 23:49
@andygrove andygrove merged commit 2d41937 into apache:main Apr 28, 2026
5 checks passed
@andygrove andygrove deleted the spark-version-docs branch April 28, 2026 23:49
@andygrove
Copy link
Copy Markdown
Member Author

Thanks for the quick review @coderfender

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants