Spark 3.4 | 3.5: Backport enable remote scan planning #14963
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
singhpk234
requested review from
huaxingao and
nastra
and removed request for
nastra
Contributor
|
@singhpk234 Do you mean backport the work in #14822? you have #14615 in the PR's description. |
Contributor
Author
|
you are right backport #14822, updated the description |
Contributor
Author
|
[Update: Done] |
sfc-gh-prsingh
force-pushed
the
feature/spark-remote-scan
branch
from
7ed0041 to
fee2dd6
Compare
huaxingao
approved these changes
Jan 5, 2026
Contributor
Author
|
Thanks @huaxingao ! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
About change
Remote Scan planning should work with spark versions 3.4 | 3.5, there is no spark specific changes required all changes are in core unlike VARIANT (was debugging something stumbled on this)
This pr essentially backports the work done in spark 4.0 | 4.1