-
Notifications
You must be signed in to change notification settings - Fork 28.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture #26254
Conversation
changes specific to s390x
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks OK pending one more comment / tests
@@ -47,7 +47,7 @@ | |||
static { | |||
boolean _unaligned; | |||
String arch = System.getProperty("os.arch", ""); | |||
if (arch.equals("ppc64le") || arch.equals("ppc64")) { | |||
if (arch.equals("ppc64le") || arch.equals("ppc64") || arch.matches("s390x")) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
arch.equals()
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added a commit with the change arch.equals("s390x")
, as it is on master branch.
Test build #4905 has finished for PR 26254 at commit
|
Added arch.equals("s390x")
Test build #4906 has started for PR 26254 at commit |
Test build #4907 has finished for PR 26254 at commit
|
…s " for big endian architecture continuation to #24861 As mentioned by srowen, added changes specific to s390x on branch-2.4. > The change is in the master branch so it will be released with Spark 3.0 right now. It is not in branch-2.4 or others. I'm saying it's fine to open a PR for 2.4 too, as it needs a very slightly different change, and then it could be part of 2.4. Yes, you need a new PR. This one is merged and does not cherry-pick into 2.4. Please review. Closes #26254 from vibhutisawant/branch-2.4. Authored-by: vibhutisawant <41043754+vibhutisawant@users.noreply.github.com> Signed-off-by: Sean Owen <sean.owen@databricks.com>
Merged to 2.4 |
continuation to #24861
As mentioned by @srowen, added changes specific to s390x on branch-2.4.
Please review.