Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture #26254

Closed
wants to merge 2 commits into from

Conversation

vibhutisawant
Copy link

continuation to #24861

As mentioned by @srowen, added changes specific to s390x on branch-2.4.

The change is in the master branch so it will be released with Spark 3.0 right now. It is not in branch-2.4 or others. I'm saying it's fine to open a PR for 2.4 too, as it needs a very slightly different change, and then it could be part of 2.4. Yes, you need a new PR. This one is merged and does not cherry-pick into 2.4.

Please review.

changes specific to s390x
Copy link
Member

@srowen srowen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks OK pending one more comment / tests

@@ -47,7 +47,7 @@
static {
boolean _unaligned;
String arch = System.getProperty("os.arch", "");
if (arch.equals("ppc64le") || arch.equals("ppc64")) {
if (arch.equals("ppc64le") || arch.equals("ppc64") || arch.matches("s390x")) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

arch.equals()?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added a commit with the change arch.equals("s390x"), as it is on master branch.

@SparkQA
Copy link

SparkQA commented Oct 25, 2019

Test build #4905 has finished for PR 26254 at commit 7458f4e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Added arch.equals("s390x")
@SparkQA
Copy link

SparkQA commented Oct 28, 2019

Test build #4906 has started for PR 26254 at commit 0ad7802.

@SparkQA
Copy link

SparkQA commented Oct 29, 2019

Test build #4907 has finished for PR 26254 at commit 0ad7802.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

srowen pushed a commit that referenced this pull request Oct 29, 2019
…s " for big endian architecture

continuation to #24861

As mentioned by srowen, added changes specific to s390x on branch-2.4.
> The change is in the master branch so it will be released with Spark 3.0 right now. It is not in branch-2.4 or others. I'm saying it's fine to open a PR for 2.4 too, as it needs a very slightly different change, and then it could be part of 2.4. Yes, you need a new PR. This one is merged and does not cherry-pick into 2.4.

Please review.

Closes #26254 from vibhutisawant/branch-2.4.

Authored-by: vibhutisawant <41043754+vibhutisawant@users.noreply.github.com>
Signed-off-by: Sean Owen <sean.owen@databricks.com>
@srowen
Copy link
Member

srowen commented Oct 29, 2019

Merged to 2.4

@srowen srowen closed this Oct 29, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
4 participants