Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-35463][BUILD][FOLLOWUP] Redirect output for skipping checksum check #32637

Closed
wants to merge 1 commit into from

Conversation

viirya
Copy link
Member

@viirya viirya commented May 23, 2021

What changes were proposed in this pull request?

This patch is a followup of SPARK-35463. In SPARK-35463, we output a message to stdout and now we redirect it to stderr.

Why are the changes needed?

All echo statements in build/mvn should redirect to stderr if it is not followed by exit. It is because we use build/mvn to get stdout output by other scripts. If we don't redirect it, we can get invalid output, e.g. got "Skipping checksum because shasum is not installed." as commons-cli version.

Does this PR introduce any user-facing change?

No. Dev only.

How was this patch tested?

Manually test on internal system.

@github-actions github-actions bot added the BUILD label May 23, 2021
@viirya
Copy link
Member Author

viirya commented May 23, 2021

@SparkQA
Copy link

SparkQA commented May 23, 2021

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43359/

@dongjoon-hyun
Copy link
Member

Thank you so much, @viirya .
Merged to master/3.1/3.0.

dongjoon-hyun pushed a commit that referenced this pull request May 23, 2021
…check

### What changes were proposed in this pull request?

This patch is a followup of SPARK-35463. In SPARK-35463, we output a message to stdout and now we redirect it to stderr.

### Why are the changes needed?

All `echo` statements in `build/mvn` should redirect to stderr if it is not followed by `exit`. It is because we use `build/mvn` to get stdout output by other scripts. If we don't redirect it, we can get invalid output, e.g. got "Skipping checksum because shasum is not installed." as `commons-cli` version.

### Does this PR introduce _any_ user-facing change?

No. Dev only.

### How was this patch tested?

Manually test on internal system.

Closes #32637 from viirya/fix-build.

Authored-by: Liang-Chi Hsieh <viirya@gmail.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
(cherry picked from commit 594ffd2)
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
dongjoon-hyun pushed a commit that referenced this pull request May 23, 2021
…check

### What changes were proposed in this pull request?

This patch is a followup of SPARK-35463. In SPARK-35463, we output a message to stdout and now we redirect it to stderr.

### Why are the changes needed?

All `echo` statements in `build/mvn` should redirect to stderr if it is not followed by `exit`. It is because we use `build/mvn` to get stdout output by other scripts. If we don't redirect it, we can get invalid output, e.g. got "Skipping checksum because shasum is not installed." as `commons-cli` version.

### Does this PR introduce _any_ user-facing change?

No. Dev only.

### How was this patch tested?

Manually test on internal system.

Closes #32637 from viirya/fix-build.

Authored-by: Liang-Chi Hsieh <viirya@gmail.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
(cherry picked from commit 594ffd2)
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
@viirya
Copy link
Member Author

viirya commented May 23, 2021

Thank you @dongjoon-hyun

@maropu
Copy link
Member

maropu commented May 23, 2021

late lgtm.

@viirya
Copy link
Member Author

viirya commented May 23, 2021

Thanks @maropu

@SparkQA
Copy link

SparkQA commented May 23, 2021

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43359/

@SparkQA
Copy link

SparkQA commented May 23, 2021

Test build #138837 has finished for PR 32637 at commit ddf59db.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

flyrain pushed a commit to flyrain/spark that referenced this pull request Sep 21, 2021
…check

This patch is a followup of SPARK-35463. In SPARK-35463, we output a message to stdout and now we redirect it to stderr.

All `echo` statements in `build/mvn` should redirect to stderr if it is not followed by `exit`. It is because we use `build/mvn` to get stdout output by other scripts. If we don't redirect it, we can get invalid output, e.g. got "Skipping checksum because shasum is not installed." as `commons-cli` version.

No. Dev only.

Manually test on internal system.

Closes apache#32637 from viirya/fix-build.

Authored-by: Liang-Chi Hsieh <viirya@gmail.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
(cherry picked from commit 594ffd2)
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
@viirya viirya deleted the fix-build branch December 27, 2023 18:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
4 participants