New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-33728][CORE][K8S] Debug the Jenkins CI K8s failures #30435

Closed

holdenk wants to merge 9 commits into apache:master from holdenk:wtf-bbq-thing

Contributor

holdenk commented Nov 19, 2020

What changes were proposed in this pull request?

Collect executor log info during the decommissioning integration test on Kube.

Why are the changes needed?

After the Jenkins upgrade the test is failing and there is not enough info in the driver log only to debug this.

Does this PR introduce any user-facing change?

No

How was this patch tested?

N/A

github-actions bot added the KUBERNETES label

SparkQA commented Nov 19, 2020

Test build #131373 has finished for PR 30435 at commit 3048cc6.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA commented Nov 19, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35976/

SparkQA commented Nov 19, 2020

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35976/

github-actions bot added the CORE label

SparkQA commented Nov 20, 2020

Test build #131440 has finished for PR 30435 at commit 5b4ab2a.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA commented Nov 20, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36045/

SparkQA commented Nov 20, 2020

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36045/

SparkQA commented Nov 20, 2020

Test build #131455 has finished for PR 30435 at commit 1e2d04e.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA commented Nov 21, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36061/

SparkQA commented Nov 21, 2020

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/36061/

holdenk force-pushed the wtf-bbq-thing branch from 1e2d04e to e441108 Compare

December 9, 2020 18:43

SparkQA commented Dec 9, 2020

Test build #132506 has finished for PR 30435 at commit e441108.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA commented Dec 9, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37108/

SparkQA commented Dec 9, 2020

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37108/

SparkQA commented Dec 9, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37116/

SparkQA commented Dec 9, 2020

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37116/

SparkQA commented Dec 9, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37121/

SparkQA commented Dec 9, 2020

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37121/

SparkQA commented Dec 10, 2020

Test build #132514 has finished for PR 30435 at commit 691cb53.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

holdenk changed the title ~~[DONOTMERGE][DEBUGGING][CORE][K8S] Debug the Jenkins CI K8s failures~~ [SPARK-33728][CORE][K8S] Debug the Jenkins CI K8s failures

SparkQA commented Dec 10, 2020

Test build #132519 has finished for PR 30435 at commit 937d3ad.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Contributor Author

holdenk commented Dec 10, 2020

Jenkins retest this please.

SparkQA commented Dec 10, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37194/

SparkQA commented Dec 10, 2020

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37194/

holdenk force-pushed the wtf-bbq-thing branch from 937d3ad to 7db707e Compare

December 10, 2020 22:03

SparkQA commented Dec 10, 2020

Test build #132589 has finished for PR 30435 at commit 937d3ad.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA commented Dec 10, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37198/

SparkQA commented Dec 10, 2020

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37198/

SparkQA commented Dec 10, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37199/

SparkQA commented Dec 10, 2020

Test build #132593 has finished for PR 30435 at commit 7db707e.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA commented Dec 11, 2020

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37199/

SparkQA commented Dec 11, 2020

Test build #132594 has finished for PR 30435 at commit 23d52ae.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

holdenk added 9 commits

December 11, 2020 14:49


          Try and collect some logging information from the executors when thin…

ca63c87

…gs go boom but only in Jenkins


          type fix in tracking

d74e830


          Wait it's the basic case that's failing in Jenkins not decom with cle…

e8886b2

…anup


          Improve logging, allow different exit conditions


          Fix long line

b23582f


          Fix style

bc47e17


          Remove extra space

1eea6b0


          remove comment that doesn't really make sense

011f4db


          Handle the pod exiting while we're still collecting log info

4cb5aa3

holdenk force-pushed the wtf-bbq-thing branch from 23d52ae to 4cb5aa3 Compare

December 11, 2020 22:49

SparkQA commented Dec 11, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37281/

SparkQA commented Dec 12, 2020

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37281/

SparkQA commented Dec 12, 2020

Test build #132678 has finished for PR 30435 at commit 4cb5aa3.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Contributor Author

holdenk commented Dec 18, 2020

Jenkins retest this please.

SparkQA commented Dec 18, 2020

Test build #133035 has finished for PR 30435 at commit 4cb5aa3.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Contributor Author

holdenk commented Dec 21, 2020

Jenkins retest this please.

SparkQA commented Dec 21, 2020

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37779/

SparkQA commented Dec 21, 2020

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37779/

SparkQA commented Dec 21, 2020

Test build #133181 has finished for PR 30435 at commit 4cb5aa3.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

holdenk closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment