Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[k8s.io] Probing container should *not* be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite} #30714

Closed
k8s-github-robot opened this issue Aug 16, 2016 · 58 comments
Assignees
Labels
area/node-e2e kind/flake Categorizes issue or PR as related to a flaky test. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. sig/node Categorizes an issue or PR as relevant to SIG Node.

Comments

@k8s-github-robot
Copy link

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30673/node-pull-build-e2e-test/19216/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 16 21:43:59.508: pod e2e-tests-container-probe-x6g5s/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30673.

Previous issues for this test: #30335

@k8s-github-robot k8s-github-robot added priority/backlog Higher priority than priority/awaiting-more-evidence. kind/flake Categorizes issue or PR as related to a flaky test. labels Aug 16, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubelet-gce-e2e-ci/8411/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 16 21:54:19.888: pod e2e-tests-container-probe-dyn3i/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/25524/node-pull-build-e2e-test/19300/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 17 03:56:19.073: pod e2e-tests-container-probe-jhcjc/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #25524.

@k8s-github-robot k8s-github-robot added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. and removed priority/backlog Higher priority than priority/awaiting-more-evidence. labels Aug 17, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/29551/node-pull-build-e2e-test/19377/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 17 12:01:38.335: pod e2e-tests-container-probe-9l549/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #29551.

@k8s-github-robot k8s-github-robot added priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. and removed priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Aug 17, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/29006/node-pull-build-e2e-test/19387/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 17 13:07:18.221: pod e2e-tests-container-probe-v1nng/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #29006.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30658/node-pull-build-e2e-test/19437/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 17 17:42:45.078: pod e2e-tests-container-probe-ho2xq/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30658.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/29639/node-pull-build-e2e-test/19448/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 17 18:08:25.377: pod e2e-tests-container-probe-vc2az/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #29639.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/27778/node-pull-build-e2e-test/19473/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 17 19:32:29.494: pod e2e-tests-container-probe-2n44y/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #27778.

@Random-Liu
Copy link
Member

Also assign @coufon to help debug this. Thanks @coufon !

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30798/node-pull-build-e2e-test/19510/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 17 21:25:29.065: pod e2e-tests-container-probe-6qajw/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30798.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30658/node-pull-build-e2e-test/19560/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 18 00:15:59.031: pod e2e-tests-container-probe-h1pjx/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30658.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubelet-gce-e2e-ci/8451/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 18 05:12:19.145: pod e2e-tests-container-probe-rvsbl/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30893/node-pull-build-e2e-test/19734/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 18 16:12:58.324: pod e2e-tests-container-probe-tgiyy/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30893.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30906/node-pull-build-e2e-test/19765/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 18 18:07:26.390: pod e2e-tests-container-probe-gzzt3/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30906.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30569/node-pull-build-e2e-test/19777/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 18 18:41:52.984: pod e2e-tests-container-probe-2awwg/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30569.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30888/node-pull-build-e2e-test/19973/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 19 09:22:39.813: pod e2e-tests-container-probe-strc2/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30888.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30985/node-pull-build-e2e-test/19976/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 19 10:07:51.052: pod e2e-tests-container-probe-v6dnt/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30985.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30995/node-pull-build-e2e-test/20026/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 19 13:54:41.991: pod e2e-tests-container-probe-jaelw/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30995.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/29049/node-pull-build-e2e-test/20038/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 19 14:46:20.223: pod e2e-tests-container-probe-rcamt/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #29049.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30513/node-pull-build-e2e-test/20070/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 19 16:14:18.729: pod e2e-tests-container-probe-m1bal/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30513.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30840/node-pull-build-e2e-test/20090/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 19 17:27:18.514: pod e2e-tests-container-probe-jtksy/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30840.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/27880/node-pull-build-e2e-test/20105/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 19 18:01:37.087: pod e2e-tests-container-probe-v85sl/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #27880.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30829/node-pull-build-e2e-test/20125/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 19 19:04:59.703: pod e2e-tests-container-probe-e6mmf/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30829.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31125/node-pull-build-e2e-test/20952/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 23 19:27:45.435: pod e2e-tests-container-probe-j8yu1/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #31125.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31052/node-pull-build-e2e-test/20973/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 23 22:18:39.339: pod e2e-tests-container-probe-s20yl/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #31052.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30649/node-pull-build-e2e-test/21028/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 24 05:12:03.484: pod e2e-tests-container-probe-jqky0/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #30649.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/26926/node-pull-build-e2e-test/21035/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 24 05:54:30.569: pod e2e-tests-container-probe-wsy3z/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #26926.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/19343/node-pull-build-e2e-test/21096/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 24 15:38:23.223: pod e2e-tests-container-probe-m7zpo/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #19343.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/27180/node-pull-build-e2e-test/21137/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 24 19:38:35.077: pod e2e-tests-container-probe-e3pwp/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #27180.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31373/node-pull-build-e2e-test/21160/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 24 21:21:29.248: pod e2e-tests-container-probe-qoi2l/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #31373.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31375/node-pull-build-e2e-test/21269/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 25 08:56:48.324: pod e2e-tests-container-probe-63wn6/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #31375.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31426/node-pull-build-e2e-test/21306/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 25 15:15:58.863: pod e2e-tests-container-probe-2hw0x/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #31426.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31390/node-pull-build-e2e-test/21414/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 25 23:10:50.438: pod e2e-tests-container-probe-jf67b/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #31390.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31470/node-pull-build-e2e-test/21425/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 26 00:00:10.437: pod e2e-tests-container-probe-1gok9/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #31470.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31476/node-pull-build-e2e-test/21431/

Failed: [k8s.io] Probing container should not be restarted with a /healthz http liveness probe [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:233
Aug 26 00:12:54.767: pod e2e-tests-container-probe-ej0uk/liveness-http - expected number of restarts: 0, found restarts: 1
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/container_probe.go:373

Happened on a presubmit run in #31476.

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @Random-Liu @coufon

This flaky-test issue would love to have more attention...

@yujuhong yujuhong added sig/node Categorizes an issue or PR as relevant to SIG Node. area/node-e2e labels Aug 30, 2016
@Random-Liu
Copy link
Member

Random-Liu commented Aug 30, 2016

Some background of the flaky test:

  • The test is testing readiness probe, and expect that a good container should not be restarted. However, sometimes the container does get restarted.
  • The test only run in cluster e2e before, it used gcr.io/google_containers/nettest:1.7 and readiness timeout is 10s.
  • The original nettest image needs access to apiserver and token files, we can't use it in node e2e. So when I moved it to shared directory, I changed the test image to gcr.io/google_containers/nginx-slim:0.7 which is just a nginx server.
    4) At first, I didn't set the readiness timeout, it was using the default value 1s. At that time, it flaked both in node e2e and cluster e2e.
    5) Then I changed the readiness timeout to 5s, after that it only flakes on node e2e now.

Some possible reasons:

  1. The network setting in the node e2e environment is not configured properly.
  2. The new test image is not stable.
  3. There is a bug in our code, and it has been there for a long time, it just exposed by node e2e, because we run it more frequently, and operations in local environment are faster than cluster e2e.

Both @coufon and I have tried to reproduce locally, but can't get a reproduce yet.

@Random-Liu
Copy link
Member

More interesting thing is that it doesn't flake anymore since 5 days ago.
@freehan Did we merge some container network fix around that time?

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @Random-Liu @coufon

This flaky-test issue would love to have more attention.

2 similar comments
@k8s-github-robot
Copy link
Author

[FLAKE-PING] @Random-Liu @coufon

This flaky-test issue would love to have more attention.

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @Random-Liu @coufon

This flaky-test issue would love to have more attention.

@Random-Liu
Copy link
Member

The test never fails again from 6 days ago, I guess some container network change fixed this. Close this one. Feel free to reopen if this happens again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/node-e2e kind/flake Categorizes issue or PR as related to a flaky test. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. sig/node Categorizes an issue or PR as relevant to SIG Node.
Projects
None yet
Development

No branches or pull requests

5 participants