Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

kubernetes-e2e-gci-gke-prod: broken test run #33402

Closed
k8s-github-robot opened this issue Sep 23, 2016 · 26 comments
Closed

kubernetes-e2e-gci-gke-prod: broken test run #33402

k8s-github-robot opened this issue Sep 23, 2016 · 26 comments
Assignees
@apelisse
Labels
area/test-infra kind/flake Categorizes issue or PR as related to a flaky test. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.

Comments

@k8s-github-robot
Copy link

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/3/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 05:41:44.979: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-5a88c96e-pf5j:
 container "runtime": expected RSS memory (MB) < 89128960; got 105377792
node gke-jenkins-e2e-default-pool-5a88c96e-a3ub:
 container "runtime": expected RSS memory (MB) < 89128960; got 91398144

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] KubeProxy should test kube-proxy [Slow] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubeproxy.go:107
Expected error:
    <*errors.errorString | 0xc8200bf060>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
not to have occurred

Issues about this test specifically: #26490

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 01:30:42.477: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-5a88c96e-4q7q:
 container "runtime": expected RSS memory (MB) < 157286400; got 223215616
node gke-jenkins-e2e-default-pool-5a88c96e-a3ub:
 container "runtime": expected RSS memory (MB) < 157286400; got 225234944
node gke-jenkins-e2e-default-pool-5a88c96e-pf5j:
 container "runtime": expected RSS memory (MB) < 157286400; got 228036608

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Services should work after restarting kube-proxy [Disruptive] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:331
Expected error:
    <*errors.errorString | 0xc820b50410>: {
        s: "service verification failed for: 10.123.248.208\nexpected [service1-43oyr service1-ie1sp service1-wmhf9]\nreceived [service1-43oyr service1-wmhf9]",
    }
    service verification failed for: 10.123.248.208
    expected [service1-43oyr service1-ie1sp service1-wmhf9]
    received [service1-43oyr service1-wmhf9]
not to have occurred

Issues about this test specifically: #29514

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-23T09:56:40.848578748Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 04:00:31.072: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-5a88c96e-9wil:
 container "runtime": expected RSS memory (MB) < 314572800; got 528957440
node gke-jenkins-e2e-default-pool-5a88c96e-a3ub:
 container "runtime": expected RSS memory (MB) < 314572800; got 532905984
node gke-jenkins-e2e-default-pool-5a88c96e-pf5j:
 container "runtime": expected RSS memory (MB) < 314572800; got 538816512

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055
@k8s-github-robot k8s-github-robot added kind/flake Categorizes issue or PR as related to a flaky test. priority/backlog Higher priority than priority/awaiting-more-evidence. area/test-infra labels Sep 23, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/4/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 07:37:40.727: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-2e426346-9e91:
 container "runtime": expected RSS memory (MB) < 157286400; got 218996736
node gke-jenkins-e2e-default-pool-2e426346-feew:
 container "runtime": expected RSS memory (MB) < 157286400; got 230567936
node gke-jenkins-e2e-default-pool-2e426346-39bb:
 container "runtime": expected RSS memory (MB) < 157286400; got 224620544

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Services should work after restarting apiserver [Disruptive] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:372
Expected error:
    <*errors.errorString | 0xc820fef130>: {
        s: "service verification failed for: 10.123.242.99\nexpected [service1-1y0e2 service1-mle9a service1-pa38m]\nreceived [service1-1y0e2 service1-pa38m]",
    }
    service verification failed for: 10.123.242.99
    expected [service1-1y0e2 service1-mle9a service1-pa38m]
    received [service1-1y0e2 service1-pa38m]
not to have occurred

Issues about this test specifically: #28257 #29159 #29449 #32447

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 10:11:16.647: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-2e426346-39bb:
 container "runtime": expected RSS memory (MB) < 314572800; got 531218432
node gke-jenkins-e2e-default-pool-2e426346-9e91:
 container "runtime": expected RSS memory (MB) < 314572800; got 521695232
node gke-jenkins-e2e-default-pool-2e426346-feew:
 container "runtime": expected RSS memory (MB) < 314572800; got 527065088

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 11:26:59.904: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-2e426346-feew:
 container "runtime": expected RSS memory (MB) < 89128960; got 90628096
node gke-jenkins-e2e-default-pool-2e426346-39bb:
 container "runtime": expected RSS memory (MB) < 89128960; got 98828288

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] Services should work after restarting kube-proxy [Disruptive] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:331
Expected error:
    <*errors.errorString | 0xc826c92290>: {
        s: "service verification failed for: 10.123.251.88\nexpected [service2-5u2h6 service2-r15t5 service2-u07fh]\nreceived [service2-r15t5 service2-u07fh]",
    }
    service verification failed for: 10.123.251.88
    expected [service2-5u2h6 service2-r15t5 service2-u07fh]
    received [service2-r15t5 service2-u07fh]
not to have occurred

Issues about this test specifically: #29514

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/1/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 22 14:19:37.298: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-3a2d24ab-ejyi:
 container "runtime": expected RSS memory (MB) < 314572800; got 527900672
node gke-jenkins-e2e-default-pool-3a2d24ab-lo1u:
 container "runtime": expected RSS memory (MB) < 314572800; got 519188480
node gke-jenkins-e2e-default-pool-3a2d24ab-nlli:
 container "runtime": expected RSS memory (MB) < 314572800; got 527241216

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 22 16:22:13.316: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-3a2d24ab-lo1u:
 container "runtime": expected RSS memory (MB) < 89128960; got 93683712
node gke-jenkins-e2e-default-pool-3a2d24ab-nlli:
 container "runtime": expected RSS memory (MB) < 89128960; got 94846976

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 22 16:49:23.005: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-3a2d24ab-20zn:
 container "runtime": expected RSS memory (MB) < 157286400; got 228081664
node gke-jenkins-e2e-default-pool-3a2d24ab-lo1u:
 container "runtime": expected RSS memory (MB) < 157286400; got 241983488
node gke-jenkins-e2e-default-pool-3a2d24ab-nlli:
 container "runtime": expected RSS memory (MB) < 157286400; got 244031488

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Services should be able to change the type and ports of a service [Slow] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:725
Sep 22 13:30:56.815: Failed waiting for pods to be running: Timeout waiting for 1 pods to be ready

Issues about this test specifically: #26134

@k8s-github-robot k8s-github-robot added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. and removed priority/backlog Higher priority than priority/awaiting-more-evidence. labels Sep 23, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/2/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 22 22:14:22.539: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-01c6dcaf-ynwl:
 container "runtime": expected RSS memory (MB) < 314572800; got 515727360
node gke-jenkins-e2e-default-pool-01c6dcaf-zysx:
 container "runtime": expected RSS memory (MB) < 314572800; got 534396928
node gke-jenkins-e2e-default-pool-01c6dcaf-tee1:
 container "runtime": expected RSS memory (MB) < 314572800; got 539303936

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Services should work after restarting apiserver [Disruptive] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:372
Expected error:
    <*errors.errorString | 0xc821768950>: {
        s: "service verification failed for: 10.123.253.94\nexpected [service1-68lay service1-848u4 service1-ksk2z]\nreceived [service1-68lay service1-ksk2z]",
    }
    service verification failed for: 10.123.253.94
    expected [service1-68lay service1-848u4 service1-ksk2z]
    received [service1-68lay service1-ksk2z]
not to have occurred

Issues about this test specifically: #28257 #29159 #29449 #32447

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 22 23:16:04.788: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-01c6dcaf-tee1:
 container "runtime": expected RSS memory (MB) < 89128960; got 106905600
node gke-jenkins-e2e-default-pool-01c6dcaf-zysx:
 container "runtime": expected RSS memory (MB) < 89128960; got 89559040

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 00:18:05.316: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-01c6dcaf-tee1:
 container "runtime": expected RSS memory (MB) < 157286400; got 240476160
node gke-jenkins-e2e-default-pool-01c6dcaf-ynwl:
 container "runtime": expected RSS memory (MB) < 157286400; got 241627136
node gke-jenkins-e2e-default-pool-01c6dcaf-zysx:
 container "runtime": expected RSS memory (MB) < 157286400; got 253108224

Issues about this test specifically: #28220 #32942

@k8s-github-robot k8s-github-robot added priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. and removed priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Sep 23, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/5/

Multiple broken tests:

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 16:08:59.942: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-3af695d4-wtkk:
 container "runtime": expected RSS memory (MB) < 157286400; got 222064640
node gke-jenkins-e2e-default-pool-3af695d4-ofn8:
 container "runtime": expected RSS memory (MB) < 157286400; got 246542336
node gke-jenkins-e2e-default-pool-3af695d4-uwhz:
 container "runtime": expected RSS memory (MB) < 157286400; got 242987008

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 16:46:27.282: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-3af695d4-uwhz:
 container "runtime": expected RSS memory (MB) < 314572800; got 535003136
node gke-jenkins-e2e-default-pool-3af695d4-wtkk:
 container "runtime": expected RSS memory (MB) < 314572800; got 519675904
node gke-jenkins-e2e-default-pool-3af695d4-ofn8:
 container "runtime": expected RSS memory (MB) < 314572800; got 536793088

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 19:14:36.448: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-3af695d4-uwhz:
 container "runtime": expected RSS memory (MB) < 89128960; got 105689088

Issues about this test specifically: #26784 #28384 #31935 #33023

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/6/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 21:10:21.995: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-f465ebd5-ijrs:
 container "runtime": expected RSS memory (MB) < 314572800; got 521277440
node gke-jenkins-e2e-default-pool-f465ebd5-mzvn:
 container "runtime": expected RSS memory (MB) < 314572800; got 528400384
node gke-jenkins-e2e-default-pool-f465ebd5-u96m:
 container "runtime": expected RSS memory (MB) < 314572800; got 528560128

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 23 21:54:28.679: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-f465ebd5-ijrs:
 container "runtime": expected RSS memory (MB) < 89128960; got 92598272
node gke-jenkins-e2e-default-pool-f465ebd5-u96m:
 container "runtime": expected RSS memory (MB) < 89128960; got 91381760

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 24 00:34:31.087: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-f465ebd5-u96m:
 container "runtime": expected RSS memory (MB) < 157286400; got 246263808
node gke-jenkins-e2e-default-pool-f465ebd5-ijrs:
 container "runtime": expected RSS memory (MB) < 157286400; got 243499008
node gke-jenkins-e2e-default-pool-f465ebd5-mzvn:
 container "runtime": expected RSS memory (MB) < 157286400; got 250249216

Issues about this test specifically: #28220 #32942

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/7/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 24 06:52:46.116: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-f463ae9a-kefj:
 container "runtime": expected RSS memory (MB) < 157286400; got 220082176
node gke-jenkins-e2e-default-pool-f463ae9a-ltqr:
 container "runtime": expected RSS memory (MB) < 157286400; got 251453440
node gke-jenkins-e2e-default-pool-f463ae9a-svpy:
 container "runtime": expected RSS memory (MB) < 157286400; got 238915584

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 24 05:55:42.546: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-f463ae9a-svpy:
 container "runtime": expected RSS memory (MB) < 314572800; got 518127616
node gke-jenkins-e2e-default-pool-f463ae9a-jt48:
 container "runtime": expected RSS memory (MB) < 314572800; got 528207872
node gke-jenkins-e2e-default-pool-f463ae9a-ltqr:
 container "runtime": expected RSS memory (MB) < 314572800; got 526569472

Issues about this test specifically: #26982 #32214

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/8/

Multiple broken tests:

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 24 09:50:14.778: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-ee8084a2-hyac:
 container "runtime": expected RSS memory (MB) < 314572800; got 520200192
node gke-jenkins-e2e-default-pool-ee8084a2-3rrq:
 container "runtime": expected RSS memory (MB) < 314572800; got 521465856
node gke-jenkins-e2e-default-pool-ee8084a2-bzrn:
 container "runtime": expected RSS memory (MB) < 314572800; got 523759616

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] Services should be able to up and down services {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:279
Expected error:
    <*errors.errorString | 0xc8226c05f0>: {
        s: "service verification failed for: 10.123.250.59\nexpected [service1-3vuyr service1-iywnw service1-phxjr]\nreceived [service1-3vuyr service1-iywnw]",
    }
    service verification failed for: 10.123.250.59
    expected [service1-3vuyr service1-iywnw service1-phxjr]
    received [service1-3vuyr service1-iywnw]
not to have occurred

Issues about this test specifically: #26128 #26685 #33408

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 24 13:50:40.471: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-ee8084a2-bzrn:
 container "runtime": expected RSS memory (MB) < 157286400; got 246882304
node gke-jenkins-e2e-default-pool-ee8084a2-hyac:
 container "runtime": expected RSS memory (MB) < 157286400; got 247988224
node gke-jenkins-e2e-default-pool-ee8084a2-6a1s:
 container "runtime": expected RSS memory (MB) < 157286400; got 220794880

Issues about this test specifically: #28220 #32942

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/9/

Multiple broken tests:

Failed: [k8s.io] Probing container with readiness probe should not be ready before initial delay and never restart [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/container_probe.go:86
pod never became ready
Expected error:
    <*errors.errorString | 0xc8200e20c0>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
not to have occurred

Issues about this test specifically: #29521

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 25 15:11:28.478: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-43a2090c-k798:
 container "runtime": expected RSS memory (MB) < 157286400; got 231559168
node gke-jenkins-e2e-default-pool-43a2090c-lnl3:
 container "runtime": expected RSS memory (MB) < 157286400; got 225898496
node gke-jenkins-e2e-default-pool-43a2090c-rsw5:
 container "runtime": expected RSS memory (MB) < 157286400; got 227282944

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] KubeProxy should test kube-proxy [Slow] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubeproxy.go:107
Expected error:
    <*errors.errorString | 0xc8200e20c0>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
not to have occurred

Issues about this test specifically: #26490

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-25T23:42:54.589089284Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 25 17:59:04.380: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-43a2090c-e5l2:
 container "runtime": expected RSS memory (MB) < 314572800; got 527757312
node gke-jenkins-e2e-default-pool-43a2090c-lnl3:
 container "runtime": expected RSS memory (MB) < 314572800; got 535724032
node gke-jenkins-e2e-default-pool-43a2090c-rsw5:
 container "runtime": expected RSS memory (MB) < 314572800; got 535166976

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] Services should be able to up and down services {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:279
Expected error:
    <*errors.errorString | 0xc822506370>: {
        s: "service verification failed for: 10.123.249.10\nexpected [service1-klrzz service1-pse0f service1-stexy]\nreceived [service1-klrzz service1-stexy]",
    }
    service verification failed for: 10.123.249.10
    expected [service1-klrzz service1-pse0f service1-stexy]
    received [service1-klrzz service1-stexy]
not to have occurred

Issues about this test specifically: #26128 #26685 #33408

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/10/

Multiple broken tests:

Failed: [k8s.io] Networking [k8s.io] Granular Checks should function for pod communication between nodes {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/networking.go:267
Expected error:
    <*errors.errorString | 0xc821297690>: {
        s: "pod 'different-node-wget' terminated with failure: &{ExitCode:1 Signal:0 Reason:Error Message: StartedAt:{Time:2016-09-25 22:26:25 -0700 PDT} FinishedAt:{Time:2016-09-25 22:26:35 -0700 PDT} ContainerID:docker://9b84e16b821fde3634f40ef01c93b55307fc250d383dce36cd5016d96174ae22}",
    }
    pod 'different-node-wget' terminated with failure: &{ExitCode:1 Signal:0 Reason:Error Message: StartedAt:{Time:2016-09-25 22:26:25 -0700 PDT} FinishedAt:{Time:2016-09-25 22:26:35 -0700 PDT} ContainerID:docker://9b84e16b821fde3634f40ef01c93b55307fc250d383dce36cd5016d96174ae22}
not to have occurred

Issues about this test specifically: #30131 #31402

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T05:55:09.398931933Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Services should be able to up and down services {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:279
Expected error:
    <*errors.errorString | 0xc82168ddb0>: {
        s: "service verification failed for: 10.123.246.126\nexpected [service3-htijy service3-l8poq service3-yanrl]\nreceived [service3-htijy service3-l8poq]",
    }
    service verification failed for: 10.123.246.126
    expected [service3-htijy service3-l8poq service3-yanrl]
    received [service3-htijy service3-l8poq]
not to have occurred

Issues about this test specifically: #26128 #26685 #33408

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 25 18:52:41.829: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-6f73ba50-gcqw:
 container "runtime": expected RSS memory (MB) < 157286400; got 236605440
node gke-jenkins-e2e-default-pool-6f73ba50-phog:
 container "runtime": expected RSS memory (MB) < 157286400; got 248860672
node gke-jenkins-e2e-default-pool-6f73ba50-6bba:
 container "runtime": expected RSS memory (MB) < 157286400; got 242171904

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 25 21:26:14.156: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-6f73ba50-gcqw:
 container "runtime": expected RSS memory (MB) < 89128960; got 94912512

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 25 22:14:39.828: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-6f73ba50-gcqw:
 container "runtime": expected RSS memory (MB) < 314572800; got 529383424
node gke-jenkins-e2e-default-pool-6f73ba50-phog:
 container "runtime": expected RSS memory (MB) < 314572800; got 532209664
node gke-jenkins-e2e-default-pool-6f73ba50-9hs0:
 container "runtime": expected RSS memory (MB) < 314572800; got 533725184

Issues about this test specifically: #26982 #32214

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/11/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 06:17:53.156: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-88162709-rid8:
 container "runtime": expected RSS memory (MB) < 89128960; got 101199872
node gke-jenkins-e2e-default-pool-88162709-o9tj:
 container "runtime": expected RSS memory (MB) < 89128960; got 92762112

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T07:52:43.895442367Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 02:00:55.657: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-88162709-o9tj:
 container "runtime": expected RSS memory (MB) < 157286400; got 224616448
node gke-jenkins-e2e-default-pool-88162709-rid8:
 container "runtime": expected RSS memory (MB) < 157286400; got 243384320
node gke-jenkins-e2e-default-pool-88162709-t4sm:
 container "runtime": expected RSS memory (MB) < 157286400; got 227397632

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Nodes [Disruptive] [k8s.io] Network when a node becomes unreachable [replication controller] recreates pods scheduled on the unreachable node AND allows scheduling of pods on a node after it rejoins the cluster {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/resize_nodes.go:544
Expected error:
    <*errors.errorString | 0xc82391c400>: {
        s: "failed to wait for pods responding: timed out waiting for the condition",
    }
    failed to wait for pods responding: timed out waiting for the condition
not to have occurred

Issues about this test specifically: #27324

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 03:30:41.535: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-88162709-t4sm:
 container "runtime": expected RSS memory (MB) < 314572800; got 518729728
node gke-jenkins-e2e-default-pool-88162709-o9tj:
 container "runtime": expected RSS memory (MB) < 314572800; got 528072704
node gke-jenkins-e2e-default-pool-88162709-rid8:
 container "runtime": expected RSS memory (MB) < 314572800; got 537010176

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] Services should work after restarting apiserver [Disruptive] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:372
Expected error:
    <*errors.errorString | 0xc82399d7f0>: {
        s: "service verification failed for: 10.123.245.70\nexpected [service1-bnr8r service1-boerf service1-dnczq]\nreceived [service1-bnr8r service1-boerf]",
    }
    service verification failed for: 10.123.245.70
    expected [service1-bnr8r service1-boerf service1-dnczq]
    received [service1-bnr8r service1-boerf]
not to have occurred

Issues about this test specifically: #28257 #29159 #29449 #32447

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/12/

Multiple broken tests:

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-26T15:09:29.787246838Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 10:28:09.604: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-41998b4f-vbkz:
 container "runtime": expected RSS memory (MB) < 314572800; got 522137600
node gke-jenkins-e2e-default-pool-41998b4f-jsg8:
 container "runtime": expected RSS memory (MB) < 314572800; got 524574720
node gke-jenkins-e2e-default-pool-41998b4f-nsxa:
 container "runtime": expected RSS memory (MB) < 314572800; got 527597568

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 12:53:59.065: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-41998b4f-vbkz:
 container "runtime": expected RSS memory (MB) < 157286400; got 242700288
node gke-jenkins-e2e-default-pool-41998b4f-4jsy:
 container "runtime": expected RSS memory (MB) < 157286400; got 224997376
node gke-jenkins-e2e-default-pool-41998b4f-nsxa:
 container "runtime": expected RSS memory (MB) < 157286400; got 250195968

Issues about this test specifically: #28220 #32942

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/13/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 18:30:52.999: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-c950716b-qfyp:
 container "runtime": expected RSS memory (MB) < 157286400; got 245399552
node gke-jenkins-e2e-default-pool-c950716b-upiv:
 container "runtime": expected RSS memory (MB) < 157286400; got 243048448
node gke-jenkins-e2e-default-pool-c950716b-nboa:
 container "runtime": expected RSS memory (MB) < 157286400; got 229801984

Issues about this test specifically: #28220 #32942

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 14:29:53.802: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-c950716b-bli3:
 container "runtime": expected RSS memory (MB) < 314572800; got 539459584
node gke-jenkins-e2e-default-pool-c950716b-qfyp:
 container "runtime": expected RSS memory (MB) < 314572800; got 525017088
node gke-jenkins-e2e-default-pool-c950716b-upiv:
 container "runtime": expected RSS memory (MB) < 314572800; got 535179264

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 17:31:37.019: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-c950716b-qfyp:
 container "runtime": expected RSS memory (MB) < 89128960; got 92549120
node gke-jenkins-e2e-default-pool-c950716b-upiv:
 container "runtime": expected RSS memory (MB) < 89128960; got 90198016

Issues about this test specifically: #26784 #28384 #31935 #33023

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/14/

Multiple broken tests:

Failed: [k8s.io] Networking [k8s.io] Granular Checks should function for pod communication between nodes {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/networking.go:267
Expected error:
    <*errors.errorString | 0xc821416f00>: {
        s: "pod 'different-node-wget' terminated with failure: &{ExitCode:1 Signal:0 Reason:Error Message: StartedAt:{Time:2016-09-26 22:37:05 -0700 PDT} FinishedAt:{Time:2016-09-26 22:37:15 -0700 PDT} ContainerID:docker://de6e91d36618e655cdb490a2cd98143a25d1caad8c434369dccf46a560f97a1a}",
    }
    pod 'different-node-wget' terminated with failure: &{ExitCode:1 Signal:0 Reason:Error Message: StartedAt:{Time:2016-09-26 22:37:05 -0700 PDT} FinishedAt:{Time:2016-09-26 22:37:15 -0700 PDT} ContainerID:docker://de6e91d36618e655cdb490a2cd98143a25d1caad8c434369dccf46a560f97a1a}
not to have occurred

Issues about this test specifically: #30131 #31402

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 00:33:13.449: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-dc1b7e5a-py49:
 container "runtime": expected RSS memory (MB) < 314572800; got 530915328
node gke-jenkins-e2e-default-pool-dc1b7e5a-24f3:
 container "runtime": expected RSS memory (MB) < 314572800; got 531668992
node gke-jenkins-e2e-default-pool-dc1b7e5a-p1kj:
 container "runtime": expected RSS memory (MB) < 314572800; got 538271744

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T07:51:33.892658008Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 26 22:02:40.567: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-dc1b7e5a-py49:
 container "runtime": expected RSS memory (MB) < 157286400; got 224346112
node gke-jenkins-e2e-default-pool-dc1b7e5a-24f3:
 container "runtime": expected RSS memory (MB) < 157286400; got 222756864
node gke-jenkins-e2e-default-pool-dc1b7e5a-p1kj:
 container "runtime": expected RSS memory (MB) < 157286400; got 231362560

Issues about this test specifically: #28220 #32942

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/15/

Multiple broken tests:

Failed: [k8s.io] Services should be able to up and down services {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:279
Expected error:
    <*errors.errorString | 0xc8237d3830>: {
        s: "service verification failed for: 10.123.249.11\nexpected [service3-5uwv5 service3-8f7ze service3-yxopd]\nreceived [service3-8f7ze service3-yxopd]",
    }
    service verification failed for: 10.123.249.11
    expected [service3-5uwv5 service3-8f7ze service3-yxopd]
    received [service3-8f7ze service3-yxopd]
not to have occurred

Issues about this test specifically: #26128 #26685 #33408

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 02:56:42.755: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-7121e1c1-d17n:
 container "runtime": expected RSS memory (MB) < 157286400; got 226926592
node gke-jenkins-e2e-default-pool-7121e1c1-mxjg:
 container "runtime": expected RSS memory (MB) < 157286400; got 228265984
node gke-jenkins-e2e-default-pool-7121e1c1-quhl:
 container "runtime": expected RSS memory (MB) < 157286400; got 224489472

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 06:12:14.983: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-7121e1c1-mxjg:
 container "runtime": expected RSS memory (MB) < 314572800; got 532852736
node gke-jenkins-e2e-default-pool-7121e1c1-myzz:
 container "runtime": expected RSS memory (MB) < 314572800; got 515420160
node gke-jenkins-e2e-default-pool-7121e1c1-quhl:
 container "runtime": expected RSS memory (MB) < 314572800; got 529367040

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T13:21:28.313922179Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/16/

Multiple broken tests:

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-27T17:34:14.392389928Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 11:29:47.292: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-2fbbf6bd-l8s9:
 container "runtime": expected RSS memory (MB) < 157286400; got 227516416
node gke-jenkins-e2e-default-pool-2fbbf6bd-xe6w:
 container "runtime": expected RSS memory (MB) < 157286400; got 236654592
node gke-jenkins-e2e-default-pool-2fbbf6bd-emg3:
 container "runtime": expected RSS memory (MB) < 157286400; got 217317376

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 13:05:40.804: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-2fbbf6bd-xe6w:
 container "runtime": expected RSS memory (MB) < 314572800; got 537120768
node gke-jenkins-e2e-default-pool-2fbbf6bd-emg3:
 container "runtime": expected RSS memory (MB) < 314572800; got 530276352
node gke-jenkins-e2e-default-pool-2fbbf6bd-l8s9:
 container "runtime": expected RSS memory (MB) < 314572800; got 532996096

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055

Failed: [k8s.io] SchedulerPredicates [Serial] validates that taints-tolerations is respected if not matching {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/scheduler_predicates.go:1549
Expected error:
    <*errors.StatusError | 0xc821168f80>: {
        ErrStatus: {
            TypeMeta: {Kind: "Status", APIVersion: "v1"},
            ListMeta: {SelfLink: "", ResourceVersion: ""},
            Status: "Failure",
            Message: "Operation cannot be fulfilled on nodes \"gke-jenkins-e2e-default-pool-2fbbf6bd-9c64\": the object has been modified; please apply your changes to the latest version and try again",
            Reason: "Conflict",
            Details: {
                Name: "gke-jenkins-e2e-default-pool-2fbbf6bd-9c64",
                Group: "",
                Kind: "nodes",
                Causes: nil,
                RetryAfterSeconds: 0,
            },
            Code: 409,
        },
    }
    Operation cannot be fulfilled on nodes "gke-jenkins-e2e-default-pool-2fbbf6bd-9c64": the object has been modified; please apply your changes to the latest version and try again
not to have occurred

Issues about this test specifically: #27655

Failed: [k8s.io] Networking [k8s.io] Granular Checks should function for pod communication between nodes {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/networking.go:267
Expected error:
    <*errors.errorString | 0xc820508f50>: {
        s: "pod 'different-node-wget' terminated with failure: &{ExitCode:1 Signal:0 Reason:Error Message: StartedAt:{Time:2016-09-27 08:40:32 -0700 PDT} FinishedAt:{Time:2016-09-27 08:40:42 -0700 PDT} ContainerID:docker://e1294f1416d6884361c9cbbdb5e08540f206f3e8caf9125ee618179e3135597b}",
    }
    pod 'different-node-wget' terminated with failure: &{ExitCode:1 Signal:0 Reason:Error Message: StartedAt:{Time:2016-09-27 08:40:32 -0700 PDT} FinishedAt:{Time:2016-09-27 08:40:42 -0700 PDT} ContainerID:docker://e1294f1416d6884361c9cbbdb5e08540f206f3e8caf9125ee618179e3135597b}
not to have occurred

Issues about this test specifically: #30131 #31402

Failed: [k8s.io] Services should be able to up and down services {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:279
Expected error:
    <*errors.errorString | 0xc821b6e060>: {
        s: "service verification failed for: 10.123.244.15\nexpected [service3-bd1vi service3-hojis service3-qvj8l]\nreceived [service3-hojis service3-qvj8l]",
    }
    service verification failed for: 10.123.244.15
    expected [service3-bd1vi service3-hojis service3-qvj8l]
    received [service3-hojis service3-qvj8l]
not to have occurred

Issues about this test specifically: #26128 #26685 #33408

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/17/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 20:03:36.092: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-df4e7518-5ar7:
 container "runtime": expected RSS memory (MB) < 314572800; got 519204864
node gke-jenkins-e2e-default-pool-df4e7518-qifg:
 container "runtime": expected RSS memory (MB) < 314572800; got 526835712
node gke-jenkins-e2e-default-pool-df4e7518-zg2u:
 container "runtime": expected RSS memory (MB) < 314572800; got 540348416

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] SchedulerPredicates [Serial] validates resource limits of pods that are allowed to run [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/scheduler_predicates.go:389
Error waiting for 9 pods to be running - probably a timeout
Expected error:
    <*errors.errorString | 0xc82172f3d0>: {
        s: "Timeout while waiting for pods with labels \"startPodsID=30552cb2-84ff-11e6-a8eb-0242ac110002\" to be running",
    }
    Timeout while waiting for pods with labels "startPodsID=30552cb2-84ff-11e6-a8eb-0242ac110002" to be running
not to have occurred

Issues about this test specifically: #27115 #28070 #30747 #31341

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T00:54:50.898675097Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: Test {e2e.go}

error running Ginkgo tests: exit status 1

Issues about this test specifically: #33361

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 18:49:47.429: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-df4e7518-zg2u:
 container "runtime": expected RSS memory (MB) < 89128960; got 104685568

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 19:38:27.113: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-df4e7518-zg2u:
 container "runtime": expected RSS memory (MB) < 157286400; got 253992960
node gke-jenkins-e2e-default-pool-df4e7518-5ar7:
 container "runtime": expected RSS memory (MB) < 157286400; got 221089792
node gke-jenkins-e2e-default-pool-df4e7518-qifg:
 container "runtime": expected RSS memory (MB) < 157286400; got 221130752

Issues about this test specifically: #28220 #32942

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/18/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 28 01:55:07.256: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-2bde7f9f-0b2c:
 container "runtime": expected RSS memory (MB) < 157286400; got 249610240
node gke-jenkins-e2e-default-pool-2bde7f9f-ff0j:
 container "runtime": expected RSS memory (MB) < 157286400; got 239775744
node gke-jenkins-e2e-default-pool-2bde7f9f-n5ek:
 container "runtime": expected RSS memory (MB) < 157286400; got 227938304

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 21:29:59.634: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-2bde7f9f-ff0j:
 container "runtime": expected RSS memory (MB) < 314572800; got 524992512
node gke-jenkins-e2e-default-pool-2bde7f9f-0832:
 container "runtime": expected RSS memory (MB) < 314572800; got 519045120
node gke-jenkins-e2e-default-pool-2bde7f9f-0b2c:
 container "runtime": expected RSS memory (MB) < 314572800; got 518946816

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T04:34:55.979850085Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 27 23:53:02.736: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-2bde7f9f-0b2c:
 container "runtime": expected RSS memory (MB) < 89128960; got 103616512

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.000s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055 #33627

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/19/

Multiple broken tests:

Failed: [k8s.io] Services should be able to create a functioning NodePort service {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:406
Sep 28 03:59:58.343: Failed waiting for pods to be running: Timeout waiting for 1 pods to be ready

Issues about this test specifically: #28064 #28569

Failed: [k8s.io] Networking [k8s.io] Granular Checks should function for pod communication between nodes {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/networking.go:267
Expected error:
    <*errors.errorString | 0xc8211415a0>: {
        s: "pod 'different-node-wget' terminated with failure: &{ExitCode:1 Signal:0 Reason:Error Message: StartedAt:{Time:2016-09-28 04:21:41 -0700 PDT} FinishedAt:{Time:2016-09-28 04:21:51 -0700 PDT} ContainerID:docker://d4e71cd805d76d70e5c18cf444f69a1c52aa0b2e9782820ff0ca03e3d475546d}",
    }
    pod 'different-node-wget' terminated with failure: &{ExitCode:1 Signal:0 Reason:Error Message: StartedAt:{Time:2016-09-28 04:21:41 -0700 PDT} FinishedAt:{Time:2016-09-28 04:21:51 -0700 PDT} ContainerID:docker://d4e71cd805d76d70e5c18cf444f69a1c52aa0b2e9782820ff0ca03e3d475546d}
not to have occurred

Issues about this test specifically: #30131 #31402

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 28 05:11:19.588: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-775a7155-srrm:
 container "runtime": expected RSS memory (MB) < 314572800; got 521216000
node gke-jenkins-e2e-default-pool-775a7155-tbhf:
 container "runtime": expected RSS memory (MB) < 314572800; got 530235392
node gke-jenkins-e2e-default-pool-775a7155-rcmk:
 container "runtime": expected RSS memory (MB) < 314572800; got 519958528

Issues about this test specifically: #26982 #32214

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 28 05:59:05.589: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-775a7155-srrm:
 container "runtime": expected RSS memory (MB) < 157286400; got 243523584
node gke-jenkins-e2e-default-pool-775a7155-tbhf:
 container "runtime": expected RSS memory (MB) < 157286400; got 249761792
node gke-jenkins-e2e-default-pool-775a7155-rcmk:
 container "runtime": expected RSS memory (MB) < 157286400; got 241278976

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 28 07:23:07.332: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-775a7155-srrm:
 container "runtime": expected RSS memory (MB) < 89128960; got 90435584
node gke-jenkins-e2e-default-pool-775a7155-tbhf:
 container "runtime": expected RSS memory (MB) < 89128960; got 105906176

Issues about this test specifically: #26784 #28384 #31935 #33023

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/20/

Multiple broken tests:

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 0 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 28 13:13:51.590: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-9397072a-ef5g:
 container "runtime": expected RSS memory (MB) < 89128960; got 94031872
node gke-jenkins-e2e-default-pool-9397072a-l0g5:
 container "runtime": expected RSS memory (MB) < 89128960; got 90730496

Issues about this test specifically: #26784 #28384 #31935 #33023

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 35 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 28 14:15:33.199: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-9397072a-4ujd:
 container "runtime": expected RSS memory (MB) < 157286400; got 234983424
node gke-jenkins-e2e-default-pool-9397072a-ef5g:
 container "runtime": expected RSS memory (MB) < 157286400; got 249090048
node gke-jenkins-e2e-default-pool-9397072a-l0g5:
 container "runtime": expected RSS memory (MB) < 157286400; got 239992832

Issues about this test specifically: #28220 #32942

Failed: [k8s.io] Downward API volume should update annotations on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:134
Timed out after 45.001s.
Expected
    <string>: content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"
    content of file "/etc/annotations": builder="bar"
    kubernetes.io/config.seen="2016-09-28T22:10:06.446742884Z"
    kubernetes.io/config.source="api"

to contain substring
    <string>: builder="foo"

Issues about this test specifically: #28462

Failed: [k8s.io] Downward API volume should update labels on modification [Conformance] {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/downwardapi_volume.go:97
Timed out after 45.008s.
Expected
    <string>: content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"
    content of file "/etc/labels": key1="value1"
    key2="value2"

to contain substring
    <string>: key3="value3"

Issues about this test specifically: #28416 #31055 #33627

Failed: [k8s.io] Kubelet [Serial] [Slow] [k8s.io] regular resource usage tracking resource tracking for 100 pods per node {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubelet_perf.go:277
Sep 28 12:08:57.327: Memory usage exceeding limits:
 node gke-jenkins-e2e-default-pool-9397072a-4ujd:
 container "runtime": expected RSS memory (MB) < 314572800; got 517017600
node gke-jenkins-e2e-default-pool-9397072a-ef5g:
 container "runtime": expected RSS memory (MB) < 314572800; got 531742720
node gke-jenkins-e2e-default-pool-9397072a-l0g5:
 container "runtime": expected RSS memory (MB) < 314572800; got 523874304

Issues about this test specifically: #26982 #32214

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/23/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention.

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-e2e-gci-gke-prod/22/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention.

1 similar comment
@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention.

@ixdy ixdy closed this as completed Oct 4, 2016
@k8s-github-robot k8s-github-robot mentioned this issue Oct 21, 2016
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@apelisse apelisse

Labels
area/test-infra kind/flake Categorizes issue or PR as related to a flaky test. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@apelisse @ixdy @k8s-github-robot