Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite} #30548

Closed
k8s-github-robot opened this issue Aug 12, 2016 · 54 comments
Assignees
Labels
area/node-e2e kind/flake Categorizes issue or PR as related to a flaky test. sig/node Categorizes an issue or PR as relevant to SIG Node.

Comments

@k8s-github-robot
Copy link

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30200/node-pull-build-e2e-test/18598/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-e53ade43-60d5-11e6-9439-42010a800020
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2105

Happened on a presubmit run in #30200.

@k8s-github-robot k8s-github-robot added priority/backlog Higher priority than priority/awaiting-more-evidence. kind/flake Categorizes issue or PR as related to a flaky test. labels Aug 12, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30844/node-pull-build-e2e-test/19601/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-48c86d58-64f4-11e6-9028-42010a80002a
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

Happened on a presubmit run in #30844.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30865/node-pull-build-e2e-test/19669/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-13e2dfd7-653b-11e6-9bee-42010a800019
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

Happened on a presubmit run in #30865.

@k8s-github-robot k8s-github-robot added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. and removed priority/backlog Higher priority than priority/awaiting-more-evidence. labels Aug 18, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30940/node-pull-build-e2e-test/19861/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-cac6d765-6599-11e6-8926-42010a800006
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

Happened on a presubmit run in #30940.

@k8s-github-robot k8s-github-robot added priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. and removed priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Aug 18, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/26057/node-pull-build-e2e-test/20100/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-bca8214f-6634-11e6-911a-42010a800016
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

Happened on a presubmit run in #26057.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30713/node-pull-build-e2e-test/20118/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-ba1a4f84-663b-11e6-90f5-42010a800013
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

Happened on a presubmit run in #30713.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubelet-gce-e2e-ci/8513/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-a2d08cc9-6697-11e6-90dd-42010a800010
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/28921/node-pull-build-e2e-test/20254/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-30665fdb-669e-11e6-a226-42010a800010
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

Happened on a presubmit run in #28921.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31039/node-pull-build-e2e-test/20299/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-6a52abe0-66f7-11e6-8c13-42010a800007
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

Happened on a presubmit run in #31039.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/29741/node-pull-build-e2e-test/20302/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-6b3ca8a7-66fd-11e6-ae27-42010a800005
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

Happened on a presubmit run in #29741.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubelet-gce-e2e-ci/8533/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-5687d769-6718-11e6-9c00-42010a800009
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2108

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30730/node-pull-build-e2e-test/20423/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-435140b1-67fb-11e6-aa6e-42010a800004
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #30730.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubelet-gce-e2e-ci/8594/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-97d105e6-68b1-11e6-9674-42010a800017
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31139/node-pull-build-e2e-test/20664/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-54b0c320-68af-11e6-b262-42010a800027
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #31139.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31139/node-pull-build-e2e-test/20708/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-c5d9253c-68bf-11e6-a683-42010a800027
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #31139.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30931/node-pull-build-e2e-test/20716/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-3252e6f0-68c2-11e6-a62c-42010a800022
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #30931.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31177/node-pull-build-e2e-test/20741/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-826d4527-68ce-11e6-a06a-42010a800014
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #31177.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30787/node-pull-build-e2e-test/20766/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-cb6f1232-68de-11e6-9259-42010a800012
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #30787.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31330/node-pull-build-e2e-test/21042/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-0ce6fe4e-69d0-11e6-ba33-42010a80000b
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #31330.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31159/node-pull-build-e2e-test/21063/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-6433bb3b-69e8-11e6-94b9-42010a800009
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #31159.

@dchen1107
Copy link
Member

@euank I think you are right that the issue is not limited to coreos image. Re-assign it back to me.

@dchen1107 dchen1107 assigned dchen1107 and unassigned euank Aug 30, 2016
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31642/node-pull-build-e2e-test/22054/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-63bcb007-6ef9-11e6-bdc4-42010a800009
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #31642.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubelet-gce-e2e-ci/8860/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-49cb7928-6f12-11e6-b1d0-42010a800009
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31769/node-pull-build-e2e-test/22104/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-2b39ee60-6f38-11e6-aaef-42010a800006
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #31769.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/31644/node-pull-build-e2e-test/22106/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-be84617d-6f3b-11e6-8b2b-42010a800007
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT_HTTPS=443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2118

Happened on a presubmit run in #31644.

@timstclair
Copy link

Should we remove the non-release-blocker label if this is not limited to coreos?

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubelet-gce-e2e-ci/8882/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_PORT=tcp://10.0.0.1:443
    KUBERNETES_SERVICE_PORT=443
    HOSTNAME=client-envvars-3b4b2459-6f9c-11e6-bd7d-42010a800004
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/kubelet-gce-e2e-ci/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2125

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/30739/node-pull-build-e2e-test/22156/

Failed: [k8s.io] Pods should contain environment variables for services [Conformance] {E2eNode Suite}

/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/pods.go:445
"FOOSERVICE_SERVICE_HOST=" in container output
Expected
    <string>: KUBERNETES_SERVICE_PORT=443
    KUBERNETES_PORT=tcp://10.0.0.1:443
    HOSTNAME=client-envvars-99909165-6f9d-11e6-b473-42010a80000c
    SHLVL=1
    HOME=/root
    KUBERNETES_PORT_443_TCP_ADDR=10.0.0.1
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    KUBERNETES_PORT_443_TCP_PORT=443
    KUBERNETES_PORT_443_TCP_PROTO=tcp
    KUBERNETES_SERVICE_PORT_HTTPS=443
    KUBERNETES_PORT_443_TCP=tcp://10.0.0.1:443
    PWD=/
    KUBERNETES_SERVICE_HOST=10.0.0.1

to contain substring
    <string>: FOOSERVICE_SERVICE_HOST=
/var/lib/jenkins/workspace/node-pull-build-e2e-test/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2125

Happened on a presubmit run in #30739.

@timstclair
Copy link

From comment in kubelet.go:

    // Note that there is a race between Kubelet seeing the pod and kubelet seeing the service.
    // To avoid this users can: (1) wait between starting a service and starting; or (2) detect
    // missing service env var and exit and be restarted; or (3) use DNS instead of env vars
    // and keep trying to resolve the DNS name of the service (recommended).

I think that's probably what's happening here.

@yujuhong
Copy link
Contributor

Sounds like increasing the wait time should help?

@timstclair
Copy link

It should, but we would need to wait before the pod is created. Is there a way to tell whether the Kubelet has found the service?

@yujuhong
Copy link
Contributor

Not that I know of, unless we expose the information through an endpoint, which sounds like an overkill :
Since it's mainly the watch delay, could we get by with some arbitrary wait time such as 5 seconds?

@euank
Copy link
Contributor

euank commented Aug 31, 2016

We could also modify the test to take the advice of "detect the missing env-var and restart". If the test doesn't fatal out when the service environment variables aren't there, but instead re-runs the client up to some duration of retries, that would make it less flaky. And we can at least assert that "within 1 minute the environment variables definitely should have propagated, else this is a bug" I'd think.

@timstclair
Copy link

We might be able to do something fancy with InitContainers, but I think @euank 's suggestion is probably the way to go.

@yujuhong
Copy link
Contributor

We could also modify the test to take the advice of "detect the missing env-var and restart". If the test doesn't fatal out when the service environment variables aren't there, but instead re-runs the client up to some duration of retries, that would make it less flaky

I also thought about letting the container fail and restart, but decided against it since I didn't like relying on kubelet's restart backoff interval. Recreating the pod sounds ok.

@timstclair
Copy link

What about making the pod restart on failure, and changing the command to sh -c 'env | grep "FOOSERVICE_"? We wouldn't have as much control over the number of retries though.

@yujuhong
Copy link
Contributor

What about making the pod restart on failure, and changing the command to sh -c 'env | grep "FOOSERVICE_"? We wouldn't have as much control over the number of retries though.

That's what I originally wanted, but then decided not to suggest it because we don't have control over kubelet restart's backoff. Although I think it should work in general.

@timstclair
Copy link

Ok, I'll send a PR to add manual retries.

@timstclair timstclair assigned timstclair and unassigned dchen1107 Aug 31, 2016
k8s-github-robot pushed a commit that referenced this issue Sep 1, 2016
Automatic merge from submit-queue

Add retries to service environment variable test

Fixes (hopefully): #30548 (comment)

/cc @euank @dchen1107
@yujuhong yujuhong removed the priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. label Sep 1, 2016
@timstclair
Copy link

Hopefully this is fixed. We'll reopen if it happens again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/node-e2e kind/flake Categorizes issue or PR as related to a flaky test. sig/node Categorizes an issue or PR as relevant to SIG Node.
Projects
None yet
Development

No branches or pull requests

8 participants