Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flake: Services should serve identically named services in different namespaces on different load-balancers #16285

Closed
lavalamp opened this issue Oct 26, 2015 · 10 comments
Closed

Flake: Services should serve identically named services in different namespaces on different load-balancers #16285

lavalamp opened this issue Oct 26, 2015 · 10 comments
Assignees
@thockin
Labels
kind/flake Categorizes issue or PR as related to a flaky test. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.

Comments

@lavalamp
Copy link
Member

Blocking merges, P0

Services should serve identically named services in different namespaces on different load-balancers

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:870
Error waiting for the url http://146.148.83.214:31011 to be reachable
Expected error:
    <*errors.errorString | 0xc208143390>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
not to have occurred

http://kubekins.dls.corp.google.com/view/Critical%20Builds/job/kubernetes-e2e-gce-parallel/10319/

10:06:14 ------------------------------
10:06:30 [BeforeEach] Services
10:06:30   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework.go:51
10:06:30 STEP: Creating a kubernetes client
10:06:30 >>> testContext.KubeConfig: /var/lib/jenkins/jobs/kubernetes-e2e-gce-parallel/workspace/.kube/config
10:06:30 STEP: Building a namespace api object
10:06:30 Oct 26 10:00:15.341: INFO: Waiting up to 2m0s for service account default to be provisioned in ns e2e-tests-services-eo2mq
10:06:30 Oct 26 10:00:15.391: INFO: Get service account default in ns e2e-tests-services-eo2mq failed, ignoring for 2s: serviceaccounts "default" not found
10:06:30 Oct 26 10:00:17.395: INFO: Service account default in ns e2e-tests-services-eo2mq with secrets found. (2.054370738s)
10:06:30 STEP: Waiting for a default service account to be provisioned in namespace
10:06:30 Oct 26 10:00:17.395: INFO: Waiting up to 2m0s for service account default to be provisioned in ns e2e-tests-services-eo2mq
10:06:30 Oct 26 10:00:17.397: INFO: Service account default in ns e2e-tests-services-eo2mq with secrets found. (2.128877ms)
10:06:30 [BeforeEach] Services
10:06:30   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:54
10:06:30 >>> testContext.KubeConfig: /var/lib/jenkins/jobs/kubernetes-e2e-gce-parallel/workspace/.kube/config
10:06:30 [It] should serve identically named services in different namespaces on different load-balancers
10:06:30   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:870
10:06:30 STEP: Building a second namespace api object
10:06:30 Oct 26 10:00:17.405: INFO: Waiting up to 2m0s for service account default to be provisioned in ns e2e-tests-services-tfr0f
10:06:30 Oct 26 10:00:17.410: INFO: Get service account default in ns e2e-tests-services-tfr0f failed, ignoring for 2s: serviceaccounts "default" not found
10:06:30 Oct 26 10:00:19.413: INFO: Service account default in ns e2e-tests-services-tfr0f with secrets found. (2.00808515s)
10:06:30 STEP: creating service test-svc with load balancer in namespace e2e-tests-services-eo2mq
10:06:30 STEP: creating pod to be part of service test-svc in namespace e2e-tests-services-eo2mq
10:06:30 Oct 26 10:00:19.458: INFO: Pod name webserver: Found 0 pods out of 1
10:06:30 Oct 26 10:00:24.463: INFO: Pod name webserver: Found 1 pods out of 1
10:06:30 STEP: ensuring each pod is running
10:06:30 Oct 26 10:00:24.463: INFO: Waiting up to 5m0s for pod webserver-nuf64 status to be running
10:06:30 Oct 26 10:00:24.467: INFO: Found pod 'webserver-nuf64' on node 'e2e-test-parallel-minion-cxc2'
10:06:30 STEP: trying to dial each unique pod
10:06:30 Oct 26 10:00:24.476: INFO: Controller webserver: Got non-empty result from replica 1 [webserver-nuf64]: "<pre>\n<a href=\"var/\">var/</a>\n<a href=\"etc/\">etc/</a>\n<a href=\"dev/\">dev/</a>\n<a href=\"sys/\">sys/</a>\n<a href=\".dockerenv\">.dockerenv</a>\n<a href=\".dockerinit\">.dockerinit</a>\n<a href=\"proc/\">proc/</a>\n<a href=\"test-webserver\">test-webserver</a>\n</pre>\n", 1 of 1 required successes so far
10:06:30 STEP: creating a static IP
10:06:30 I1026 10:00:24.476116   15506 google_compute.go:39] Creating static IP with name "e2e-external-lb-test-48276" in project "kubernetes-jenkins"
10:06:30 STEP: creating service test-svc with load balancer in namespace e2e-tests-services-tfr0f
10:06:30 STEP: creating pod to be part of service test-svc in namespace e2e-tests-services-tfr0f
10:06:30 Oct 26 10:00:29.070: INFO: Pod name webserver: Found 0 pods out of 2
10:06:30 Oct 26 10:00:34.080: INFO: Pod name webserver: Found 2 pods out of 2
10:06:30 STEP: ensuring each pod is running
10:06:30 Oct 26 10:00:34.080: INFO: Waiting up to 5m0s for pod webserver-7p7b5 status to be running
10:06:30 Oct 26 10:00:34.096: INFO: Found pod 'webserver-7p7b5' on node 'e2e-test-parallel-minion-ofi6'
10:06:30 Oct 26 10:00:34.096: INFO: Waiting up to 5m0s for pod webserver-ajez5 status to be running
10:06:30 Oct 26 10:00:34.115: INFO: Found pod 'webserver-ajez5' on node 'e2e-test-parallel-minion-m510'
10:06:30 STEP: trying to dial each unique pod
10:06:30 Oct 26 10:00:34.220: INFO: Controller webserver: Got non-empty result from replica 1 [webserver-7p7b5]: "<pre>\n<a href=\"var/\">var/</a>\n<a href=\"etc/\">etc/</a>\n<a href=\"dev/\">dev/</a>\n<a href=\"sys/\">sys/</a>\n<a href=\".dockerenv\">.dockerenv</a>\n<a href=\".dockerinit\">.dockerinit</a>\n<a href=\"proc/\">proc/</a>\n<a href=\"test-webserver\">test-webserver</a>\n</pre>\n", 1 of 2 required successes so far
10:06:30 Oct 26 10:00:34.369: INFO: Controller webserver: Got non-empty result from replica 2 [webserver-ajez5]: "<pre>\n<a href=\"var/\">var/</a>\n<a href=\"etc/\">etc/</a>\n<a href=\"dev/\">dev/</a>\n<a href=\"sys/\">sys/</a>\n<a href=\".dockerenv\">.dockerenv</a>\n<a href=\".dockerinit\">.dockerinit</a>\n<a href=\"proc/\">proc/</a>\n<a href=\"test-webserver\">test-webserver</a>\n</pre>\n", 2 of 2 required successes so far
10:06:30 STEP: waiting up to 20m0s for service test-svc in namespace e2e-tests-services-eo2mq to have a LoadBalancer ingress point
10:06:30 Oct 26 10:00:46.406: INFO: Waiting for service test-svc in namespace e2e-tests-services-eo2mq to have a LoadBalancer ingress point (12.037166824s)
10:06:30 Oct 26 10:01:01.434: INFO: Waiting for service test-svc in namespace e2e-tests-services-eo2mq to have a LoadBalancer ingress point (27.064870129s)
10:06:30 STEP: hitting the pod through the service's NodePort
10:06:30 STEP: Waiting up to 5m0s for the url http://146.148.83.214:31011 to be reachable
10:06:30 Oct 26 10:01:16.471: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1.720033ms)
10:06:30 Oct 26 10:01:18.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2.003652178s)
10:06:30 Oct 26 10:01:20.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4.003939605s)
10:06:30 Oct 26 10:01:22.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (6.003805547s)
10:06:30 Oct 26 10:01:24.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (8.00350888s)
10:06:30 Oct 26 10:01:26.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (10.003502685s)
10:06:30 Oct 26 10:01:28.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (12.003625514s)
10:06:30 Oct 26 10:01:30.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (14.003640354s)
10:06:30 Oct 26 10:01:32.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (16.003434694s)
10:06:30 Oct 26 10:01:34.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (18.003914651s)
10:06:30 Oct 26 10:01:36.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (20.003859353s)
10:06:30 Oct 26 10:01:38.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (22.003873409s)
10:06:30 Oct 26 10:01:40.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (24.003388983s)
10:06:30 Oct 26 10:01:42.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (26.003501756s)
10:06:30 Oct 26 10:01:44.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (28.003383989s)
10:06:30 Oct 26 10:01:46.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (30.003602875s)
10:06:30 Oct 26 10:01:48.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (32.003480187s)
10:06:30 Oct 26 10:01:50.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (34.003528057s)
10:06:30 Oct 26 10:01:52.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (36.00344677s)
10:06:30 Oct 26 10:01:54.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (38.003726231s)
10:06:30 Oct 26 10:01:56.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (40.003979418s)
10:06:30 Oct 26 10:01:58.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (42.003643584s)
10:06:30 Oct 26 10:02:00.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (44.003672974s)
10:06:30 Oct 26 10:02:02.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (46.004070605s)
10:06:30 Oct 26 10:02:04.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (48.003927367s)
10:06:30 Oct 26 10:02:06.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (50.00389363s)
10:06:30 Oct 26 10:02:08.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (52.00362278s)
10:06:30 Oct 26 10:02:10.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (54.003553612s)
10:06:30 Oct 26 10:02:12.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (56.003743261s)
10:06:30 Oct 26 10:02:14.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (58.00345945s)
10:06:30 Oct 26 10:02:16.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m0.003411396s)
10:06:30 Oct 26 10:02:18.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m2.003690491s)
10:06:30 Oct 26 10:02:20.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m4.003639122s)
10:06:30 Oct 26 10:02:22.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m6.003626677s)
10:06:30 Oct 26 10:02:24.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m8.003833981s)
10:06:30 Oct 26 10:02:26.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m10.003668348s)
10:06:30 Oct 26 10:02:28.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m12.003594601s)
10:06:30 Oct 26 10:02:30.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m14.004013626s)
10:06:30 Oct 26 10:02:32.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m16.003646642s)
10:06:30 Oct 26 10:02:34.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m18.00381714s)
10:06:30 Oct 26 10:02:36.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m20.003853439s)
10:06:30 Oct 26 10:02:38.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m22.003541407s)
10:06:30 Oct 26 10:02:40.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m24.003546395s)
10:06:30 Oct 26 10:02:42.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m26.003656425s)
10:06:30 Oct 26 10:02:44.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m28.003614843s)
10:06:30 Oct 26 10:02:46.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m30.00354381s)
10:06:30 Oct 26 10:02:48.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m32.003581713s)
10:06:30 Oct 26 10:02:50.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m34.003848371s)
10:06:30 Oct 26 10:02:52.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m36.003994715s)
10:06:30 Oct 26 10:02:54.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m38.004091973s)
10:06:30 Oct 26 10:02:56.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m40.003912461s)
10:06:30 Oct 26 10:02:58.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m42.003672614s)
10:06:30 Oct 26 10:03:00.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m44.003753422s)
10:06:30 Oct 26 10:03:02.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m46.00363826s)
10:06:30 Oct 26 10:03:04.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m48.003737271s)
10:06:30 Oct 26 10:03:06.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m50.003960981s)
10:06:30 Oct 26 10:03:08.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m52.003762678s)
10:06:30 Oct 26 10:03:10.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m54.003804177s)
10:06:30 Oct 26 10:03:12.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m56.003795066s)
10:06:30 Oct 26 10:03:14.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (1m58.004049062s)
10:06:30 Oct 26 10:03:16.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m0.003485628s)
10:06:30 Oct 26 10:03:18.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m2.003528707s)
10:06:30 Oct 26 10:03:20.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m4.003619315s)
10:06:30 Oct 26 10:03:22.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m6.003614452s)
10:06:30 Oct 26 10:03:24.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m8.003861422s)
10:06:30 Oct 26 10:03:26.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m10.003646908s)
10:06:30 Oct 26 10:03:28.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m12.0035655s)
10:06:30 Oct 26 10:03:30.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m14.003672934s)
10:06:30 Oct 26 10:03:32.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m16.00384482s)
10:06:30 Oct 26 10:03:34.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m18.003698957s)
10:06:30 Oct 26 10:03:36.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m20.00370043s)
10:06:30 Oct 26 10:03:38.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m22.004004666s)
10:06:30 Oct 26 10:03:40.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m24.003681114s)
10:06:30 Oct 26 10:03:42.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m26.003726513s)
10:06:30 Oct 26 10:03:44.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m28.003630153s)
10:06:30 Oct 26 10:03:46.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m30.003638971s)
10:06:30 Oct 26 10:03:48.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m32.003364695s)
10:06:30 Oct 26 10:03:50.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m34.003585686s)
10:06:30 Oct 26 10:03:52.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m36.003285663s)
10:06:30 Oct 26 10:03:54.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m38.00337839s)
10:06:30 Oct 26 10:03:56.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m40.003815097s)
10:06:30 Oct 26 10:03:58.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m42.004008365s)
10:06:30 Oct 26 10:04:00.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m44.003762414s)
10:06:30 Oct 26 10:04:02.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m46.003859066s)
10:06:30 Oct 26 10:04:04.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m48.003895414s)
10:06:30 Oct 26 10:04:06.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m50.003818146s)
10:06:30 Oct 26 10:04:08.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m52.003623587s)
10:06:30 Oct 26 10:04:10.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m54.00361428s)
10:06:30 Oct 26 10:04:12.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m56.003750028s)
10:06:30 Oct 26 10:04:14.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (2m58.003445544s)
10:06:30 Oct 26 10:04:16.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m0.003576047s)
10:06:30 Oct 26 10:04:18.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m2.003345036s)
10:06:30 Oct 26 10:04:20.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m4.003683468s)
10:06:30 Oct 26 10:04:22.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m6.003357692s)
10:06:30 Oct 26 10:04:24.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m8.003481447s)
10:06:30 Oct 26 10:04:26.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m10.003956033s)
10:06:30 Oct 26 10:04:28.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m12.003681805s)
10:06:30 Oct 26 10:04:30.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m14.003949615s)
10:06:30 Oct 26 10:04:32.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m16.003495474s)
10:06:30 Oct 26 10:04:34.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m18.003922391s)
10:06:30 Oct 26 10:04:36.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m20.00365655s)
10:06:30 Oct 26 10:04:38.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m22.003509688s)
10:06:30 Oct 26 10:04:40.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m24.003704543s)
10:06:30 Oct 26 10:04:42.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m26.003895707s)
10:06:30 Oct 26 10:04:44.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m28.003691778s)
10:06:30 Oct 26 10:04:46.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m30.003824038s)
10:06:30 Oct 26 10:04:48.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m32.003874804s)
10:06:30 Oct 26 10:04:50.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m34.003796838s)
10:06:30 Oct 26 10:04:52.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m36.003884252s)
10:06:30 Oct 26 10:04:54.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m38.003544386s)
10:06:30 Oct 26 10:04:56.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m40.003575459s)
10:06:30 Oct 26 10:04:58.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m42.003659555s)
10:06:30 Oct 26 10:05:00.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m44.004024423s)
10:06:30 Oct 26 10:05:02.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m46.00369491s)
10:06:30 Oct 26 10:05:04.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m48.00379069s)
10:06:30 Oct 26 10:05:06.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m50.003916824s)
10:06:30 Oct 26 10:05:08.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m52.003539433s)
10:06:30 Oct 26 10:05:10.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m54.003688199s)
10:06:30 Oct 26 10:05:12.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m56.003824155s)
10:06:30 Oct 26 10:05:14.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (3m58.003883894s)
10:06:30 Oct 26 10:05:16.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m0.003646316s)
10:06:30 Oct 26 10:05:18.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m2.003638422s)
10:06:30 Oct 26 10:05:20.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m4.003539935s)
10:06:30 Oct 26 10:05:22.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m6.003402601s)
10:06:30 Oct 26 10:05:24.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m8.003891859s)
10:06:30 Oct 26 10:05:26.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m10.003773625s)
10:06:30 Oct 26 10:05:28.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m12.003701413s)
10:06:30 Oct 26 10:05:30.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m14.003852745s)
10:06:30 Oct 26 10:05:32.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m16.003678368s)
10:06:30 Oct 26 10:05:34.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m18.003879111s)
10:06:30 Oct 26 10:05:36.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m20.003689714s)
10:06:30 Oct 26 10:05:38.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m22.003765203s)
10:06:30 Oct 26 10:05:40.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m24.003920009s)
10:06:30 Oct 26 10:05:42.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m26.003264803s)
10:06:30 Oct 26 10:05:44.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m28.003615575s)
10:06:30 Oct 26 10:05:46.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m30.003698891s)
10:06:30 Oct 26 10:05:48.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m32.003703401s)
10:06:30 Oct 26 10:05:50.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m34.00381528s)
10:06:30 Oct 26 10:05:52.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m36.003428181s)
10:06:30 Oct 26 10:05:54.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m38.003709229s)
10:06:30 Oct 26 10:05:56.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m40.003616462s)
10:06:30 Oct 26 10:05:58.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m42.003845881s)
10:06:30 Oct 26 10:06:00.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m44.003791135s)
10:06:30 Oct 26 10:06:02.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m46.003919763s)
10:06:30 Oct 26 10:06:04.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m48.004213243s)
10:06:30 Oct 26 10:06:06.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m50.004124663s)
10:06:30 Oct 26 10:06:08.474: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m52.003849067s)
10:06:30 Oct 26 10:06:10.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m54.003677565s)
10:06:30 Oct 26 10:06:12.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m56.003714066s)
10:06:30 Oct 26 10:06:14.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (4m58.003532085s)
10:06:30 Oct 26 10:06:16.473: INFO: Got error waiting for reachability of http://146.148.83.214:31011: Get http://146.148.83.214:31011: dial tcp 146.148.83.214:31011: connection refused (5m0.003453826s)
10:06:30 [AfterEach] Services
10:06:30   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework.go:52
10:06:30 STEP: Collecting events from namespace "e2e-tests-services-eo2mq".
10:06:30 Oct 26 10:06:20.584: INFO: event for test-svc: {service-controller } CreatingLoadBalancer: Creating load balancer
10:06:30 Oct 26 10:06:20.584: INFO: event for test-svc: {service-controller } CreatedLoadBalancer: Created load balancer
10:06:30 Oct 26 10:06:20.584: INFO: event for webserver-nuf64: {scheduler } Scheduled: Successfully assigned webserver-nuf64 to e2e-test-parallel-minion-cxc2
10:06:30 Oct 26 10:06:20.584: INFO: event for webserver-nuf64: {kubelet e2e-test-parallel-minion-cxc2} Pulled: Container image "beta.gcr.io/google_containers/pause:2.0" already present on machine
10:06:30 Oct 26 10:06:20.584: INFO: event for webserver-nuf64: {kubelet e2e-test-parallel-minion-cxc2} Created: Created with docker id a6d7cccb918e
10:06:30 Oct 26 10:06:20.584: INFO: event for webserver-nuf64: {kubelet e2e-test-parallel-minion-cxc2} Started: Started with docker id a6d7cccb918e
10:06:30 Oct 26 10:06:20.584: INFO: event for webserver-nuf64: {kubelet e2e-test-parallel-minion-cxc2} Pulled: Container image "gcr.io/google_containers/test-webserver" already present on machine
10:06:30 Oct 26 10:06:20.584: INFO: event for webserver-nuf64: {kubelet e2e-test-parallel-minion-cxc2} Created: Created with docker id c225dc8cfcdf
10:06:30 Oct 26 10:06:20.584: INFO: event for webserver-nuf64: {kubelet e2e-test-parallel-minion-cxc2} Started: Started with docker id c225dc8cfcdf
10:06:30 Oct 26 10:06:20.584: INFO: event for webserver: {replication-controller } SuccessfulCreate: Created pod: webserver-nuf64
10:06:30 Oct 26 10:06:20.602: INFO: POD                                                  NODE                           PHASE    GRACE  CONDITIONS
10:06:30 Oct 26 10:06:20.602: INFO: pod-update-de9b9ddf-7c03-11e5-8b4b-42010af01555      e2e-test-parallel-minion-l6j0  Pending         []
10:06:30 Oct 26 10:06:20.602: INFO: webserver-nuf64                                      e2e-test-parallel-minion-cxc2  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 10:00:20 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: webserver-7p7b5                                      e2e-test-parallel-minion-ofi6  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 10:00:31 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: webserver-ajez5                                      e2e-test-parallel-minion-m510  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 10:00:29 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: elasticsearch-logging-v1-5uf3b                       e2e-test-parallel-minion-iz6g  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:56:19 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: elasticsearch-logging-v1-98yvs                       e2e-test-parallel-minion-l6j0  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:55:56 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: fluentd-elasticsearch-e2e-test-parallel-minion-4xpp  e2e-test-parallel-minion-4xpp  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:55:39 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: fluentd-elasticsearch-e2e-test-parallel-minion-cxc2  e2e-test-parallel-minion-cxc2  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:55:50 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: fluentd-elasticsearch-e2e-test-parallel-minion-iz6g  e2e-test-parallel-minion-iz6g  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:56:01 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: fluentd-elasticsearch-e2e-test-parallel-minion-l6j0  e2e-test-parallel-minion-l6j0  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:55:40 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: fluentd-elasticsearch-e2e-test-parallel-minion-m510  e2e-test-parallel-minion-m510  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:55:39 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: fluentd-elasticsearch-e2e-test-parallel-minion-ofi6  e2e-test-parallel-minion-ofi6  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:55:43 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: heapster-v10-7oxwc                                   e2e-test-parallel-minion-m510  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:55:39 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: kibana-logging-v1-pye80                              e2e-test-parallel-minion-iz6g  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:56:20 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: kube-dns-v9-9bpi6                                    e2e-test-parallel-minion-4xpp  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:56:04 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: kube-ui-v3-ijh79                                     e2e-test-parallel-minion-cxc2  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:55:37 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: monitoring-influxdb-grafana-v2-lw64p                 e2e-test-parallel-minion-ofi6  Running         [{Ready True 0001-01-01 00:00:00 +0000 UTC 2015-10-26 09:56:01 -0700 PDT  }]
10:06:30 Oct 26 10:06:20.602: INFO: 
10:06:30 Oct 26 10:06:20.602: INFO: Waiting up to 1m0s for all nodes to be ready
10:06:30 Oct 26 10:06:20.607: INFO: Node e2e-test-parallel-minion-4xpp condition 1/1: type: Ready, status: True, reason: "KubeletReady", message: "kubelet is posting ready status", last transition time: 2015-10-26 09:55:14 -0700 PDT
10:06:30 Oct 26 10:06:20.607: INFO: Successfully found node e2e-test-parallel-minion-4xpp readiness to be true
10:06:30 Oct 26 10:06:20.607: INFO: Node e2e-test-parallel-minion-cxc2 condition 1/1: type: Ready, status: True, reason: "KubeletReady", message: "kubelet is posting ready status", last transition time: 2015-10-26 09:55:24 -0700 PDT
10:06:30 Oct 26 10:06:20.607: INFO: Successfully found node e2e-test-parallel-minion-cxc2 readiness to be true
10:06:30 Oct 26 10:06:20.607: INFO: Node e2e-test-parallel-minion-iz6g condition 1/1: type: Ready, status: True, reason: "KubeletReady", message: "kubelet is posting ready status", last transition time: 2015-10-26 09:55:18 -0700 PDT
10:06:30 Oct 26 10:06:20.607: INFO: Successfully found node e2e-test-parallel-minion-iz6g readiness to be true
10:06:30 Oct 26 10:06:20.607: INFO: Node e2e-test-parallel-minion-l6j0 condition 1/1: type: Ready, status: True, reason: "KubeletReady", message: "kubelet is posting ready status", last transition time: 2015-10-26 09:55:12 -0700 PDT
10:06:30 Oct 26 10:06:20.607: INFO: Successfully found node e2e-test-parallel-minion-l6j0 readiness to be true
10:06:30 Oct 26 10:06:20.607: INFO: Node e2e-test-parallel-minion-m510 condition 1/1: type: Ready, status: True, reason: "KubeletReady", message: "kubelet is posting ready status", last transition time: 2015-10-26 09:55:14 -0700 PDT
10:06:30 Oct 26 10:06:20.607: INFO: Successfully found node e2e-test-parallel-minion-m510 readiness to be true
10:06:30 Oct 26 10:06:20.607: INFO: Node e2e-test-parallel-minion-ofi6 condition 1/1: type: Ready, status: True, reason: "KubeletReady", message: "kubelet is posting ready status", last transition time: 2015-10-26 09:55:13 -0700 PDT
10:06:30 Oct 26 10:06:20.607: INFO: Successfully found node e2e-test-parallel-minion-ofi6 readiness to be true
10:06:30 STEP: Destroying namespace "e2e-tests-services-eo2mq" for this suite.
10:06:30 [AfterEach] Services
10:06:30   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:64
10:06:30 STEP: Destroying namespace e2e-tests-services-tfr0f
10:06:30 
10:06:30 
10:06:30 • Failure [375.308 seconds]
10:06:30 Services
10:06:30 /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:871
10:06:30   should serve identically named services in different namespaces on different load-balancers [It]
10:06:30   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:870
10:06:30 
10:06:30   Error waiting for the url http://146.148.83.214:31011 to be reachable
10:06:30   Expected error:
10:06:30       <*errors.errorString | 0xc208143390>: {
10:06:30           s: "timed out waiting for the condition",
10:06:30       }
10:06:30       timed out waiting for the condition
10:06:30   not to have occurred
10:06:30 
10:06:30   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:1186
@lavalamp lavalamp added priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. team/cluster labels Oct 26, 2015
@ashcrow
Copy link
Contributor

ashcrow commented Oct 26, 2015

Looks like this e2e code hasn't changed since 2015-10-01.

@thockin
Copy link
Member

thockin commented Oct 26, 2015

Ugh. What changed is that we moved it off teh flaky list. Perhaps wrongly
so.

On Mon, Oct 26, 2015 at 11:17 AM, Stephen Milner notifications@github.com
wrote:

Looks like this e2e code hasn't changed since 2015-10-01.

—
Reply to this email directly or view it on GitHub
#16285 (comment)
.

@ashcrow
Copy link
Contributor

ashcrow commented Oct 27, 2015

Ah, I see. 6600fbc removed a number of e2e service items from FLAKY variables. Relevant here:

-    "Services.*identically\snamed"

ashcrow added a commit to ashcrow/kubernetes that referenced this issue Oct 27, 2015
@ashcrow
flake: Disable flaky service e2e per kubernetes#16285
f7449ce
@ArtfulCoder
Copy link
Contributor

the test is actually still running
" Services should serve identically named services in different namespaces on different load-balancers"
is running green.. http://kubekins.dls.corp.google.com/view/Critical%20Builds/job/kubernetes-e2e-gce/test_results_analyzer/

Saad's fix where we correctly wait for GCE operations to complete, is checked in.

Closing this issue.

RichieEscarez pushed a commit to RichieEscarez/kubernetes that referenced this issue Dec 4, 2015
@ashcrow @RichieEscarez
flake: Disable flaky service e2e per kubernetes#16285
4ddb21c
@janetkuo
Copy link
Member

Looks like this test is failing forever in http://kubekins.dls.corp.google.com/view/Flaky/job/kubernetes-e2e-gce-parallel-flaky and http://kubekins.dls.corp.google.com/view/Flaky/job/kubernetes-e2e-gce-flaky.

Services should serve identically named services in different namespaces on different load-balancers [Flaky]

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/service.go:887 Jan 21 14:44:06.151: Failed to create 2 pods with name netcat: failed to wait for pods responding: timed out waiting for the condition

@janetkuo janetkuo reopened this Jan 21, 2016
@thockin
Copy link
Member

thockin commented Jan 28, 2016

Somehow I lost this one. Will look at it ASAP

On Thu, Jan 21, 2016 at 3:13 PM, Janet Kuo notifications@github.com wrote:

Reopened #16285 #16285.

—
Reply to this email directly or view it on GitHub
#16285 (comment).

@thockin thockin added the kind/flake Categorizes issue or PR as related to a flaky test. label Jan 29, 2016
@thockin
Copy link
Member

thockin commented Jan 29, 2016

The problem is that this test depends on the api proxy which doesn't do UDP, as far as I can tell, so it could never have worked when UDP support was added. I will see what I can do to rectify.

@thockin thockin mentioned this issue Feb 1, 2016
Merged
@thockin
Copy link
Member

thockin commented Feb 1, 2016

Fixed test is #20426 - it's a doozy.

@thockin thockin mentioned this issue Feb 2, 2016
Closed
@thockin
Copy link
Member

thockin commented Feb 3, 2016

I've asked oncall to move this to the head of the queue. It's hard to figure out existing flakes when the test driving them has been totally changed. I want to re-examine all e2e/service.go flakes after tghis

@thockin
Copy link
Member

thockin commented Feb 3, 2016

#20426 is in. I am going to close a few issues and wait for reoccurence, which is to be handled P(-1)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@thockin thockin

Labels
kind/flake Categorizes issue or PR as related to a flaky test. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@ashcrow @lavalamp @ArtfulCoder @janetkuo @thockin