Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ci-kubernetes-e2e-gci-gce-examples: broken test run #43195

Closed
k8s-github-robot opened this issue Mar 16, 2017 · 1,207 comments
Closed

ci-kubernetes-e2e-gci-gce-examples: broken test run #43195

k8s-github-robot opened this issue Mar 16, 2017 · 1,207 comments
Assignees
@spiffxp @apelisse
Labels
kind/flake Categorizes issue or PR as related to a flaky test. needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.

Comments

@k8s-github-robot
Copy link

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3599/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420fc4950>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 04:43:22.279  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-gt5kf with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 04:43:22.287  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 04:43:22.408  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 04:43:22 GMT 2017]; root of context hierarchy\n2017-03-16 04:43:24.096  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 04:43:24.121  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 04:43:24.635  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed\n\njava.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]\n\tat com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]\n\tat org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]\n\tat java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]\n\tat org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]\n\n2017-03-16 04:43:24.636  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.\n2017-03-16 04:43:24.788  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []\n2017-03-16 04:43:24.790  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 04:43:24.790  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.\n2017-03-16 04:43:24.806  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 04:43:24.843  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701\n2017-03-16 04:43:24.844  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 04:43:24.844  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 04:43:25.200  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 04:43:26.108  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 04:43:26.428  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 04:43:26.503  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 04:43:26.520  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING\n2017-03-16 04:43:26.522  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 04:43:26.551  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.8]:5701 - a87c1575-7cf6-42ce-82c1-b75087567b3a this\n}\n\n2017-03-16 04:43:26.662  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED\n2017-03-16 04:43:26.667  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.588 seconds (JVM running for 6.453)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 04:43:22.279  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-gt5kf with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 04:43:22.287  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 04:43:22.408  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 04:43:22 GMT 2017]; root of context hierarchy
    2017-03-16 04:43:24.096  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 04:43:24.121  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 04:43:24.635  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed
    
    java.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast
    	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]
    	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]
    	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]
    	at com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]
    	at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]
    	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]
    	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]
    
    2017-03-16 04:43:24.636  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.
    2017-03-16 04:43:24.788  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []
    2017-03-16 04:43:24.790  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 04:43:24.790  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.
    2017-03-16 04:43:24.806  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 04:43:24.843  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701
    2017-03-16 04:43:24.844  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 04:43:24.844  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 04:43:25.200  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 04:43:26.108  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 04:43:26.428  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 04:43:26.503  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 04:43:26.520  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING
    2017-03-16 04:43:26.522  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 04:43:26.551  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.8]:5701 - a87c1575-7cf6-42ce-82c1-b75087567b3a this
    }
    
    2017-03-16 04:43:26.662  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED
    2017-03-16 04:43:26.667  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.588 seconds (JVM running for 6.453)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.169.31 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-p1mzg] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42140a5a0 exit status 1 <nil> <nil> true [0xc42053a3a8 0xc42053a3c0 0xc42053a3d8] [0xc42053a3a8 0xc42053a3c0 0xc42053a3d8] [0xc42053a3b8 0xc42053a3d0] [0xc35000 0xc35000] 0xc42142bbc0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.169.31 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-p1mzg] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42140a5a0 exit status 1 <nil> <nil> true [0xc42053a3a8 0xc42053a3c0 0xc42053a3d8] [0xc42053a3a8 0xc42053a3c0 0xc42053a3d8] [0xc42053a3b8 0xc42053a3d0] [0xc35000 0xc35000] 0xc42142bbc0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421dad680>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-f254z\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:14:24 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:14:25 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-f254z}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:14:25 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:14:26 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:14:26 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:14:26 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-f254z
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  05:14:24 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:14:25 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-f254z}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:14:25 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:14:26 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:14:26 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:14:26 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Previous issues for this suite: #36939 #39382 #39874 #42107 #43019
@k8s-github-robot k8s-github-robot added kind/flake Categorizes issue or PR as related to a flaky test. priority/P2 labels Mar 16, 2017
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3600/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420f972b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-rg1b1\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:50:28 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:50:29 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-rg1b1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:50:29 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:50:30 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:50:30 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:50:30 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-rg1b1
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  05:50:28 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:50:29 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-rg1b1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:50:29 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:50:30 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:50:30 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:50:30 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421ce1370>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 05:54:38.864  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-0rdk0 with PID 8 (/bootstrapper.jar started by root in /)\n2017-03-16 05:54:38.885  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 05:54:39.018  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 05:54:39 GMT 2017]; root of context hierarchy\n2017-03-16 05:54:40.671  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 05:54:40.692  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 05:54:41.258  WARN 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed\n\njava.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]\n\tat com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]\n\tat org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]\n\tat java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]\n\tat org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]\n\n2017-03-16 05:54:41.259  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.\n2017-03-16 05:54:41.392  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []\n2017-03-16 05:54:41.394  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 05:54:41.394  WARN 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.\n2017-03-16 05:54:41.412  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 05:54:41.447  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.10]:5701\n2017-03-16 05:54:41.447  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 05:54:41.448  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 05:54:41.793  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.10]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 05:54:42.644  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.180.1.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 05:54:42.933  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 05:54:42.939  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 05:54:42.954  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTING\n2017-03-16 05:54:42.956  INFO 8 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 05:54:42.988  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.10]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.10]:5701 - ad431fd7-7875-44b3-a71c-38e33cf14f25 this\n}\n\n2017-03-16 05:54:43.071  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTED\n2017-03-16 05:54:43.077  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.303 seconds (JVM running for 6.175)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 05:54:38.864  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-0rdk0 with PID 8 (/bootstrapper.jar started by root in /)
    2017-03-16 05:54:38.885  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 05:54:39.018  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 05:54:39 GMT 2017]; root of context hierarchy
    2017-03-16 05:54:40.671  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 05:54:40.692  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 05:54:41.258  WARN 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed
    
    java.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast
    	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]
    	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]
    	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]
    	at com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]
    	at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]
    	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]
    	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]
    
    2017-03-16 05:54:41.259  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.
    2017-03-16 05:54:41.392  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []
    2017-03-16 05:54:41.394  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 05:54:41.394  WARN 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.
    2017-03-16 05:54:41.412  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 05:54:41.447  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.10]:5701
    2017-03-16 05:54:41.447  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 05:54:41.448  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 05:54:41.793  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.10]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 05:54:42.644  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.180.1.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 05:54:42.933  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 05:54:42.939  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 05:54:42.954  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTING
    2017-03-16 05:54:42.956  INFO 8 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 05:54:42.988  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.10]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.10]:5701 - ad431fd7-7875-44b3-a71c-38e33cf14f25 this
    }
    
    2017-03-16 05:54:43.071  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTED
    2017-03-16 05:54:43.077  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.303 seconds (JVM running for 6.175)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.128.73 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-t9s3k] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420b6a900 exit status 1 <nil> <nil> true [0xc420484628 0xc420484640 0xc420484660] [0xc420484628 0xc420484640 0xc420484660] [0xc420484638 0xc420484658] [0xc35000 0xc35000] 0xc420a5b5c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.128.73 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-t9s3k] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420b6a900 exit status 1 <nil> <nil> true [0xc420484628 0xc420484640 0xc420484660] [0xc420484628 0xc420484640 0xc420484660] [0xc420484638 0xc420484658] [0xc35000 0xc35000] 0xc420a5b5c0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3601/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420c602c0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bp16p\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:45:58 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:45:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bp16p}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:45:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:46:00 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:46:00 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:46:00 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-bp16p
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  06:45:58 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:45:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bp16p}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:45:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:46:00 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:46:00 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:46:00 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.128.73 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-dgjhv] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421e069f0 exit status 1 <nil> <nil> true [0xc420498578 0xc420498598 0xc4204985b8] [0xc420498578 0xc420498598 0xc4204985b8] [0xc420498590 0xc4204985b0] [0xc35000 0xc35000] 0xc420e76360 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.128.73 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-dgjhv] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421e069f0 exit status 1 <nil> <nil> true [0xc420498578 0xc420498598 0xc4204985b8] [0xc420498578 0xc420498598 0xc4204985b8] [0xc420498590 0xc4204985b0] [0xc35000 0xc35000] 0xc420e76360 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4214fe7c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 06:51:34.719  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-lsthh with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 06:51:34.737  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 06:51:34.831  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 06:51:34 GMT 2017]; root of context hierarchy\n2017-03-16 06:51:36.310  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 06:51:36.340  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 06:51:36.907  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 06:51:37.042  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.9]\n2017-03-16 06:51:37.042  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 06:51:37.053  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 06:51:37.084  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.9]:5701\n2017-03-16 06:51:37.085  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 06:51:37.085  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 06:51:37.422  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 06:51:38.257  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 06:51:38.528  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 06:51:38.531  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 06:51:38.548  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.9]:5701 [someGroup] [3.7.5] [10.180.0.9]:5701 is STARTING\n2017-03-16 06:51:38.551  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 06:51:38.576  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.9]:5701 - ba710eb8-7d75-47e2-9409-d2dc288e2275 this\n}\n\n2017-03-16 06:51:38.648  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.9]:5701 [someGroup] [3.7.5] [10.180.0.9]:5701 is STARTED\n2017-03-16 06:51:38.650  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.814 seconds (JVM running for 5.601)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 06:51:34.719  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-lsthh with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 06:51:34.737  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 06:51:34.831  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 06:51:34 GMT 2017]; root of context hierarchy
    2017-03-16 06:51:36.310  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 06:51:36.340  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 06:51:36.907  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 06:51:37.042  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.9]
    2017-03-16 06:51:37.042  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 06:51:37.053  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 06:51:37.084  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.9]:5701
    2017-03-16 06:51:37.085  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 06:51:37.085  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 06:51:37.422  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 06:51:38.257  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 06:51:38.528  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 06:51:38.531  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 06:51:38.548  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.9]:5701 [someGroup] [3.7.5] [10.180.0.9]:5701 is STARTING
    2017-03-16 06:51:38.551  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 06:51:38.576  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.9]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.0.9]:5701 - ba710eb8-7d75-47e2-9409-d2dc288e2275 this
    }
    
    2017-03-16 06:51:38.648  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.9]:5701 [someGroup] [3.7.5] [10.180.0.9]:5701 is STARTED
    2017-03-16 06:51:38.650  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.814 seconds (JVM running for 5.601)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3602/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.209.166 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9qb6g] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c1d530 exit status 1 <nil> <nil> true [0xc42026a3a0 0xc42026a3b8 0xc42026a3d0] [0xc42026a3a0 0xc42026a3b8 0xc42026a3d0] [0xc42026a3b0 0xc42026a3c8] [0xc35000 0xc35000] 0xc420a08060 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.209.166 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9qb6g] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c1d530 exit status 1 <nil> <nil> true [0xc42026a3a0 0xc42026a3b8 0xc42026a3d0] [0xc42026a3a0 0xc42026a3b8 0xc42026a3d0] [0xc42026a3b0 0xc42026a3c8] [0xc35000 0xc35000] 0xc420a08060 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420a06860>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-j85x8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  07:57:00 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  07:57:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.9; broadcast_rpc_address=10.180.3.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j85x8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  07:57:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  07:57:02 Global memtable on-heap threshold is enabled at 128MB\nINFO  07:57:02 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:57:02 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-j85x8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  07:57:00 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  07:57:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.9; broadcast_rpc_address=10.180.3.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j85x8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  07:57:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  07:57:02 Global memtable on-heap threshold is enabled at 128MB
    INFO  07:57:02 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 07:57:02 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4217227b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 07:59:14.432  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ct7q1 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 07:59:14.441  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 07:59:14.586  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 07:59:14 GMT 2017]; root of context hierarchy\n2017-03-16 07:59:16.214  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 07:59:16.243  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 07:59:16.928  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 07:59:17.075  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.17]\n2017-03-16 07:59:17.076  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 07:59:17.094  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 07:59:17.133  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.17]:5701\n2017-03-16 07:59:17.133  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 07:59:17.133  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 07:59:17.480  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 07:59:18.428  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 07:59:18.726  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 07:59:18.728  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 07:59:18.748  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTING\n2017-03-16 07:59:18.752  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 07:59:18.779  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.17]:5701 - b7d8de17-723c-4e33-b74c-f5e56647e468 this\n}\n\n2017-03-16 07:59:18.854  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTED\n2017-03-16 07:59:18.857  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.623 seconds (JVM running for 6.683)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 07:59:14.432  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ct7q1 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 07:59:14.441  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 07:59:14.586  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 07:59:14 GMT 2017]; root of context hierarchy
    2017-03-16 07:59:16.214  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 07:59:16.243  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 07:59:16.928  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 07:59:17.075  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.17]
    2017-03-16 07:59:17.076  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 07:59:17.094  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 07:59:17.133  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.17]:5701
    2017-03-16 07:59:17.133  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 07:59:17.133  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 07:59:17.480  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 07:59:18.428  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 07:59:18.726  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 07:59:18.728  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 07:59:18.748  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTING
    2017-03-16 07:59:18.752  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 07:59:18.779  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.17]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.17]:5701 - b7d8de17-723c-4e33-b74c-f5e56647e468 this
    }
    
    2017-03-16 07:59:18.854  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTED
    2017-03-16 07:59:18.857  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.623 seconds (JVM running for 6.683)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3603/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.185.23 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-j701c] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e1c3c0 exit status 1 <nil> <nil> true [0xc420f0c140 0xc420f0c178 0xc420f0c198] [0xc420f0c140 0xc420f0c178 0xc420f0c198] [0xc420f0c168 0xc420f0c190] [0xc35000 0xc35000] 0xc421adcae0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.185.23 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-j701c] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e1c3c0 exit status 1 <nil> <nil> true [0xc420f0c140 0xc420f0c178 0xc420f0c198] [0xc420f0c140 0xc420f0c178 0xc420f0c198] [0xc420f0c168 0xc420f0c190] [0xc35000 0xc35000] 0xc421adcae0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4210c7330>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 08:40:52.542  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9gspn with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 08:40:52.572  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 08:40:52.696  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 08:40:52 GMT 2017]; root of context hierarchy\n2017-03-16 08:40:54.716  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 08:40:54.741  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 08:40:55.394  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 08:40:55.553  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]\n2017-03-16 08:40:55.553  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 08:40:55.568  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 08:40:55.612  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-16 08:40:55.613  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 08:40:55.613  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 08:40:55.980  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 08:40:56.873  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 08:40:57.160  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 08:40:57.162  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 08:40:57.172  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-16 08:40:57.175  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 08:40:57.194  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 679cf0fe-9e88-4703-9ef8-4de8d3490acc this\n}\n\n2017-03-16 08:40:57.260  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-16 08:40:57.263  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.947 seconds (JVM running for 6.805)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 08:40:52.542  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9gspn with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 08:40:52.572  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 08:40:52.696  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 08:40:52 GMT 2017]; root of context hierarchy
    2017-03-16 08:40:54.716  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 08:40:54.741  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 08:40:55.394  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 08:40:55.553  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]
    2017-03-16 08:40:55.553  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 08:40:55.568  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 08:40:55.612  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
    2017-03-16 08:40:55.613  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 08:40:55.613  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 08:40:55.980  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 08:40:56.873  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 08:40:57.160  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 08:40:57.162  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 08:40:57.172  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
    2017-03-16 08:40:57.175  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 08:40:57.194  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.6]:5701 - 679cf0fe-9e88-4703-9ef8-4de8d3490acc this
    }
    
    2017-03-16 08:40:57.260  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
    2017-03-16 08:40:57.263  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.947 seconds (JVM running for 6.805)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421a9a2d0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3bvvk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  08:59:02 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  08:59:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.9; broadcast_rpc_address=10.180.3.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3bvvk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  08:59:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  08:59:04 Global memtable on-heap threshold is enabled at 128MB\nINFO  08:59:04 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:59:04 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3bvvk
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  08:59:02 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  08:59:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.9; broadcast_rpc_address=10.180.3.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3bvvk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  08:59:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  08:59:04 Global memtable on-heap threshold is enabled at 128MB
    INFO  08:59:04 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 08:59:04 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3604/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42124c910>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 09:43:26.222  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-djh8s with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 09:43:26.229  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 09:43:26.303  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 09:43:26 GMT 2017]; root of context hierarchy\n2017-03-16 09:43:27.902  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 09:43:27.920  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 09:43:28.516  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 09:43:28.654  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.7]\n2017-03-16 09:43:28.655  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 09:43:28.665  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 09:43:28.699  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.7]:5701\n2017-03-16 09:43:28.700  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 09:43:28.700  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 09:43:29.177  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.7]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 09:43:30.189  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 09:43:30.425  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 09:43:30.429  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 09:43:30.438  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.7]:5701 [someGroup] [3.7.5] [10.180.2.7]:5701 is STARTING\n2017-03-16 09:43:30.441  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 09:43:30.457  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.7]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.7]:5701 - b85e7121-013f-4af0-a082-346343390b5d this\n}\n\n2017-03-16 09:43:30.526  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.7]:5701 [someGroup] [3.7.5] [10.180.2.7]:5701 is STARTED\n2017-03-16 09:43:30.530  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.186 seconds (JVM running for 6.024)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 09:43:26.222  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-djh8s with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 09:43:26.229  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 09:43:26.303  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 09:43:26 GMT 2017]; root of context hierarchy
    2017-03-16 09:43:27.902  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 09:43:27.920  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 09:43:28.516  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 09:43:28.654  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.7]
    2017-03-16 09:43:28.655  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 09:43:28.665  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 09:43:28.699  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.7]:5701
    2017-03-16 09:43:28.700  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 09:43:28.700  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 09:43:29.177  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.7]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 09:43:30.189  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 09:43:30.425  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 09:43:30.429  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 09:43:30.438  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.7]:5701 [someGroup] [3.7.5] [10.180.2.7]:5701 is STARTING
    2017-03-16 09:43:30.441  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 09:43:30.457  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.7]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.7]:5701 - b85e7121-013f-4af0-a082-346343390b5d this
    }
    
    2017-03-16 09:43:30.526  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.7]:5701 [someGroup] [3.7.5] [10.180.2.7]:5701 is STARTED
    2017-03-16 09:43:30.530  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.186 seconds (JVM running for 6.024)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4218ed650>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-85x5q\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  10:01:00 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  10:01:01 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-85x5q}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  10:01:01 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  10:01:02 Global memtable on-heap threshold is enabled at 128MB\nINFO  10:01:02 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:01:02 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-85x5q
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  10:01:00 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  10:01:01 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-85x5q}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  10:01:01 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  10:01:02 Global memtable on-heap threshold is enabled at 128MB
    INFO  10:01:02 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 10:01:02 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.253.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-6c46g] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4214aa000 exit status 1 <nil> <nil> true [0xc42080a100 0xc42080a118 0xc42080a130] [0xc42080a100 0xc42080a118 0xc42080a130] [0xc42080a110 0xc42080a128] [0xc35000 0xc35000] 0xc4220a1b00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.253.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-6c46g] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4214aa000 exit status 1 <nil> <nil> true [0xc42080a100 0xc42080a118 0xc42080a130] [0xc42080a100 0xc42080a118 0xc42080a130] [0xc42080a110 0xc42080a128] [0xc35000 0xc35000] 0xc4220a1b00 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3605/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421cb8210>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 11:04:47.842  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5wv0x with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 11:04:47.857  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 11:04:47.936  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 11:04:47 GMT 2017]; root of context hierarchy\n2017-03-16 11:04:50.044  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 11:04:50.069  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 11:04:50.701  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 11:04:50.844  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.17]\n2017-03-16 11:04:50.845  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 11:04:50.857  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 11:04:50.891  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.17]:5701\n2017-03-16 11:04:50.892  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 11:04:50.892  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 11:04:51.247  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 11:04:52.378  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 11:04:52.648  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 11:04:52.651  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 11:04:52.666  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTING\n2017-03-16 11:04:52.671  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 11:04:52.697  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.17]:5701 - f03beeff-e91d-4e05-ae1c-bf480e59f16f this\n}\n\n2017-03-16 11:04:52.815  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTED\n2017-03-16 11:04:52.818  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.916 seconds (JVM running for 6.944)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 11:04:47.842  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5wv0x with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 11:04:47.857  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 11:04:47.936  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 11:04:47 GMT 2017]; root of context hierarchy
    2017-03-16 11:04:50.044  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 11:04:50.069  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 11:04:50.701  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 11:04:50.844  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.17]
    2017-03-16 11:04:50.845  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 11:04:50.857  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 11:04:50.891  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.17]:5701
    2017-03-16 11:04:50.892  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 11:04:50.892  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 11:04:51.247  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 11:04:52.378  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 11:04:52.648  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 11:04:52.651  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 11:04:52.666  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTING
    2017-03-16 11:04:52.671  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 11:04:52.697  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.17]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.17]:5701 - f03beeff-e91d-4e05-ae1c-bf480e59f16f this
    }
    
    2017-03-16 11:04:52.815  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTED
    2017-03-16 11:04:52.818  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.916 seconds (JVM running for 6.944)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420c20240>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-5k37p\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:20:20 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:20:21 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5k37p}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:20:21 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:20:22 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:20:22 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:20:22 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-5k37p
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  11:20:20 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:20:21 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5k37p}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:20:21 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:20:22 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:20:22 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:20:22 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.253.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-88pk5] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ec1980 exit status 1 <nil> <nil> true [0xc42052a568 0xc42052a580 0xc42052a5a0] [0xc42052a568 0xc42052a580 0xc42052a5a0] [0xc42052a578 0xc42052a598] [0xc35000 0xc35000] 0xc420e4bf80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.253.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-88pk5] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ec1980 exit status 1 <nil> <nil> true [0xc42052a568 0xc42052a580 0xc42052a5a0] [0xc42052a568 0xc42052a580 0xc42052a5a0] [0xc42052a578 0xc42052a598] [0xc35000 0xc35000] 0xc420e4bf80 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3606/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.230.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-psxx2] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c3f7d0 exit status 1 <nil> <nil> true [0xc42048c070 0xc42048c0a8 0xc42048c0d0] [0xc42048c070 0xc42048c0a8 0xc42048c0d0] [0xc42048c0a0 0xc42048c0c0] [0xc35000 0xc35000] 0xc420f1ee40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.230.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-psxx2] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c3f7d0 exit status 1 <nil> <nil> true [0xc42048c070 0xc42048c0a8 0xc42048c0d0] [0xc42048c070 0xc42048c0a8 0xc42048c0d0] [0xc42048c0a0 0xc42048c0c0] [0xc35000 0xc35000] 0xc420f1ee40 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4216d2c00>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-k6949\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:59:48 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:59:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-k6949}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:59:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:59:49 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:59:49 Global memtable off-heap threshold is enabled at 128MB\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\nERROR 11:59:49 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-k6949
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  11:59:48 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:59:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-k6949}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:59:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:59:49 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:59:49 Global memtable off-heap threshold is enabled at 128MB
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    ERROR 11:59:49 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421fd1040>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 12:07:00.974  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wf50l with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 12:07:01.000  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 12:07:01.148  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 12:07:01 GMT 2017]; root of context hierarchy\n2017-03-16 12:07:02.604  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 12:07:02.621  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 12:07:03.216  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 12:07:03.333  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.14]\n2017-03-16 12:07:03.334  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 12:07:03.346  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 12:07:03.377  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.14]:5701\n2017-03-16 12:07:03.377  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 12:07:03.378  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 12:07:03.670  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 12:07:04.490  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 12:07:04.760  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 12:07:04.765  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 12:07:04.773  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.14]:5701 [someGroup] [3.7.5] [10.180.2.14]:5701 is STARTING\n2017-03-16 12:07:04.774  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 12:07:04.799  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.14]:5701 - 4157de68-9679-44b0-ab73-002314a465d6 this\n}\n\n2017-03-16 12:07:04.848  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.14]:5701 [someGroup] [3.7.5] [10.180.2.14]:5701 is STARTED\n2017-03-16 12:07:04.852  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.776 seconds (JVM running for 5.599)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 12:07:00.974  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wf50l with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 12:07:01.000  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 12:07:01.148  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 12:07:01 GMT 2017]; root of context hierarchy
    2017-03-16 12:07:02.604  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 12:07:02.621  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 12:07:03.216  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 12:07:03.333  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.14]
    2017-03-16 12:07:03.334  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 12:07:03.346  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 12:07:03.377  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.14]:5701
    2017-03-16 12:07:03.377  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 12:07:03.378  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 12:07:03.670  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 12:07:04.490  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 12:07:04.760  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 12:07:04.765  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 12:07:04.773  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.14]:5701 [someGroup] [3.7.5] [10.180.2.14]:5701 is STARTING
    2017-03-16 12:07:04.774  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 12:07:04.799  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.14]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.14]:5701 - 4157de68-9679-44b0-ab73-002314a465d6 this
    }
    
    2017-03-16 12:07:04.848  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.14]:5701 [someGroup] [3.7.5] [10.180.2.14]:5701 is STARTED
    2017-03-16 12:07:04.852  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.776 seconds (JVM running for 5.599)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3607/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421253010>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 12:46:09.169  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-f50r1 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 12:46:09.176  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 12:46:09.345  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 12:46:09 GMT 2017]; root of context hierarchy\n2017-03-16 12:46:10.947  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 12:46:10.973  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 12:46:11.659  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 12:46:11.785  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.6]\n2017-03-16 12:46:11.786  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 12:46:11.799  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 12:46:11.840  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.6]:5701\n2017-03-16 12:46:11.841  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 12:46:11.841  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 12:46:12.231  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 12:46:13.153  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 12:46:13.441  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 12:46:13.442  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 12:46:13.466  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.6]:5701 [someGroup] [3.7.5] [10.180.0.6]:5701 is STARTING\n2017-03-16 12:46:13.469  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 12:46:13.497  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.6]:5701 - 7e208201-b904-4f3c-aed5-aa4789599bc5 this\n}\n\n2017-03-16 12:46:13.579  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.6]:5701 [someGroup] [3.7.5] [10.180.0.6]:5701 is STARTED\n2017-03-16 12:46:13.582  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.486 seconds (JVM running for 6.398)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 12:46:09.169  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-f50r1 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 12:46:09.176  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 12:46:09.345  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 12:46:09 GMT 2017]; root of context hierarchy
    2017-03-16 12:46:10.947  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 12:46:10.973  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 12:46:11.659  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 12:46:11.785  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.6]
    2017-03-16 12:46:11.786  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 12:46:11.799  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 12:46:11.840  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.6]:5701
    2017-03-16 12:46:11.841  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 12:46:11.841  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 12:46:12.231  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 12:46:13.153  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 12:46:13.441  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 12:46:13.442  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 12:46:13.466  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.6]:5701 [someGroup] [3.7.5] [10.180.0.6]:5701 is STARTING
    2017-03-16 12:46:13.469  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 12:46:13.497  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.6]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.0.6]:5701 - 7e208201-b904-4f3c-aed5-aa4789599bc5 this
    }
    
    2017-03-16 12:46:13.579  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.6]:5701 [someGroup] [3.7.5] [10.180.0.6]:5701 is STARTED
    2017-03-16 12:46:13.582  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.486 seconds (JVM running for 6.398)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.235.78 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-twfc0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4217fa1b0 exit status 1 <nil> <nil> true [0xc420037670 0xc420037688 0xc4200376a0] [0xc420037670 0xc420037688 0xc4200376a0] [0xc420037680 0xc420037698] [0xc35000 0xc35000] 0xc4218a72c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.235.78 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-twfc0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4217fa1b0 exit status 1 <nil> <nil> true [0xc420037670 0xc420037688 0xc4200376a0] [0xc420037670 0xc420037688 0xc4200376a0] [0xc420037680 0xc420037698] [0xc35000 0xc35000] 0xc4218a72c0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421ab6c20>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.17\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.17\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.17\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.17\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bxs1s\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:18:54 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:18:55 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.17; broadcast_rpc_address=10.180.0.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bxs1s}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:18:55 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:18:56 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:18:56 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:18:56 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.17
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.0.17
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.17
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.0.17
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-bxs1s
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  13:18:54 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:18:55 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.17; broadcast_rpc_address=10.180.0.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bxs1s}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:18:55 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:18:56 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:18:56 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:18:56 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3608/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.253.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ftt81] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4211aaa80 exit status 1 <nil> <nil> true [0xc4204a6290 0xc4204a62a8 0xc4204a62c0] [0xc4204a6290 0xc4204a62a8 0xc4204a62c0] [0xc4204a62a0 0xc4204a62b8] [0xc35000 0xc35000] 0xc420e6b800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.253.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ftt81] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4211aaa80 exit status 1 <nil> <nil> true [0xc4204a6290 0xc4204a62a8 0xc4204a62c0] [0xc4204a6290 0xc4204a62a8 0xc4204a62c0] [0xc4204a62a0 0xc4204a62b8] [0xc35000 0xc35000] 0xc420e6b800 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421d36690>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-7wzr6\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:55:58 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:56:00 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7wzr6}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:56:00 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:56:00 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:56:00 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:56:00 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-7wzr6
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  13:55:58 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:56:00 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7wzr6}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:56:00 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:56:00 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:56:00 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:56:00 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421d35200>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 14:06:47.959  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-1cbvd with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 14:06:47.971  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 14:06:48.085  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 14:06:48 GMT 2017]; root of context hierarchy\n2017-03-16 14:06:50.049  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 14:06:50.075  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 14:06:50.723  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 14:06:50.856  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.11]\n2017-03-16 14:06:50.857  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 14:06:50.870  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 14:06:50.906  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.11]:5701\n2017-03-16 14:06:50.906  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 14:06:50.906  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 14:06:51.285  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 14:06:52.314  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 14:06:52.580  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 14:06:52.590  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 14:06:52.600  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTING\n2017-03-16 14:06:52.601  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 14:06:52.621  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.11]:5701 - c024a314-1e5a-4b7e-90ac-f607309b6197 this\n}\n\n2017-03-16 14:06:52.682  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTED\n2017-03-16 14:06:52.686  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.754 seconds (JVM running for 6.674)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 14:06:47.959  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-1cbvd with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 14:06:47.971  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 14:06:48.085  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 14:06:48 GMT 2017]; root of context hierarchy
    2017-03-16 14:06:50.049  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 14:06:50.075  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 14:06:50.723  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 14:06:50.856  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.11]
    2017-03-16 14:06:50.857  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 14:06:50.870  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 14:06:50.906  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.11]:5701
    2017-03-16 14:06:50.906  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 14:06:50.906  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 14:06:51.285  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 14:06:52.314  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 14:06:52.580  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 14:06:52.590  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 14:06:52.600  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTING
    2017-03-16 14:06:52.601  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 14:06:52.621  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.11]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.11]:5701 - c024a314-1e5a-4b7e-90ac-f607309b6197 this
    }
    
    2017-03-16 14:06:52.682  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTED
    2017-03-16 14:06:52.686  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.754 seconds (JVM running for 6.674)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3609/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421dc6930>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 15:05:46.260  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-q9crj with PID 8 (/bootstrapper.jar started by root in /)\n2017-03-16 15:05:46.275  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 15:05:46.456  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 15:05:46 GMT 2017]; root of context hierarchy\n2017-03-16 15:05:48.215  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 15:05:48.237  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 15:05:49.070  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 15:05:49.244  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.12]\n2017-03-16 15:05:49.244  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 15:05:49.258  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 15:05:49.296  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.12]:5701\n2017-03-16 15:05:49.296  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 15:05:49.296  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 15:05:49.670  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.12]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 15:05:50.716  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.180.3.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 15:05:51.004  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 15:05:51.006  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 15:05:51.021  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.12]:5701 [someGroup] [3.7.5] [10.180.3.12]:5701 is STARTING\n2017-03-16 15:05:51.024  INFO 8 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 15:05:51.044  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.12]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.12]:5701 - 9c35bfcb-b321-4a66-9c95-5a4273fa075e this\n}\n\n2017-03-16 15:05:51.127  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.12]:5701 [someGroup] [3.7.5] [10.180.3.12]:5701 is STARTED\n2017-03-16 15:05:51.131  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.971 seconds (JVM running for 6.945)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 15:05:46.260  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-q9crj with PID 8 (/bootstrapper.jar started by root in /)
    2017-03-16 15:05:46.275  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 15:05:46.456  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 15:05:46 GMT 2017]; root of context hierarchy
    2017-03-16 15:05:48.215  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 15:05:48.237  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 15:05:49.070  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 15:05:49.244  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.12]
    2017-03-16 15:05:49.244  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 15:05:49.258  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 15:05:49.296  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.12]:5701
    2017-03-16 15:05:49.296  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 15:05:49.296  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 15:05:49.670  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.12]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 15:05:50.716  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.180.3.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 15:05:51.004  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 15:05:51.006  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 15:05:51.021  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.12]:5701 [someGroup] [3.7.5] [10.180.3.12]:5701 is STARTING
    2017-03-16 15:05:51.024  INFO 8 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 15:05:51.044  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.12]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.12]:5701 - 9c35bfcb-b321-4a66-9c95-5a4273fa075e this
    }
    
    2017-03-16 15:05:51.127  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.12]:5701 [someGroup] [3.7.5] [10.180.3.12]:5701 is STARTED
    2017-03-16 15:05:51.131  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.971 seconds (JVM running for 6.945)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.235.78 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zzzjh] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e0ab40 exit status 1 <nil> <nil> true [0xc4202ea440 0xc4202ea470 0xc4202ea4a8] [0xc4202ea440 0xc4202ea470 0xc4202ea4a8] [0xc4202ea460 0xc4202ea498] [0xc35000 0xc35000] 0xc420b45620 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.235.78 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zzzjh] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e0ab40 exit status 1 <nil> <nil> true [0xc4202ea440 0xc4202ea470 0xc4202ea4a8] [0xc4202ea440 0xc4202ea470 0xc4202ea4a8] [0xc4202ea460 0xc4202ea498] [0xc35000 0xc35000] 0xc420b45620 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4216d0840>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-1fxxr\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:03:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:03:32 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.11; broadcast_rpc_address=10.180.3.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1fxxr}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:03:32 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:03:32 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:03:33 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:03:33 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-1fxxr
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  15:03:30 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:03:32 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.11; broadcast_rpc_address=10.180.3.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1fxxr}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:03:32 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:03:32 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:03:33 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:03:33 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3610/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420ca0550>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 15:53:27.998  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-xxqmb with PID 8 (/bootstrapper.jar started by root in /)\n2017-03-16 15:53:28.016  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 15:53:28.106  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 15:53:28 GMT 2017]; root of context hierarchy\n2017-03-16 15:53:29.983  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 15:53:30.000  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 15:53:30.652  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 15:53:30.777  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]\n2017-03-16 15:53:30.778  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 15:53:30.791  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 15:53:30.833  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701\n2017-03-16 15:53:30.834  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 15:53:30.834  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 15:53:31.210  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 15:53:32.078  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 15:53:32.371  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 15:53:32.376  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 15:53:32.385  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING\n2017-03-16 15:53:32.387  INFO 8 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 15:53:32.420  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.9]:5701 - b1ee3045-9663-4dc8-9d26-fbcfa6ffefc4 this\n}\n\n2017-03-16 15:53:32.495  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED\n2017-03-16 15:53:32.501  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.46 seconds (JVM running for 6.339)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 15:53:27.998  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-xxqmb with PID 8 (/bootstrapper.jar started by root in /)
    2017-03-16 15:53:28.016  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 15:53:28.106  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 15:53:28 GMT 2017]; root of context hierarchy
    2017-03-16 15:53:29.983  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 15:53:30.000  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 15:53:30.652  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 15:53:30.777  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]
    2017-03-16 15:53:30.778  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 15:53:30.791  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 15:53:30.833  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701
    2017-03-16 15:53:30.834  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 15:53:30.834  INFO 8 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 15:53:31.210  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 15:53:32.078  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 15:53:32.371  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 15:53:32.376  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 15:53:32.385  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING
    2017-03-16 15:53:32.387  INFO 8 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 15:53:32.420  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.9]:5701 - b1ee3045-9663-4dc8-9d26-fbcfa6ffefc4 this
    }
    
    2017-03-16 15:53:32.495  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED
    2017-03-16 15:53:32.501  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.46 seconds (JVM running for 6.339)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.230.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-dztzw] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420b5a720 exit status 1 <nil> <nil> true [0xc420f12d08 0xc420f12d20 0xc420f12d38] [0xc420f12d08 0xc420f12d20 0xc420f12d38] [0xc420f12d18 0xc420f12d30] [0xc35000 0xc35000] 0xc42176c780 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.230.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-dztzw] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420b5a720 exit status 1 <nil> <nil> true [0xc420f12d08 0xc420f12d20 0xc420f12d38] [0xc420f12d08 0xc420f12d20 0xc420f12d38] [0xc420f12d18 0xc420f12d30] [0xc35000 0xc35000] 0xc42176c780 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421850690>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bg94d\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  16:11:44 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  16:11:45 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bg94d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  16:11:45 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  16:11:45 Global memtable on-heap threshold is enabled at 128MB\nINFO  16:11:45 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:11:45 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-bg94d
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  16:11:44 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  16:11:45 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bg94d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  16:11:45 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  16:11:45 Global memtable on-heap threshold is enabled at 128MB
    INFO  16:11:45 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 16:11:45 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3611/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4213f5900>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-40tkp\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  17:12:36 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  17:12:37 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-40tkp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  17:12:37 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  17:12:37 Global memtable on-heap threshold is enabled at 128MB\nINFO  17:12:37 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:12:38 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-40tkp
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  17:12:36 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  17:12:37 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-40tkp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  17:12:37 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  17:12:37 Global memtable on-heap threshold is enabled at 128MB
    INFO  17:12:37 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 17:12:38 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.47.174 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-bxwg0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4212754d0 exit status 1 <nil> <nil> true [0xc420034cd8 0xc420034cf8 0xc420034d30] [0xc420034cd8 0xc420034cf8 0xc420034d30] [0xc420034cf0 0xc420034d18] [0xc35000 0xc35000] 0xc420bd5260 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.47.174 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-bxwg0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4212754d0 exit status 1 <nil> <nil> true [0xc420034cd8 0xc420034cf8 0xc420034d30] [0xc420034cd8 0xc420034cf8 0xc420034d30] [0xc420034cf0 0xc420034d18] [0xc35000 0xc35000] 0xc420bd5260 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420b52740>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 16:57:25.154  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wf11p with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 16:57:25.172  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 16:57:25.343  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 16:57:25 GMT 2017]; root of context hierarchy\n2017-03-16 16:57:27.000  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 16:57:27.026  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 16:57:27.813  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 16:57:27.960  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.13]\n2017-03-16 16:57:27.961  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 16:57:27.975  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 16:57:28.011  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.13]:5701\n2017-03-16 16:57:28.011  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 16:57:28.011  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 16:57:28.386  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 16:57:29.294  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 16:57:29.658  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 16:57:29.662  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 16:57:29.673  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTING\n2017-03-16 16:57:29.676  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 16:57:29.699  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.13]:5701 - 227c0311-2bde-498d-86a9-3fad162d4cde this\n}\n\n2017-03-16 16:57:29.767  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTED\n2017-03-16 16:57:29.774  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.595 seconds (JVM running for 6.44)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 16:57:25.154  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wf11p with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 16:57:25.172  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 16:57:25.343  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 16:57:25 GMT 2017]; root of context hierarchy
    2017-03-16 16:57:27.000  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 16:57:27.026  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 16:57:27.813  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 16:57:27.960  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.13]
    2017-03-16 16:57:27.961  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 16:57:27.975  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 16:57:28.011  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.13]:5701
    2017-03-16 16:57:28.011  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 16:57:28.011  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 16:57:28.386  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 16:57:29.294  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 16:57:29.658  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 16:57:29.662  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 16:57:29.673  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTING
    2017-03-16 16:57:29.676  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 16:57:29.699  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.13]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.13]:5701 - 227c0311-2bde-498d-86a9-3fad162d4cde this
    }
    
    2017-03-16 16:57:29.767  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTED
    2017-03-16 16:57:29.774  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.595 seconds (JVM running for 6.44)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@calebamiles calebamiles modified the milestone: v1.6 Mar 16, 2017
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3612/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42088f6a0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 18:04:13.569  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-234k8 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 18:04:13.588  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 18:04:13.705  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 18:04:13 GMT 2017]; root of context hierarchy\n2017-03-16 18:04:15.395  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 18:04:15.420  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 18:04:16.252  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 18:04:16.382  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-16 18:04:16.383  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 18:04:16.397  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 18:04:16.451  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-16 18:04:16.451  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 18:04:16.451  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 18:04:16.847  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 18:04:17.788  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 18:04:18.106  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 18:04:18.115  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 18:04:18.123  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-16 18:04:18.127  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 18:04:18.157  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - e737ccd9-2782-4deb-8f87-e5c609fa3b38 this\n}\n\n2017-03-16 18:04:18.228  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-16 18:04:18.236  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.745 seconds (JVM running for 6.692)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 18:04:13.569  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-234k8 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 18:04:13.588  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 18:04:13.705  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 18:04:13 GMT 2017]; root of context hierarchy
    2017-03-16 18:04:15.395  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 18:04:15.420  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 18:04:16.252  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 18:04:16.382  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
    2017-03-16 18:04:16.383  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 18:04:16.397  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 18:04:16.451  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
    2017-03-16 18:04:16.451  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 18:04:16.451  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 18:04:16.847  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 18:04:17.788  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 18:04:18.106  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 18:04:18.115  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 18:04:18.123  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
    2017-03-16 18:04:18.127  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 18:04:18.157  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.18]:5701 - e737ccd9-2782-4deb-8f87-e5c609fa3b38 this
    }
    
    2017-03-16 18:04:18.228  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
    2017-03-16 18:04:18.236  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.745 seconds (JVM running for 6.692)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.47.174 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9dj7z] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4211da210 exit status 1 <nil> <nil> true [0xc4201f04c8 0xc4201f04f0 0xc4201f0508] [0xc4201f04c8 0xc4201f04f0 0xc4201f0508] [0xc4201f04e0 0xc4201f0500] [0xc360d0 0xc360d0] 0xc4212dfaa0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.47.174 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9dj7z] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4211da210 exit status 1 <nil> <nil> true [0xc4201f04c8 0xc4201f04f0 0xc4201f0508] [0xc4201f04c8 0xc4201f04f0 0xc4201f0508] [0xc4201f04e0 0xc4201f0500] [0xc360d0 0xc360d0] 0xc4212dfaa0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421c3a1c0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-hlr1m\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:27:21 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:27:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hlr1m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:27:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:27:23 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:27:23 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:27:23 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-hlr1m
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  18:27:21 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:27:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hlr1m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:27:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:27:23 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:27:23 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:27:23 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3613/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.98.89 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5282t] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dcfb60 exit status 1 <nil> <nil> true [0xc420570228 0xc420570240 0xc420570260] [0xc420570228 0xc420570240 0xc420570260] [0xc420570238 0xc420570258] [0xc360d0 0xc360d0] 0xc4213b87e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.98.89 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5282t] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420dcfb60 exit status 1 <nil> <nil> true [0xc420570228 0xc420570240 0xc420570260] [0xc420570228 0xc420570240 0xc420570260] [0xc420570238 0xc420570258] [0xc360d0 0xc360d0] 0xc4213b87e0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420caa920>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 18:59:53.441  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-r4vw8 with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 18:59:53.457  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 18:59:53.703  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 18:59:53 GMT 2017]; root of context hierarchy\n2017-03-16 18:59:55.547  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 18:59:55.569  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 18:59:56.363  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 18:59:56.517  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.7]\n2017-03-16 18:59:56.517  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 18:59:56.531  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 18:59:56.570  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.7]:5701\n2017-03-16 18:59:56.571  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 18:59:56.571  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 18:59:56.998  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.7]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 18:59:58.221  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 18:59:58.555  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 18:59:58.560  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 18:59:58.574  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.7]:5701 [someGroup] [3.7.5] [10.180.2.7]:5701 is STARTING\n2017-03-16 18:59:58.578  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 18:59:58.605  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.7]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.7]:5701 - f8555782-780b-44ab-b076-ea11a34f4261 this\n}\n\n2017-03-16 18:59:58.692  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.7]:5701 [someGroup] [3.7.5] [10.180.2.7]:5701 is STARTED\n2017-03-16 18:59:58.698  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.854 seconds (JVM running for 8.178)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 18:59:53.441  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-r4vw8 with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 18:59:53.457  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 18:59:53.703  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 18:59:53 GMT 2017]; root of context hierarchy
    2017-03-16 18:59:55.547  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 18:59:55.569  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 18:59:56.363  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 18:59:56.517  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.7]
    2017-03-16 18:59:56.517  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 18:59:56.531  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 18:59:56.570  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.7]:5701
    2017-03-16 18:59:56.571  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 18:59:56.571  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 18:59:56.998  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.7]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 18:59:58.221  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 18:59:58.555  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 18:59:58.560  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 18:59:58.574  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.7]:5701 [someGroup] [3.7.5] [10.180.2.7]:5701 is STARTING
    2017-03-16 18:59:58.578  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 18:59:58.605  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.7]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.7]:5701 - f8555782-780b-44ab-b076-ea11a34f4261 this
    }
    
    2017-03-16 18:59:58.692  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.7]:5701 [someGroup] [3.7.5] [10.180.2.7]:5701 is STARTED
    2017-03-16 18:59:58.698  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.854 seconds (JVM running for 8.178)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc422036bc0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-22m95\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  19:34:05 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  19:34:06 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.18; broadcast_rpc_address=10.180.2.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-22m95}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  19:34:06 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  19:34:07 Global memtable on-heap threshold is enabled at 128MB\nINFO  19:34:07 Global memtable off-heap threshold is enabled at 128MB\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 19:34:07 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.18
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.18
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.18
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.18
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-22m95
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  19:34:05 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  19:34:06 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.18; broadcast_rpc_address=10.180.2.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-22m95}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  19:34:06 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  19:34:07 Global memtable on-heap threshold is enabled at 128MB
    INFO  19:34:07 Global memtable off-heap threshold is enabled at 128MB
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 19:34:07 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3614/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420cd8e10>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-m8xzq\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  20:08:26 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  20:08:27 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-m8xzq}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  20:08:27 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  20:08:28 Global memtable on-heap threshold is enabled at 128MB\nINFO  20:08:28 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:08:28 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-m8xzq
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  20:08:26 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  20:08:27 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-m8xzq}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  20:08:27 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  20:08:28 Global memtable on-heap threshold is enabled at 128MB
    INFO  20:08:28 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 20:08:28 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.90.4 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9x7dr] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420865860 exit status 1 <nil> <nil> true [0xc420480498 0xc4204804d0 0xc420480518] [0xc420480498 0xc4204804d0 0xc420480518] [0xc4204804c8 0xc420480510] [0xc360d0 0xc360d0] 0xc4207d5020 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.90.4 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9x7dr] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420865860 exit status 1 <nil> <nil> true [0xc420480498 0xc4204804d0 0xc420480518] [0xc420480498 0xc4204804d0 0xc420480518] [0xc4204804c8 0xc420480510] [0xc360d0 0xc360d0] 0xc4207d5020 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4220604f0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 20:27:45.019  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-1dlwp with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 20:27:45.027  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 20:27:45.191  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 20:27:45 GMT 2017]; root of context hierarchy\n2017-03-16 20:27:46.877  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 20:27:46.897  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 20:27:47.554  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 20:27:47.709  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.22]\n2017-03-16 20:27:47.709  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 20:27:47.722  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 20:27:47.764  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.22]:5701\n2017-03-16 20:27:47.764  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 20:27:47.765  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 20:27:48.179  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.22]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 20:27:49.111  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 20:27:49.413  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 20:27:49.418  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 20:27:49.431  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.22]:5701 [someGroup] [3.7.5] [10.180.3.22]:5701 is STARTING\n2017-03-16 20:27:49.434  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 20:27:49.459  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.22]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.22]:5701 - fe758ffe-598a-4b26-9ca2-4661b0c5e06f this\n}\n\n2017-03-16 20:27:49.547  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.22]:5701 [someGroup] [3.7.5] [10.180.3.22]:5701 is STARTED\n2017-03-16 20:27:49.550  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.598 seconds (JVM running for 6.428)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 20:27:45.019  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-1dlwp with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 20:27:45.027  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 20:27:45.191  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 20:27:45 GMT 2017]; root of context hierarchy
    2017-03-16 20:27:46.877  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 20:27:46.897  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 20:27:47.554  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 20:27:47.709  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.22]
    2017-03-16 20:27:47.709  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 20:27:47.722  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 20:27:47.764  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.22]:5701
    2017-03-16 20:27:47.764  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 20:27:47.765  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 20:27:48.179  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.22]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 20:27:49.111  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 20:27:49.413  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 20:27:49.418  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 20:27:49.431  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.22]:5701 [someGroup] [3.7.5] [10.180.3.22]:5701 is STARTING
    2017-03-16 20:27:49.434  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 20:27:49.459  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.22]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.22]:5701 - fe758ffe-598a-4b26-9ca2-4661b0c5e06f this
    }
    
    2017-03-16 20:27:49.547  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.22]:5701 [someGroup] [3.7.5] [10.180.3.22]:5701 is STARTED
    2017-03-16 20:27:49.550  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.598 seconds (JVM running for 6.428)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3615/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421235420>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-04hzk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  21:16:23 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  21:16:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.7; broadcast_rpc_address=10.180.2.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-04hzk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  21:16:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  21:16:24 Global memtable on-heap threshold is enabled at 128MB\nINFO  21:16:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:16:25 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-04hzk
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  21:16:23 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  21:16:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.7; broadcast_rpc_address=10.180.2.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-04hzk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  21:16:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  21:16:24 Global memtable on-heap threshold is enabled at 128MB
    INFO  21:16:24 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 21:16:25 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4210149c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 21:32:05.185  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9v8gk with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 21:32:05.201  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 21:32:05.308  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 21:32:05 GMT 2017]; root of context hierarchy\n2017-03-16 21:32:07.414  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 21:32:07.437  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 21:32:08.108  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 21:32:08.236  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-16 21:32:08.236  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 21:32:08.247  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 21:32:08.283  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-16 21:32:08.283  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 21:32:08.283  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 21:32:08.674  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 21:32:09.615  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 21:32:09.898  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 21:32:09.899  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 21:32:09.914  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-16 21:32:09.917  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 21:32:09.935  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - 2b83b469-f127-447b-bd3d-5d6304177102 this\n}\n\n2017-03-16 21:32:09.990  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-16 21:32:10.000  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.925 seconds (JVM running for 6.909)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 21:32:05.185  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9v8gk with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 21:32:05.201  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 21:32:05.308  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 21:32:05 GMT 2017]; root of context hierarchy
    2017-03-16 21:32:07.414  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 21:32:07.437  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 21:32:08.108  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 21:32:08.236  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
    2017-03-16 21:32:08.236  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 21:32:08.247  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 21:32:08.283  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
    2017-03-16 21:32:08.283  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 21:32:08.283  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 21:32:08.674  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 21:32:09.615  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 21:32:09.898  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 21:32:09.899  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 21:32:09.914  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
    2017-03-16 21:32:09.917  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 21:32:09.935  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.18]:5701 - 2b83b469-f127-447b-bd3d-5d6304177102 this
    }
    
    2017-03-16 21:32:09.990  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
    2017-03-16 21:32:10.000  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.925 seconds (JVM running for 6.909)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.164.11 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gszb8] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421553200 exit status 1 <nil> <nil> true [0xc42053a690 0xc42053a6a8 0xc42053a6c0] [0xc42053a690 0xc42053a6a8 0xc42053a6c0] [0xc42053a6a0 0xc42053a6b8] [0xc360d0 0xc360d0] 0xc4207817a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.164.11 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gszb8] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421553200 exit status 1 <nil> <nil> true [0xc42053a690 0xc42053a6a8 0xc42053a6c0] [0xc42053a690 0xc42053a6a8 0xc42053a6c0] [0xc42053a6a0 0xc42053a6b8] [0xc360d0 0xc360d0] 0xc4207817a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3616/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://107.178.208.190 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nqzw3] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421249530 exit status 1 <nil> <nil> true [0xc420f9b0c8 0xc420f9b0e0 0xc420f9b0f8] [0xc420f9b0c8 0xc420f9b0e0 0xc420f9b0f8] [0xc420f9b0d8 0xc420f9b0f0] [0xc360d0 0xc360d0] 0xc4211d97a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://107.178.208.190 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nqzw3] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421249530 exit status 1 <nil> <nil> true [0xc420f9b0c8 0xc420f9b0e0 0xc420f9b0f8] [0xc420f9b0c8 0xc420f9b0e0 0xc420f9b0f8] [0xc420f9b0d8 0xc420f9b0f0] [0xc360d0 0xc360d0] 0xc4211d97a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421c891b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.20\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.20\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.20\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.20\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-37zzg\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  22:35:17 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  22:35:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.20; broadcast_rpc_address=10.180.1.20; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.20; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-37zzg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  22:35:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  22:35:19 Global memtable on-heap threshold is enabled at 128MB\nINFO  22:35:19 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 22:35:19 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.20
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.20
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.20
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.20
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-37zzg
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  22:35:17 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  22:35:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.20; broadcast_rpc_address=10.180.1.20; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.20; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-37zzg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  22:35:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  22:35:19 Global memtable on-heap threshold is enabled at 128MB
    INFO  22:35:19 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 22:35:19 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4208aa3f0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 22:07:55.700  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-vf1tj with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 22:07:55.708  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 22:07:55.796  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 22:07:55 GMT 2017]; root of context hierarchy\n2017-03-16 22:07:57.641  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 22:07:57.660  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 22:07:58.288  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 22:07:58.435  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.4]\n2017-03-16 22:07:58.436  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 22:07:58.449  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 22:07:58.485  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.4]:5701\n2017-03-16 22:07:58.485  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 22:07:58.485  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 22:07:58.998  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.4]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 22:07:59.998  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 22:08:00.290  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 22:08:00.296  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 22:08:00.319  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.4]:5701 [someGroup] [3.7.5] [10.180.1.4]:5701 is STARTING\n2017-03-16 22:08:00.321  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 22:08:00.352  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.4]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.4]:5701 - b0ba69ea-bcbe-4b5c-9d20-36b634b7f9c1 this\n}\n\n2017-03-16 22:08:00.414  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.4]:5701 [someGroup] [3.7.5] [10.180.1.4]:5701 is STARTED\n2017-03-16 22:08:00.417  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.673 seconds (JVM running for 6.585)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 22:07:55.700  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-vf1tj with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 22:07:55.708  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 22:07:55.796  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 22:07:55 GMT 2017]; root of context hierarchy
    2017-03-16 22:07:57.641  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 22:07:57.660  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 22:07:58.288  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 22:07:58.435  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.4]
    2017-03-16 22:07:58.436  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 22:07:58.449  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 22:07:58.485  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.4]:5701
    2017-03-16 22:07:58.485  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 22:07:58.485  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 22:07:58.998  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.4]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 22:07:59.998  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 22:08:00.290  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 22:08:00.296  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 22:08:00.319  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.4]:5701 [someGroup] [3.7.5] [10.180.1.4]:5701 is STARTING
    2017-03-16 22:08:00.321  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 22:08:00.352  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.4]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.4]:5701 - b0ba69ea-bcbe-4b5c-9d20-36b634b7f9c1 this
    }
    
    2017-03-16 22:08:00.414  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.4]:5701 [someGroup] [3.7.5] [10.180.1.4]:5701 is STARTED
    2017-03-16 22:08:00.417  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.673 seconds (JVM running for 6.585)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3617/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4213239c0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.21\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.21\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.21\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.21\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-01z76\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  23:43:38 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  23:43:39 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.21; broadcast_rpc_address=10.180.2.21; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.21; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-01z76}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  23:43:39 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  23:43:40 Global memtable on-heap threshold is enabled at 128MB\nINFO  23:43:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 23:43:40 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.21
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.21
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.21
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.21
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-01z76
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  23:43:38 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  23:43:39 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.21; broadcast_rpc_address=10.180.2.21; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.21; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-01z76}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  23:43:39 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  23:43:40 Global memtable on-heap threshold is enabled at 128MB
    INFO  23:43:40 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 23:43:40 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420e0dd60>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 23:16:28.983  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-k6l43 with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 23:16:29.006  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 23:16:29.112  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 23:16:29 GMT 2017]; root of context hierarchy\n2017-03-16 23:16:30.945  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 23:16:30.969  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 23:16:31.688  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 23:16:31.810  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.11]\n2017-03-16 23:16:31.811  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 23:16:31.823  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 23:16:31.863  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.11]:5701\n2017-03-16 23:16:31.863  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 23:16:31.864  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 23:16:32.229  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 23:16:33.276  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 23:16:33.625  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 23:16:33.632  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 23:16:33.651  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTING\n2017-03-16 23:16:33.652  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 23:16:33.676  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.11]:5701 - 03df100c-ea64-453e-8dea-c14ea98404ce this\n}\n\n2017-03-16 23:16:33.738  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTED\n2017-03-16 23:16:33.743  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.975 seconds (JVM running for 6.899)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 23:16:28.983  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-k6l43 with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 23:16:29.006  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 23:16:29.112  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 23:16:29 GMT 2017]; root of context hierarchy
    2017-03-16 23:16:30.945  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 23:16:30.969  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 23:16:31.688  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 23:16:31.810  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.11]
    2017-03-16 23:16:31.811  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 23:16:31.823  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 23:16:31.863  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.11]:5701
    2017-03-16 23:16:31.863  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 23:16:31.864  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 23:16:32.229  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 23:16:33.276  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 23:16:33.625  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 23:16:33.632  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 23:16:33.651  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTING
    2017-03-16 23:16:33.652  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 23:16:33.676  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.11]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.11]:5701 - 03df100c-ea64-453e-8dea-c14ea98404ce this
    }
    
    2017-03-16 23:16:33.738  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTED
    2017-03-16 23:16:33.743  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.975 seconds (JVM running for 6.899)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.17.79 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-09rkh] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4212812c0 exit status 1 <nil> <nil> true [0xc420ed6170 0xc420ed6198 0xc420ed61c8] [0xc420ed6170 0xc420ed6198 0xc420ed61c8] [0xc420ed6190 0xc420ed61b0] [0xc35e70 0xc35e70] 0xc42082cc00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.17.79 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-09rkh] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4212812c0 exit status 1 <nil> <nil> true [0xc420ed6170 0xc420ed6198 0xc420ed61c8] [0xc420ed6170 0xc420ed6198 0xc420ed61c8] [0xc420ed6190 0xc420ed61b0] [0xc35e70 0xc35e70] 0xc42082cc00 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3618/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420eaada0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 00:31:08.557  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-764sm with PID 9 (/bootstrapper.jar started by root in /)\n2017-03-17 00:31:08.565  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 00:31:08.652  INFO 9 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 00:31:08 GMT 2017]; root of context hierarchy\n2017-03-17 00:31:10.748  INFO 9 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 00:31:10.771  INFO 9 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 00:31:11.672  INFO 9 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 00:31:11.838  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.17]\n2017-03-17 00:31:11.838  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 00:31:11.856  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 00:31:11.899  INFO 9 --- [           main] com.hazelcast.system                     : [10.180.0.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.17]:5701\n2017-03-17 00:31:11.899  INFO 9 --- [           main] com.hazelcast.system                     : [10.180.0.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 00:31:11.900  INFO 9 --- [           main] com.hazelcast.system                     : [10.180.0.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 00:31:12.296  INFO 9 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 00:31:13.298  INFO 9 --- [           main] com.hazelcast.instance.Node              : [10.180.0.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 00:31:13.581  INFO 9 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 00:31:13.583  INFO 9 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 00:31:13.603  INFO 9 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.17]:5701 [someGroup] [3.7.5] [10.180.0.17]:5701 is STARTING\n2017-03-17 00:31:13.605  INFO 9 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 00:31:13.630  INFO 9 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.17]:5701 - aa434da8-9dc8-4828-93f5-4a96935dd63b this\n}\n\n2017-03-17 00:31:13.698  INFO 9 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.17]:5701 [someGroup] [3.7.5] [10.180.0.17]:5701 is STARTED\n2017-03-17 00:31:13.705  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.328 seconds (JVM running for 7.404)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 00:31:08.557  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-764sm with PID 9 (/bootstrapper.jar started by root in /)
    2017-03-17 00:31:08.565  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 00:31:08.652  INFO 9 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 00:31:08 GMT 2017]; root of context hierarchy
    2017-03-17 00:31:10.748  INFO 9 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 00:31:10.771  INFO 9 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 00:31:11.672  INFO 9 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 00:31:11.838  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.17]
    2017-03-17 00:31:11.838  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 00:31:11.856  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 00:31:11.899  INFO 9 --- [           main] com.hazelcast.system                     : [10.180.0.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.17]:5701
    2017-03-17 00:31:11.899  INFO 9 --- [           main] com.hazelcast.system                     : [10.180.0.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 00:31:11.900  INFO 9 --- [           main] com.hazelcast.system                     : [10.180.0.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 00:31:12.296  INFO 9 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 00:31:13.298  INFO 9 --- [           main] com.hazelcast.instance.Node              : [10.180.0.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 00:31:13.581  INFO 9 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 00:31:13.583  INFO 9 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 00:31:13.603  INFO 9 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.17]:5701 [someGroup] [3.7.5] [10.180.0.17]:5701 is STARTING
    2017-03-17 00:31:13.605  INFO 9 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 00:31:13.630  INFO 9 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.17]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.0.17]:5701 - aa434da8-9dc8-4828-93f5-4a96935dd63b this
    }
    
    2017-03-17 00:31:13.698  INFO 9 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.17]:5701 [someGroup] [3.7.5] [10.180.0.17]:5701 is STARTED
    2017-03-17 00:31:13.705  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.328 seconds (JVM running for 7.404)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.81.224 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zhbr0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42139b980 exit status 1 <nil> <nil> true [0xc420034080 0xc4200340b8 0xc4200340d8] [0xc420034080 0xc4200340b8 0xc4200340d8] [0xc4200340a8 0xc4200340d0] [0xc35e70 0xc35e70] 0xc42103ad20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.81.224 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zhbr0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42139b980 exit status 1 <nil> <nil> true [0xc420034080 0xc4200340b8 0xc4200340d8] [0xc420034080 0xc4200340b8 0xc4200340d8] [0xc4200340a8 0xc4200340d0] [0xc35e70 0xc35e70] 0xc42103ad20 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42180f050>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.25\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.25\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.25\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.25\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-ftgc3\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  00:51:06 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  00:51:08 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.25; broadcast_rpc_address=10.180.0.25; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.25; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ftgc3}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  00:51:08 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  00:51:08 Global memtable on-heap threshold is enabled at 128MB\nINFO  00:51:08 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 00:51:08 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.25
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.0.25
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.25
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.0.25
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-ftgc3
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  00:51:06 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  00:51:08 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.25; broadcast_rpc_address=10.180.0.25; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.25; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ftgc3}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  00:51:08 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  00:51:08 Global memtable on-heap threshold is enabled at 128MB
    INFO  00:51:08 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 00:51:08 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/3619/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420af85a0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-q9v94\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:27:28 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:27:29 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.10; broadcast_rpc_address=10.180.0.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q9v94}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:27:29 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:27:29 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:27:29 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:27:29 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.0.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.0.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-q9v94
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  01:27:28 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:27:29 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.10; broadcast_rpc_address=10.180.0.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q9v94}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:27:29 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:27:29 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:27:29 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:27:29 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.81.224 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nsl64] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421e0b620 exit status 1 <nil> <nil> true [0xc4213504d0 0xc4213504f0 0xc421350518] [0xc4213504d0 0xc4213504f0 0xc421350518] [0xc4213504e8 0xc421350508] [0xc35e70 0xc35e70] 0xc420f26f60 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.81.224 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nsl64] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421e0b620 exit status 1 <nil> <nil> true [0xc4213504d0 0xc4213504f0 0xc421350518] [0xc4213504d0 0xc4213504f0 0xc421350518] [0xc4213504e8 0xc421350508] [0xc35e70 0xc35e70] 0xc420f26f60 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421586470>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 01:29:58.444  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-t2mrl with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-17 01:29:58.464  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 01:29:58.596  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 01:29:58 GMT 2017]; root of context hierarchy\n2017-03-17 01:30:00.716  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 01:30:00.741  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 01:30:01.427  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 01:30:01.560  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.10]\n2017-03-17 01:30:01.561  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 01:30:01.573  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 01:30:01.609  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.10]:5701\n2017-03-17 01:30:01.609  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 01:30:01.609  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 01:30:01.982  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.10]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 01:30:02.835  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.3.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 01:30:03.108  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 01:30:03.114  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 01:30:03.124  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.10]:5701 [someGroup] [3.7.5] [10.180.3.10]:5701 is STARTING\n2017-03-17 01:30:03.127  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 01:30:03.148  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.10]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.10]:5701 - dbfcb46c-7f9d-4cce-a4c1-87bb00f816ee this\n}\n\n2017-03-17 01:30:03.205  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.10]:5701 [someGroup] [3.7.5] [10.180.3.10]:5701 is STARTED\n2017-03-17 01:30:03.214  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.693 seconds (JVM running for 6.657)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 01:29:58.444  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-t2mrl with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-17 01:29:58.464  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 01:29:58.596  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 01:29:58 GMT 2017]; root of context hierarchy
    2017-03-17 01:30:00.716  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 01:30:00.741  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 01:30:01.427  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 01:30:01.560  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.10]
    2017-03-17 01:30:01.561  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 01:30:01.573  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 01:30:01.609  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.10]:5701
    2017-03-17 01:30:01.609  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 01:30:01.609  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 01:30:01.982  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.10]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 01:30:02.835  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.3.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 01:30:03.108  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 01:30:03.114  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 01:30:03.124  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.10]:5701 [someGroup] [3.7.5] [10.180.3.10]:5701 is STARTING
    2017-03-17 01:30:03.127  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 01:30:03.148  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.10]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.10]:5701 - dbfcb46c-7f9d-4cce-a4c1-87bb00f816ee this
    }
    
    2017-03-17 01:30:03.205  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.10]:5701 [someGroup] [3.7.5] [10.180.3.10]:5701 is STARTED
    2017-03-17 01:30:03.214  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.693 seconds (JVM running for 6.657)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@ethernetdan
Copy link
Contributor

ethernetdan commented Mar 17, 2017 •
edited
Loading

Fixes are in the works (#43243) but I don't think we should block for this job.

@ethernetdan ethernetdan added this to the v1.7 milestone Mar 17, 2017
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4810/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.181.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-q5nnv] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f37410 exit status 1 <nil> <nil> true [0xc42000e718 0xc42000e730 0xc42000e748] [0xc42000e718 0xc42000e730 0xc42000e748] [0xc42000e728 0xc42000e740] [0x182d7e0 0x182d7e0] 0xc42136e0c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.181.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-q5nnv] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f37410 exit status 1 <nil> <nil> true [0xc42000e718 0xc42000e730 0xc42000e748] [0xc42000e718 0xc42000e730 0xc42000e748] [0xc42000e728 0xc42000e740] [0x182d7e0 0x182d7e0] 0xc42136e0c0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42146e530>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4207c24a0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-40r03\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  00:02:24 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  00:02:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.14; broadcast_rpc_address=10.100.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-40r03}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  00:02:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  00:02:26 Global memtable on-heap threshold is enabled at 128MB\nINFO  00:02:26 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 00:02:27 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-40r03
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  00:02:24 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  00:02:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.14; broadcast_rpc_address=10.100.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-40r03}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  00:02:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  00:02:26 Global memtable on-heap threshold is enabled at 128MB
    INFO  00:02:26 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 00:02:27 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420344e40>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 00:04:49.247  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-mp61m with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 00:04:49.256  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 00:04:49.358  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 00:04:49 GMT 2017]; root of context hierarchy\n2017-05-04 00:04:51.487  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 00:04:51.513  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 00:04:52.346  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 00:04:52.510  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.16]\n2017-05-04 00:04:52.511  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 00:04:52.525  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 00:04:52.565  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.16]:5701\n2017-05-04 00:04:52.565  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 00:04:52.566  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 00:04:53.050  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.16]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 00:04:54.139  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.16]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 00:04:54.498  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.16]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 00:04:54.505  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.16]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 00:04:54.525  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.16]:5701 [someGroup] [3.8] [10.100.2.16]:5701 is STARTING\n2017-05-04 00:04:54.556  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 00:04:54.558  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.16]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.16]:5701 - 3d75c406-b362-42a6-95ab-fc84551e1c20 this\n}\n\n2017-05-04 00:04:54.642  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.16]:5701 [someGroup] [3.8] [10.100.2.16]:5701 is STARTED\n2017-05-04 00:04:54.646  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.513 seconds (JVM running for 7.495)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 00:04:49.247  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-mp61m with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 00:04:49.256  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 00:04:49.358  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 00:04:49 GMT 2017]; root of context hierarchy
    2017-05-04 00:04:51.487  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 00:04:51.513  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 00:04:52.346  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 00:04:52.510  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.16]
    2017-05-04 00:04:52.511  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 00:04:52.525  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 00:04:52.565  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.16]:5701
    2017-05-04 00:04:52.565  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 00:04:52.566  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 00:04:53.050  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.16]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 00:04:54.139  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.16]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 00:04:54.498  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.16]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 00:04:54.505  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.16]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 00:04:54.525  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.16]:5701 [someGroup] [3.8] [10.100.2.16]:5701 is STARTING
    2017-05-04 00:04:54.556  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 00:04:54.558  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.16]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.16]:5701 - 3d75c406-b362-42a6-95ab-fc84551e1c20 this
    }
    
    2017-05-04 00:04:54.642  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.16]:5701 [someGroup] [3.8] [10.100.2.16]:5701 is STARTED
    2017-05-04 00:04:54.646  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.513 seconds (JVM running for 7.495)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4811/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420e3c050>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4202998d0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-476c1\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:14:13 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:14:14 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.15; broadcast_rpc_address=10.100.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-476c1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:14:14 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:14:15 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:14:15 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:14:15 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-476c1
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  01:14:13 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:14:14 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.15; broadcast_rpc_address=10.100.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-476c1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:14:14 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:14:15 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:14:15 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:14:15 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420dfa3b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 01:16:37.437  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-p7dpm with PID 7 (/bootstrapper.jar started by root in /)\n2017-05-04 01:16:37.455  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 01:16:37.563  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 01:16:37 GMT 2017]; root of context hierarchy\n2017-05-04 01:16:39.239  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 01:16:39.269  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 01:16:40.050  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 01:16:40.194  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.16]\n2017-05-04 01:16:40.195  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 01:16:40.215  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 01:16:40.257  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.16]:5701\n2017-05-04 01:16:40.258  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 01:16:40.258  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 01:16:40.809  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.16]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 01:16:41.885  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.3.16]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 01:16:42.150  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.16]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 01:16:42.155  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.16]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 01:16:42.166  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.16]:5701 [someGroup] [3.8] [10.100.3.16]:5701 is STARTING\n2017-05-04 01:16:42.187  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 01:16:42.188  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.16]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.16]:5701 - f3d719c3-8f56-489c-a93f-e0f621bafdba this\n}\n\n2017-05-04 01:16:42.267  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.16]:5701 [someGroup] [3.8] [10.100.3.16]:5701 is STARTED\n2017-05-04 01:16:42.270  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.941 seconds (JVM running for 6.809)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 01:16:37.437  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-p7dpm with PID 7 (/bootstrapper.jar started by root in /)
    2017-05-04 01:16:37.455  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 01:16:37.563  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 01:16:37 GMT 2017]; root of context hierarchy
    2017-05-04 01:16:39.239  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 01:16:39.269  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 01:16:40.050  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 01:16:40.194  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.16]
    2017-05-04 01:16:40.195  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 01:16:40.215  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 01:16:40.257  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.16]:5701
    2017-05-04 01:16:40.258  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 01:16:40.258  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 01:16:40.809  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.16]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 01:16:41.885  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.3.16]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 01:16:42.150  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.16]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 01:16:42.155  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.16]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 01:16:42.166  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.16]:5701 [someGroup] [3.8] [10.100.3.16]:5701 is STARTING
    2017-05-04 01:16:42.187  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 01:16:42.188  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.16]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.16]:5701 - f3d719c3-8f56-489c-a93f-e0f621bafdba this
    }
    
    2017-05-04 01:16:42.267  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.16]:5701 [someGroup] [3.8] [10.100.3.16]:5701 is STARTED
    2017-05-04 01:16:42.270  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.941 seconds (JVM running for 6.809)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.181.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xglmb] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4222becf0 exit status 1 <nil> <nil> true [0xc4219d5bc8 0xc4219d5be0 0xc4219d5bf8] [0xc4219d5bc8 0xc4219d5be0 0xc4219d5bf8] [0xc4219d5bd8 0xc4219d5bf0] [0x182d7e0 0x182d7e0] 0xc421412720 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.181.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xglmb] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4222becf0 exit status 1 <nil> <nil> true [0xc4219d5bc8 0xc4219d5be0 0xc4219d5bf8] [0xc4219d5bc8 0xc4219d5be0 0xc4219d5bf8] [0xc4219d5bd8 0xc4219d5bf0] [0x182d7e0 0x182d7e0] 0xc421412720 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4812/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4224f6c00>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42019e5e0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.1.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.1.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.1.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9nnlf\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:51:37 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:51:39 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.6; broadcast_rpc_address=10.100.1.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9nnlf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:51:39 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:51:39 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:51:39 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:51:39 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.1.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.1.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.1.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9nnlf
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  01:51:37 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:51:39 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.6; broadcast_rpc_address=10.100.1.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9nnlf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:51:39 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:51:39 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:51:39 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:51:39 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.181.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-2d67d] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42085bad0 exit status 1 <nil> <nil> true [0xc420482f30 0xc420482f58 0xc420482f70] [0xc420482f30 0xc420482f58 0xc420482f70] [0xc420482f48 0xc420482f68] [0x182d7e0 0x182d7e0] 0xc42140db00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.181.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-2d67d] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42085bad0 exit status 1 <nil> <nil> true [0xc420482f30 0xc420482f58 0xc420482f70] [0xc420482f30 0xc420482f58 0xc420482f70] [0xc420482f48 0xc420482f68] [0x182d7e0 0x182d7e0] 0xc42140db00 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420bb30c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 01:59:01.650  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bpvm5 with PID 9 (/bootstrapper.jar started by root in /)\n2017-05-04 01:59:01.680  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 01:59:01.831  INFO 9 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 01:59:01 GMT 2017]; root of context hierarchy\n2017-05-04 01:59:03.236  INFO 9 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 01:59:03.253  INFO 9 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 01:59:03.955  INFO 9 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 01:59:04.141  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.14]\n2017-05-04 01:59:04.142  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 01:59:04.154  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 01:59:04.186  INFO 9 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.14]:5701\n2017-05-04 01:59:04.187  INFO 9 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 01:59:04.187  INFO 9 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 01:59:04.661  INFO 9 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.14]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 01:59:05.531  INFO 9 --- [           main] com.hazelcast.instance.Node              : [10.100.3.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 01:59:05.772  INFO 9 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 01:59:05.774  INFO 9 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 01:59:05.789  INFO 9 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTING\n2017-05-04 01:59:05.813  INFO 9 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 01:59:05.815  INFO 9 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.14]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.14]:5701 - 3798e3dc-c22d-4d28-9db2-1b42afee9c83 this\n}\n\n2017-05-04 01:59:05.881  INFO 9 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTED\n2017-05-04 01:59:05.884  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.093 seconds (JVM running for 5.876)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 01:59:01.650  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bpvm5 with PID 9 (/bootstrapper.jar started by root in /)
    2017-05-04 01:59:01.680  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 01:59:01.831  INFO 9 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 01:59:01 GMT 2017]; root of context hierarchy
    2017-05-04 01:59:03.236  INFO 9 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 01:59:03.253  INFO 9 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 01:59:03.955  INFO 9 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 01:59:04.141  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.14]
    2017-05-04 01:59:04.142  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 01:59:04.154  INFO 9 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 01:59:04.186  INFO 9 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.14]:5701
    2017-05-04 01:59:04.187  INFO 9 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 01:59:04.187  INFO 9 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 01:59:04.661  INFO 9 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.14]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 01:59:05.531  INFO 9 --- [           main] com.hazelcast.instance.Node              : [10.100.3.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 01:59:05.772  INFO 9 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 01:59:05.774  INFO 9 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 01:59:05.789  INFO 9 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTING
    2017-05-04 01:59:05.813  INFO 9 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 01:59:05.815  INFO 9 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.14]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.14]:5701 - 3798e3dc-c22d-4d28-9db2-1b42afee9c83 this
    }
    
    2017-05-04 01:59:05.881  INFO 9 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTED
    2017-05-04 01:59:05.884  INFO 9 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.093 seconds (JVM running for 5.876)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4813/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420bdd600>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4201c0ec0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 02:44:04.950  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-hsqrk with PID 8 (/bootstrapper.jar started by root in /)\n2017-05-04 02:44:04.959  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 02:44:05.052  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 02:44:05 GMT 2017]; root of context hierarchy\n2017-05-04 02:44:06.713  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 02:44:06.747  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 02:44:07.577  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 02:44:07.732  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.5]\n2017-05-04 02:44:07.733  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 02:44:07.752  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 02:44:07.795  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.5]:5701\n2017-05-04 02:44:07.795  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 02:44:07.796  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 02:44:08.363  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.5]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 02:44:09.436  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.100.3.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 02:44:09.690  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 02:44:09.691  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 02:44:09.710  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTING\n2017-05-04 02:44:09.730  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 02:44:09.731  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.5]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.5]:5701 - 5ca5a8e3-8e7c-4418-bb1f-c13ef2def3ec this\n}\n\n2017-05-04 02:44:09.803  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTED\n2017-05-04 02:44:09.806  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.019 seconds (JVM running for 6.818)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 02:44:04.950  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-hsqrk with PID 8 (/bootstrapper.jar started by root in /)
    2017-05-04 02:44:04.959  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 02:44:05.052  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 02:44:05 GMT 2017]; root of context hierarchy
    2017-05-04 02:44:06.713  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 02:44:06.747  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 02:44:07.577  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 02:44:07.732  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.5]
    2017-05-04 02:44:07.733  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 02:44:07.752  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 02:44:07.795  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.5]:5701
    2017-05-04 02:44:07.795  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 02:44:07.796  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 02:44:08.363  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.5]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 02:44:09.436  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.100.3.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 02:44:09.690  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 02:44:09.691  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 02:44:09.710  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTING
    2017-05-04 02:44:09.730  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 02:44:09.731  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.5]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.5]:5701 - 5ca5a8e3-8e7c-4418-bb1f-c13ef2def3ec this
    }
    
    2017-05-04 02:44:09.803  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTED
    2017-05-04 02:44:09.806  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.019 seconds (JVM running for 6.818)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.181.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-djr17] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f12480 exit status 1 <nil> <nil> true [0xc4203d2d88 0xc4203d2da0 0xc4203d2db8] [0xc4203d2d88 0xc4203d2da0 0xc4203d2db8] [0xc4203d2d98 0xc4203d2db0] [0x182d7e0 0x182d7e0] 0xc420eaf2c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.181.46 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-djr17] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f12480 exit status 1 <nil> <nil> true [0xc4203d2d88 0xc4203d2da0 0xc4203d2db8] [0xc4203d2d88 0xc4203d2da0 0xc4203d2db8] [0xc4203d2d98 0xc4203d2db0] [0x182d7e0 0x182d7e0] 0xc420eaf2c0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420344180>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.0.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.0.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.0.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-06m7b\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  03:18:03 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  03:18:04 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.11; broadcast_rpc_address=10.100.0.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-06m7b}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  03:18:04 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  03:18:04 Global memtable on-heap threshold is enabled at 128MB\nINFO  03:18:04 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 03:18:04 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.0.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.0.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.0.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-06m7b
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  03:18:03 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  03:18:04 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.11; broadcast_rpc_address=10.100.0.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-06m7b}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  03:18:04 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  03:18:04 Global memtable on-heap threshold is enabled at 128MB
    INFO  03:18:04 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 03:18:04 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4814/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.4.37 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zn3xk] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42124efc0 exit status 1 <nil> <nil> true [0xc42000eb38 0xc42000eb58 0xc42000eb88] [0xc42000eb38 0xc42000eb58 0xc42000eb88] [0xc42000eb50 0xc42000eb80] [0x182d7e0 0x182d7e0] 0xc42136ad80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.4.37 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zn3xk] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42124efc0 exit status 1 <nil> <nil> true [0xc42000eb38 0xc42000eb58 0xc42000eb88] [0xc42000eb38 0xc42000eb58 0xc42000eb88] [0xc42000eb50 0xc42000eb80] [0x182d7e0 0x182d7e0] 0xc42136ad80 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42040d9b0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4210d89d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 04:04:48.073  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-wscvp with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 04:04:48.082  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 04:04:48.205  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 04:04:48 GMT 2017]; root of context hierarchy\n2017-05-04 04:04:50.148  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 04:04:50.177  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 04:04:50.978  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 04:04:51.130  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.9]\n2017-05-04 04:04:51.130  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 04:04:51.143  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 04:04:51.182  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.9]:5701\n2017-05-04 04:04:51.183  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 04:04:51.183  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 04:04:51.821  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.9]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 04:04:53.208  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.9]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 04:04:53.499  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.9]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 04:04:53.516  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.9]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 04:04:53.530  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.9]:5701 [someGroup] [3.8] [10.100.3.9]:5701 is STARTING\n2017-05-04 04:04:53.555  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 04:04:53.557  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.9]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.9]:5701 - 5a938c45-eea4-4687-9505-2ca2dcef9cb0 this\n}\n\n2017-05-04 04:04:53.629  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.9]:5701 [someGroup] [3.8] [10.100.3.9]:5701 is STARTED\n2017-05-04 04:04:53.631  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.778 seconds (JVM running for 7.688)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 04:04:48.073  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-wscvp with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 04:04:48.082  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 04:04:48.205  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 04:04:48 GMT 2017]; root of context hierarchy
    2017-05-04 04:04:50.148  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 04:04:50.177  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 04:04:50.978  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 04:04:51.130  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.9]
    2017-05-04 04:04:51.130  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 04:04:51.143  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 04:04:51.182  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.9]:5701
    2017-05-04 04:04:51.183  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 04:04:51.183  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 04:04:51.821  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.9]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 04:04:53.208  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.9]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 04:04:53.499  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.9]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 04:04:53.516  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.9]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 04:04:53.530  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.9]:5701 [someGroup] [3.8] [10.100.3.9]:5701 is STARTING
    2017-05-04 04:04:53.555  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 04:04:53.557  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.9]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.9]:5701 - 5a938c45-eea4-4687-9505-2ca2dcef9cb0 this
    }
    
    2017-05-04 04:04:53.629  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.9]:5701 [someGroup] [3.8] [10.100.3.9]:5701 is STARTED
    2017-05-04 04:04:53.631  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.778 seconds (JVM running for 7.688)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42001a4c0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.5\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.5\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.5\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.5\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-pfkdn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  03:52:09 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  03:52:10 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.5; broadcast_rpc_address=10.100.2.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-pfkdn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  03:52:10 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  03:52:11 Global memtable on-heap threshold is enabled at 128MB\nINFO  03:52:11 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 03:52:11 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.5
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.5
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.5
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.5
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-pfkdn
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  03:52:09 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  03:52:10 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.5; broadcast_rpc_address=10.100.2.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-pfkdn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  03:52:10 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  03:52:11 Global memtable on-heap threshold is enabled at 128MB
    INFO  03:52:11 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 03:52:11 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4815/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4216d9680>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 05:00:27.205  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-m2lsv with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 05:00:27.225  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 05:00:27.335  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 05:00:27 GMT 2017]; root of context hierarchy\n2017-05-04 05:00:28.879  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 05:00:28.899  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 05:00:29.649  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 05:00:29.794  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.9]\n2017-05-04 05:00:29.795  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 05:00:29.807  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 05:00:29.859  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.9]:5701\n2017-05-04 05:00:29.859  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 05:00:29.859  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 05:00:30.450  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.9]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 05:00:31.795  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.9]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 05:00:32.098  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.9]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 05:00:32.108  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.9]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 05:00:32.121  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.9]:5701 [someGroup] [3.8] [10.100.3.9]:5701 is STARTING\n2017-05-04 05:00:32.151  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 05:00:32.154  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.9]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.9]:5701 - 1bf2d9b2-7e79-4900-869b-144d7d1d0a1f this\n}\n\n2017-05-04 05:00:32.237  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.9]:5701 [someGroup] [3.8] [10.100.3.9]:5701 is STARTED\n2017-05-04 05:00:32.244  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.195 seconds (JVM running for 7.083)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 05:00:27.205  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-m2lsv with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 05:00:27.225  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 05:00:27.335  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 05:00:27 GMT 2017]; root of context hierarchy
    2017-05-04 05:00:28.879  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 05:00:28.899  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 05:00:29.649  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 05:00:29.794  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.9]
    2017-05-04 05:00:29.795  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 05:00:29.807  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 05:00:29.859  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.9]:5701
    2017-05-04 05:00:29.859  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 05:00:29.859  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 05:00:30.450  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.9]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 05:00:31.795  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.9]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 05:00:32.098  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.9]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 05:00:32.108  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.9]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 05:00:32.121  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.9]:5701 [someGroup] [3.8] [10.100.3.9]:5701 is STARTING
    2017-05-04 05:00:32.151  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.9]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 05:00:32.154  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.9]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.9]:5701 - 1bf2d9b2-7e79-4900-869b-144d7d1d0a1f this
    }
    
    2017-05-04 05:00:32.237  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.9]:5701 [someGroup] [3.8] [10.100.3.9]:5701 is STARTED
    2017-05-04 05:00:32.244  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.195 seconds (JVM running for 7.083)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.39.70 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-n0swz] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42078d0b0 exit status 1 <nil> <nil> true [0xc4204b8090 0xc4204b80a8 0xc4204b80c0] [0xc4204b8090 0xc4204b80a8 0xc4204b80c0] [0xc4204b80a0 0xc4204b80b8] [0x182d7e0 0x182d7e0] 0xc42201e5a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.39.70 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-n0swz] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42078d0b0 exit status 1 <nil> <nil> true [0xc4204b8090 0xc4204b80a8 0xc4204b80c0] [0xc4204b8090 0xc4204b80a8 0xc4204b80c0] [0xc4204b80a0 0xc4204b80b8] [0x182d7e0 0x182d7e0] 0xc42201e5a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42123f220>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420292590>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-dph6z\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  04:55:31 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  04:55:32 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.7; broadcast_rpc_address=10.100.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dph6z}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  04:55:32 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  04:55:32 Global memtable on-heap threshold is enabled at 128MB\nINFO  04:55:32 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 04:55:32 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-dph6z
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  04:55:31 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  04:55:32 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.7; broadcast_rpc_address=10.100.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dph6z}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  04:55:32 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  04:55:32 Global memtable on-heap threshold is enabled at 128MB
    INFO  04:55:32 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 04:55:32 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4816/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.4.37 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tdp6w] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420acbf80 exit status 1 <nil> <nil> true [0xc4200560f8 0xc420056110 0xc420056140] [0xc4200560f8 0xc420056110 0xc420056140] [0xc420056108 0xc420056128] [0x182d7e0 0x182d7e0] 0xc420fec8a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.4.37 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tdp6w] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420acbf80 exit status 1 <nil> <nil> true [0xc4200560f8 0xc420056110 0xc420056140] [0xc4200560f8 0xc420056110 0xc420056140] [0xc420056108 0xc420056128] [0x182d7e0 0x182d7e0] 0xc420fec8a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4219fcd10>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-tc48b\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:57:35 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:57:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.8; broadcast_rpc_address=10.100.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-tc48b}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:57:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:57:37 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:57:37 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:57:37 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-tc48b
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  05:57:35 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:57:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.8; broadcast_rpc_address=10.100.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-tc48b}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:57:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:57:37 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:57:37 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:57:37 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4213d72e0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc421cc9760>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 06:20:42.778  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-fk4r9 with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 06:20:42.786  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 06:20:42.871  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 06:20:42 GMT 2017]; root of context hierarchy\n2017-05-04 06:20:44.878  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 06:20:44.897  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 06:20:45.654  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 06:20:45.802  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.19]\n2017-05-04 06:20:45.802  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 06:20:45.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 06:20:45.850  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.19]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.19]:5701\n2017-05-04 06:20:45.851  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.19]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 06:20:45.851  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.19]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 06:20:46.348  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.19]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 06:20:47.375  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.19]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 06:20:47.642  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.19]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 06:20:47.649  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.19]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 06:20:47.667  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.19]:5701 [someGroup] [3.8] [10.100.1.19]:5701 is STARTING\n2017-05-04 06:20:47.696  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.19]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 06:20:47.700  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.19]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.19]:5701 - 1c81806b-40a7-4ab7-9669-69096d6dbca0 this\n}\n\n2017-05-04 06:20:47.763  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.19]:5701 [someGroup] [3.8] [10.100.1.19]:5701 is STARTED\n2017-05-04 06:20:47.777  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.039 seconds (JVM running for 6.858)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 06:20:42.778  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-fk4r9 with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 06:20:42.786  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 06:20:42.871  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 06:20:42 GMT 2017]; root of context hierarchy
    2017-05-04 06:20:44.878  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 06:20:44.897  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 06:20:45.654  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 06:20:45.802  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.19]
    2017-05-04 06:20:45.802  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 06:20:45.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 06:20:45.850  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.19]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.19]:5701
    2017-05-04 06:20:45.851  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.19]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 06:20:45.851  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.19]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 06:20:46.348  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.19]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 06:20:47.375  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.19]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 06:20:47.642  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.19]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 06:20:47.649  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.19]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 06:20:47.667  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.19]:5701 [someGroup] [3.8] [10.100.1.19]:5701 is STARTING
    2017-05-04 06:20:47.696  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.19]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 06:20:47.700  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.19]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.19]:5701 - 1c81806b-40a7-4ab7-9669-69096d6dbca0 this
    }
    
    2017-05-04 06:20:47.763  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.19]:5701 [someGroup] [3.8] [10.100.1.19]:5701 is STARTED
    2017-05-04 06:20:47.777  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.039 seconds (JVM running for 6.858)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4817/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc421de8d00>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 07:22:20.098  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-32vbp with PID 8 (/bootstrapper.jar started by root in /)\n2017-05-04 07:22:20.121  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 07:22:20.270  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 07:22:20 GMT 2017]; root of context hierarchy\n2017-05-04 07:22:22.994  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 07:22:23.015  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 07:22:23.862  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 07:22:24.018  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.23]\n2017-05-04 07:22:24.018  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 07:22:24.030  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 07:22:24.071  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.23]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.23]:5701\n2017-05-04 07:22:24.071  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.23]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 07:22:24.071  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.23]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 07:22:24.599  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.23]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 07:22:25.677  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.100.3.23]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 07:22:25.982  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.23]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 07:22:25.988  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.23]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 07:22:26.007  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.23]:5701 [someGroup] [3.8] [10.100.3.23]:5701 is STARTING\n2017-05-04 07:22:26.032  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.23]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 07:22:26.034  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.23]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.23]:5701 - 811bfe38-ba7f-4f7d-bb98-940d84507db4 this\n}\n\n2017-05-04 07:22:26.117  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.23]:5701 [someGroup] [3.8] [10.100.3.23]:5701 is STARTED\n2017-05-04 07:22:26.127  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 7.216 seconds (JVM running for 8.056)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 07:22:20.098  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-32vbp with PID 8 (/bootstrapper.jar started by root in /)
    2017-05-04 07:22:20.121  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 07:22:20.270  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 07:22:20 GMT 2017]; root of context hierarchy
    2017-05-04 07:22:22.994  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 07:22:23.015  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 07:22:23.862  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 07:22:24.018  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.23]
    2017-05-04 07:22:24.018  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 07:22:24.030  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 07:22:24.071  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.23]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.23]:5701
    2017-05-04 07:22:24.071  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.23]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 07:22:24.071  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.23]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 07:22:24.599  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.23]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 07:22:25.677  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.100.3.23]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 07:22:25.982  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.23]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 07:22:25.988  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.23]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 07:22:26.007  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.23]:5701 [someGroup] [3.8] [10.100.3.23]:5701 is STARTING
    2017-05-04 07:22:26.032  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.23]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 07:22:26.034  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.23]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.23]:5701 - 811bfe38-ba7f-4f7d-bb98-940d84507db4 this
    }
    
    2017-05-04 07:22:26.117  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.23]:5701 [someGroup] [3.8] [10.100.3.23]:5701 is STARTED
    2017-05-04 07:22:26.127  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 7.216 seconds (JVM running for 8.056)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420345100>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-cjgs8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:57:38 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:57:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.6; broadcast_rpc_address=10.100.2.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-cjgs8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:57:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:57:40 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:57:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:57:40 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-cjgs8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  06:57:38 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:57:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.6; broadcast_rpc_address=10.100.2.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-cjgs8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:57:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:57:40 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:57:40 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:57:40 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.39.70 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-4b3j5] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d69920 exit status 1 <nil> <nil> true [0xc4205191c8 0xc420519200 0xc420519220] [0xc4205191c8 0xc420519200 0xc420519220] [0xc4205191e8 0xc420519218] [0x182d7e0 0x182d7e0] 0xc421346c00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.39.70 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-4b3j5] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420d69920 exit status 1 <nil> <nil> true [0xc4205191c8 0xc420519200 0xc420519220] [0xc4205191c8 0xc420519200 0xc420519220] [0xc4205191e8 0xc420519218] [0x182d7e0 0x182d7e0] 0xc421346c00 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc421200ad0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4818/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc421158d50>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420c55620>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-29h88\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  08:19:19 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  08:19:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.12; broadcast_rpc_address=10.100.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-29h88}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  08:19:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  08:19:21 Global memtable on-heap threshold is enabled at 128MB\nINFO  08:19:21 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:19:21 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-29h88
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  08:19:19 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  08:19:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.12; broadcast_rpc_address=10.100.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-29h88}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  08:19:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  08:19:21 Global memtable on-heap threshold is enabled at 128MB
    INFO  08:19:21 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 08:19:21 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.234.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-s129g] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dbc060 exit status 1 <nil> <nil> true [0xc42000e1a8 0xc42000e1c8 0xc42000e1e0] [0xc42000e1a8 0xc42000e1c8 0xc42000e1e0] [0xc42000e1b8 0xc42000e1d8] [0x182d7e0 0x182d7e0] 0xc421110ae0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.234.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-s129g] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420dbc060 exit status 1 <nil> <nil> true [0xc42000e1a8 0xc42000e1c8 0xc42000e1e0] [0xc42000e1a8 0xc42000e1c8 0xc42000e1e0] [0xc42000e1b8 0xc42000e1d8] [0x182d7e0 0x182d7e0] 0xc421110ae0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4211395b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 07:48:19.989  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-pn6hs with PID 7 (/bootstrapper.jar started by root in /)\n2017-05-04 07:48:19.996  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 07:48:20.098  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 07:48:20 GMT 2017]; root of context hierarchy\n2017-05-04 07:48:21.443  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 07:48:21.461  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 07:48:22.122  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 07:48:22.245  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.0.5]\n2017-05-04 07:48:22.245  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 07:48:22.259  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.0.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 07:48:22.291  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.0.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.0.5]:5701\n2017-05-04 07:48:22.292  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.0.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 07:48:22.292  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.0.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 07:48:22.755  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.0.5]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 07:48:23.622  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.0.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 07:48:23.873  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.5]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 07:48:23.877  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 07:48:23.891  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.5]:5701 [someGroup] [3.8] [10.100.0.5]:5701 is STARTING\n2017-05-04 07:48:23.918  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.0.5]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 07:48:23.921  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.0.5]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.0.5]:5701 - aa6b4f4f-899f-4fdc-bb36-3359b977e352 this\n}\n\n2017-05-04 07:48:23.974  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.5]:5701 [someGroup] [3.8] [10.100.0.5]:5701 is STARTED\n2017-05-04 07:48:23.979  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.853 seconds (JVM running for 5.588)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 07:48:19.989  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-pn6hs with PID 7 (/bootstrapper.jar started by root in /)
    2017-05-04 07:48:19.996  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 07:48:20.098  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 07:48:20 GMT 2017]; root of context hierarchy
    2017-05-04 07:48:21.443  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 07:48:21.461  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 07:48:22.122  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 07:48:22.245  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.0.5]
    2017-05-04 07:48:22.245  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 07:48:22.259  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.0.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 07:48:22.291  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.0.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.0.5]:5701
    2017-05-04 07:48:22.292  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.0.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 07:48:22.292  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.0.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 07:48:22.755  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.0.5]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 07:48:23.622  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.0.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 07:48:23.873  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.5]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 07:48:23.877  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 07:48:23.891  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.5]:5701 [someGroup] [3.8] [10.100.0.5]:5701 is STARTING
    2017-05-04 07:48:23.918  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.0.5]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 07:48:23.921  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.0.5]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.0.5]:5701 - aa6b4f4f-899f-4fdc-bb36-3359b977e352 this
    }
    
    2017-05-04 07:48:23.974  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.5]:5701 [someGroup] [3.8] [10.100.0.5]:5701 is STARTED
    2017-05-04 07:48:23.979  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.853 seconds (JVM running for 5.588)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4819/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vwsbr] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42100fdd0 exit status 1 <nil> <nil> true [0xc4201844d8 0xc4201844f0 0xc420184508] [0xc4201844d8 0xc4201844f0 0xc420184508] [0xc4201844e8 0xc420184500] [0x182d7e0 0x182d7e0] 0xc4213a3020 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vwsbr] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42100fdd0 exit status 1 <nil> <nil> true [0xc4201844d8 0xc4201844f0 0xc420184508] [0xc4201844d8 0xc4201844f0 0xc420184508] [0xc4201844e8 0xc420184500] [0x182d7e0 0x182d7e0] 0xc4213a3020 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc421339cb0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4203fe880>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-j59l1\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:08:38 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:08:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.9; broadcast_rpc_address=10.100.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j59l1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:08:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:08:40 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:08:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:08:40 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-j59l1
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  09:08:38 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:08:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.9; broadcast_rpc_address=10.100.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j59l1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:08:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:08:40 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:08:40 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:08:40 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc421700c50>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 09:13:41.686  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-nn2lb with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 09:13:41.694  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 09:13:41.801  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 09:13:41 GMT 2017]; root of context hierarchy\n2017-05-04 09:13:43.430  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 09:13:43.456  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 09:13:44.155  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 09:13:44.295  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.0.19]\n2017-05-04 09:13:44.295  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 09:13:44.308  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.0.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 09:13:44.357  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.19]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.0.19]:5701\n2017-05-04 09:13:44.358  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.19]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 09:13:44.358  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.19]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 09:13:44.841  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.0.19]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 09:13:45.889  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.0.19]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 09:13:46.153  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.19]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 09:13:46.158  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.19]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 09:13:46.174  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.19]:5701 [someGroup] [3.8] [10.100.0.19]:5701 is STARTING\n2017-05-04 09:13:46.212  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.19]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 09:13:46.214  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.0.19]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.0.19]:5701 - 168a5ce0-d829-4fae-ab8a-7adad49792a0 this\n}\n\n2017-05-04 09:13:46.349  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.19]:5701 [someGroup] [3.8] [10.100.0.19]:5701 is STARTED\n2017-05-04 09:13:46.372  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.802 seconds (JVM running for 6.645)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 09:13:41.686  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-nn2lb with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 09:13:41.694  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 09:13:41.801  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 09:13:41 GMT 2017]; root of context hierarchy
    2017-05-04 09:13:43.430  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 09:13:43.456  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 09:13:44.155  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 09:13:44.295  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.0.19]
    2017-05-04 09:13:44.295  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 09:13:44.308  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.0.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 09:13:44.357  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.19]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.0.19]:5701
    2017-05-04 09:13:44.358  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.19]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 09:13:44.358  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.19]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 09:13:44.841  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.0.19]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 09:13:45.889  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.0.19]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 09:13:46.153  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.19]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 09:13:46.158  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.19]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 09:13:46.174  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.19]:5701 [someGroup] [3.8] [10.100.0.19]:5701 is STARTING
    2017-05-04 09:13:46.212  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.19]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 09:13:46.214  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.0.19]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.0.19]:5701 - 168a5ce0-d829-4fae-ab8a-7adad49792a0 this
    }
    
    2017-05-04 09:13:46.349  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.19]:5701 [someGroup] [3.8] [10.100.0.19]:5701 is STARTED
    2017-05-04 09:13:46.372  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.802 seconds (JVM running for 6.645)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4820/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42035dcf0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.0.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.0.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.0.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-795wc\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  10:25:44 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  10:25:45 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.19; broadcast_rpc_address=10.100.0.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-795wc}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  10:25:45 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  10:25:45 Global memtable on-heap threshold is enabled at 128MB\nINFO  10:25:45 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:25:46 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.0.19
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.0.19
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.19
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.0.19
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-795wc
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  10:25:44 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  10:25:45 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.19; broadcast_rpc_address=10.100.0.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-795wc}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  10:25:45 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  10:25:45 Global memtable on-heap threshold is enabled at 128MB
    INFO  10:25:45 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 10:25:46 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.234.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5l92j] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c73ad0 exit status 1 <nil> <nil> true [0xc420092298 0xc4200922b0 0xc4200922c8] [0xc420092298 0xc4200922b0 0xc4200922c8] [0xc4200922a8 0xc4200922c0] [0x182d7e0 0x182d7e0] 0xc4211ed200 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.234.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5l92j] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c73ad0 exit status 1 <nil> <nil> true [0xc420092298 0xc4200922b0 0xc4200922c8] [0xc420092298 0xc4200922b0 0xc4200922c8] [0xc4200922a8 0xc4200922c0] [0x182d7e0 0x182d7e0] 0xc4211ed200 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42001a8c0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc421084090>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 10:10:15.667  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-vztbr with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 10:10:15.675  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 10:10:15.783  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 10:10:15 GMT 2017]; root of context hierarchy\n2017-05-04 10:10:17.449  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 10:10:17.475  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 10:10:18.251  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 10:10:18.423  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.0.18]\n2017-05-04 10:10:18.424  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 10:10:18.435  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.0.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 10:10:18.470  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.18]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.0.18]:5701\n2017-05-04 10:10:18.470  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.18]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 10:10:18.470  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.18]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 10:10:18.924  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.0.18]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 10:10:19.957  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.0.18]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 10:10:20.231  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.18]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 10:10:20.239  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.18]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 10:10:20.258  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.18]:5701 [someGroup] [3.8] [10.100.0.18]:5701 is STARTING\n2017-05-04 10:10:20.285  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.18]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 10:10:20.286  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.0.18]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.0.18]:5701 - 09205e0e-1413-4145-a3ee-a86dd8df7fae this\n}\n\n2017-05-04 10:10:20.358  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.18]:5701 [someGroup] [3.8] [10.100.0.18]:5701 is STARTED\n2017-05-04 10:10:20.364  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.602 seconds (JVM running for 6.491)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 10:10:15.667  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-vztbr with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 10:10:15.675  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 10:10:15.783  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 10:10:15 GMT 2017]; root of context hierarchy
    2017-05-04 10:10:17.449  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 10:10:17.475  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 10:10:18.251  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 10:10:18.423  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.0.18]
    2017-05-04 10:10:18.424  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 10:10:18.435  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.0.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 10:10:18.470  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.18]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.0.18]:5701
    2017-05-04 10:10:18.470  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.18]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 10:10:18.470  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.18]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 10:10:18.924  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.0.18]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 10:10:19.957  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.0.18]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 10:10:20.231  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.18]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 10:10:20.239  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.18]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 10:10:20.258  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.18]:5701 [someGroup] [3.8] [10.100.0.18]:5701 is STARTING
    2017-05-04 10:10:20.285  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.18]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 10:10:20.286  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.0.18]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.0.18]:5701 - 09205e0e-1413-4145-a3ee-a86dd8df7fae this
    }
    
    2017-05-04 10:10:20.358  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.18]:5701 [someGroup] [3.8] [10.100.0.18]:5701 is STARTED
    2017-05-04 10:10:20.364  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.602 seconds (JVM running for 6.491)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4821/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.239.182 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8c0q5] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421384270 exit status 1 <nil> <nil> true [0xc42034e4b0 0xc42034e4e0 0xc42034e500] [0xc42034e4b0 0xc42034e4e0 0xc42034e500] [0xc42034e4d0 0xc42034e4f0] [0x182d7e0 0x182d7e0] 0xc42137c060 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.239.182 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8c0q5] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421384270 exit status 1 <nil> <nil> true [0xc42034e4b0 0xc42034e4e0 0xc42034e500] [0xc42034e4b0 0xc42034e4e0 0xc42034e500] [0xc42034e4d0 0xc42034e4f0] [0x182d7e0 0x182d7e0] 0xc42137c060 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc42019dc10>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 10:52:06.896  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bg317 with PID 8 (/bootstrapper.jar started by root in /)\n2017-05-04 10:52:06.921  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 10:52:07.059  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 10:52:07 GMT 2017]; root of context hierarchy\n2017-05-04 10:52:09.026  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 10:52:09.047  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 10:52:09.786  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 10:52:09.934  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.11]\n2017-05-04 10:52:09.935  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 10:52:09.949  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 10:52:09.994  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.11]:5701\n2017-05-04 10:52:09.994  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 10:52:09.994  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 10:52:10.529  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.11]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 10:52:11.607  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.100.3.11]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 10:52:11.904  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.11]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 10:52:11.906  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.11]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 10:52:11.926  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.11]:5701 [someGroup] [3.8] [10.100.3.11]:5701 is STARTING\n2017-05-04 10:52:11.964  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 10:52:11.967  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.11]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.11]:5701 - 4f1c8078-273d-4e89-8ea2-9643863928fe this\n}\n\n2017-05-04 10:52:12.056  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.11]:5701 [someGroup] [3.8] [10.100.3.11]:5701 is STARTED\n2017-05-04 10:52:12.060  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.206 seconds (JVM running for 7.08)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 10:52:06.896  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bg317 with PID 8 (/bootstrapper.jar started by root in /)
    2017-05-04 10:52:06.921  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 10:52:07.059  INFO 8 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 10:52:07 GMT 2017]; root of context hierarchy
    2017-05-04 10:52:09.026  INFO 8 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 10:52:09.047  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 10:52:09.786  INFO 8 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 10:52:09.934  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.11]
    2017-05-04 10:52:09.935  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 10:52:09.949  INFO 8 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 10:52:09.994  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.11]:5701
    2017-05-04 10:52:09.994  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 10:52:09.994  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 10:52:10.529  INFO 8 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.11]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 10:52:11.607  INFO 8 --- [           main] com.hazelcast.instance.Node              : [10.100.3.11]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 10:52:11.904  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.11]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 10:52:11.906  INFO 8 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.11]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 10:52:11.926  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.11]:5701 [someGroup] [3.8] [10.100.3.11]:5701 is STARTING
    2017-05-04 10:52:11.964  INFO 8 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 10:52:11.967  INFO 8 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.11]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.11]:5701 - 4f1c8078-273d-4e89-8ea2-9643863928fe this
    }
    
    2017-05-04 10:52:12.056  INFO 8 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.11]:5701 [someGroup] [3.8] [10.100.3.11]:5701 is STARTED
    2017-05-04 10:52:12.060  INFO 8 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.206 seconds (JVM running for 7.08)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420344130>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4212aa830>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.0.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.0.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.0.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-7xx05\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:17:31 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:17:32 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.10; broadcast_rpc_address=10.100.0.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7xx05}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:17:32 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:17:33 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:17:33 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:17:33 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.0.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.0.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.0.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-7xx05
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  11:17:31 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:17:32 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.10; broadcast_rpc_address=10.100.0.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7xx05}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:17:32 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:17:33 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:17:33 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:17:33 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4822/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4211e68b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 12:13:57.498  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-nwgwx with PID 7 (/bootstrapper.jar started by root in /)\n2017-05-04 12:13:57.519  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 12:13:57.614  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 12:13:57 GMT 2017]; root of context hierarchy\n2017-05-04 12:13:59.687  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 12:13:59.717  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 12:14:00.498  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 12:14:00.642  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.10]\n2017-05-04 12:14:00.642  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 12:14:00.661  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 12:14:00.701  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.10]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.10]:5701\n2017-05-04 12:14:00.701  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.10]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 12:14:00.701  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.10]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 12:14:01.296  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.10]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 12:14:02.331  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.3.10]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 12:14:02.628  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.10]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 12:14:02.633  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.10]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 12:14:02.645  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.10]:5701 [someGroup] [3.8] [10.100.3.10]:5701 is STARTING\n2017-05-04 12:14:02.668  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.10]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 12:14:02.670  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.10]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.10]:5701 - b63496c8-9213-4a4f-9809-0567bf865468 this\n}\n\n2017-05-04 12:14:02.747  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.10]:5701 [someGroup] [3.8] [10.100.3.10]:5701 is STARTED\n2017-05-04 12:14:02.754  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.325 seconds (JVM running for 7.28)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 12:13:57.498  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-nwgwx with PID 7 (/bootstrapper.jar started by root in /)
    2017-05-04 12:13:57.519  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 12:13:57.614  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 12:13:57 GMT 2017]; root of context hierarchy
    2017-05-04 12:13:59.687  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 12:13:59.717  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 12:14:00.498  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 12:14:00.642  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.10]
    2017-05-04 12:14:00.642  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 12:14:00.661  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 12:14:00.701  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.10]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.10]:5701
    2017-05-04 12:14:00.701  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.10]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 12:14:00.701  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.10]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 12:14:01.296  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.10]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 12:14:02.331  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.3.10]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 12:14:02.628  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.10]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 12:14:02.633  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.10]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 12:14:02.645  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.10]:5701 [someGroup] [3.8] [10.100.3.10]:5701 is STARTING
    2017-05-04 12:14:02.668  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.10]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 12:14:02.670  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.10]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.10]:5701 - b63496c8-9213-4a4f-9809-0567bf865468 this
    }
    
    2017-05-04 12:14:02.747  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.10]:5701 [someGroup] [3.8] [10.100.3.10]:5701 is STARTED
    2017-05-04 12:14:02.754  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.325 seconds (JVM running for 7.28)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.239.182 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-rg6vz] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421043c20 exit status 1 <nil> <nil> true [0xc4204d87f0 0xc4204d8818 0xc4204d8830] [0xc4204d87f0 0xc4204d8818 0xc4204d8830] [0xc4204d8810 0xc4204d8828] [0x182d7e0 0x182d7e0] 0xc420c9a120 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.239.182 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-rg6vz] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421043c20 exit status 1 <nil> <nil> true [0xc4204d87f0 0xc4204d8818 0xc4204d8830] [0xc4204d87f0 0xc4204d8818 0xc4204d8830] [0xc4204d8810 0xc4204d8828] [0x182d7e0 0x182d7e0] 0xc420c9a120 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42012f900>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420078e20>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-fwf6x\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  12:11:29 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  12:11:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.10; broadcast_rpc_address=10.100.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fwf6x}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  12:11:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  12:11:30 Global memtable on-heap threshold is enabled at 128MB\nINFO  12:11:30 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:11:31 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-fwf6x
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  12:11:29 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  12:11:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.10; broadcast_rpc_address=10.100.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fwf6x}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  12:11:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  12:11:30 Global memtable on-heap threshold is enabled at 128MB
    INFO  12:11:30 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 12:11:31 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4823/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421232710>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.1.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.1.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.1.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-7k8vq\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:13:22 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:13:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.18; broadcast_rpc_address=10.100.1.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7k8vq}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:13:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:13:24 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:13:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:13:24 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.1.18
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.1.18
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.18
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.1.18
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-7k8vq
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  13:13:22 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:13:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.18; broadcast_rpc_address=10.100.1.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7k8vq}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:13:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:13:24 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:13:24 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:13:24 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4202b5cf0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 13:21:16.733  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-j1rch with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 13:21:16.740  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 13:21:16.885  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 13:21:16 GMT 2017]; root of context hierarchy\n2017-05-04 13:21:18.512  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 13:21:18.571  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 13:21:19.542  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 13:21:19.675  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.25]\n2017-05-04 13:21:19.676  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 13:21:19.690  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.25]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 13:21:19.727  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.25]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.25]:5701\n2017-05-04 13:21:19.727  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.25]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 13:21:19.727  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.25]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 13:21:20.191  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.25]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 13:21:21.280  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.25]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 13:21:21.579  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.25]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 13:21:21.586  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.25]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 13:21:21.606  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.25]:5701 [someGroup] [3.8] [10.100.1.25]:5701 is STARTING\n2017-05-04 13:21:21.636  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.25]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 13:21:21.640  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.25]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.25]:5701 - 68a23f3b-3d27-4954-a1f2-b8f2b3054ef7 this\n}\n\n2017-05-04 13:21:21.723  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.25]:5701 [someGroup] [3.8] [10.100.1.25]:5701 is STARTED\n2017-05-04 13:21:21.728  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.035 seconds (JVM running for 6.926)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 13:21:16.733  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-j1rch with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 13:21:16.740  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 13:21:16.885  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 13:21:16 GMT 2017]; root of context hierarchy
    2017-05-04 13:21:18.512  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 13:21:18.571  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 13:21:19.542  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 13:21:19.675  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.25]
    2017-05-04 13:21:19.676  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 13:21:19.690  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.25]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 13:21:19.727  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.25]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.25]:5701
    2017-05-04 13:21:19.727  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.25]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 13:21:19.727  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.25]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 13:21:20.191  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.25]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 13:21:21.280  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.25]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 13:21:21.579  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.25]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 13:21:21.586  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.25]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 13:21:21.606  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.25]:5701 [someGroup] [3.8] [10.100.1.25]:5701 is STARTING
    2017-05-04 13:21:21.636  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.25]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 13:21:21.640  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.25]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.25]:5701 - 68a23f3b-3d27-4954-a1f2-b8f2b3054ef7 this
    }
    
    2017-05-04 13:21:21.723  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.25]:5701 [someGroup] [3.8] [10.100.1.25]:5701 is STARTED
    2017-05-04 13:21:21.728  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.035 seconds (JVM running for 6.926)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4209fd2c0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.234.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-t63vr] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c10e40 exit status 1 <nil> <nil> true [0xc420248f88 0xc420248fc0 0xc420248fe0] [0xc420248f88 0xc420248fc0 0xc420248fe0] [0xc420248fa8 0xc420248fd8] [0x182d7e0 0x182d7e0] 0xc4214274a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.234.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-t63vr] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c10e40 exit status 1 <nil> <nil> true [0xc420248f88 0xc420248fc0 0xc420248fe0] [0xc420248f88 0xc420248fc0 0xc420248fe0] [0xc420248fa8 0xc420248fd8] [0x182d7e0 0x182d7e0] 0xc4214274a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4824/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42112d2b0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420afc9b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 13:58:15.919  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-rz35h with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 13:58:15.932  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 13:58:16.013  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 13:58:16 GMT 2017]; root of context hierarchy\n2017-05-04 13:58:17.361  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 13:58:17.380  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 13:58:18.066  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 13:58:18.198  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.0.13]\n2017-05-04 13:58:18.198  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 13:58:18.208  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.0.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 13:58:18.242  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.0.13]:5701\n2017-05-04 13:58:18.243  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 13:58:18.243  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 13:58:18.795  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.0.13]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 13:58:19.714  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.0.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 13:58:19.974  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.13]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 13:58:19.975  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 13:58:19.990  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.13]:5701 [someGroup] [3.8] [10.100.0.13]:5701 is STARTING\n2017-05-04 13:58:20.012  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.13]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 13:58:20.015  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.0.13]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.0.13]:5701 - 93005f3a-5625-44dd-b7aa-7fb0f3f1b1de this\n}\n\n2017-05-04 13:58:20.087  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.13]:5701 [someGroup] [3.8] [10.100.0.13]:5701 is STARTED\n2017-05-04 13:58:20.092  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.057 seconds (JVM running for 5.892)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 13:58:15.919  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-rz35h with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 13:58:15.932  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 13:58:16.013  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 13:58:16 GMT 2017]; root of context hierarchy
    2017-05-04 13:58:17.361  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 13:58:17.380  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 13:58:18.066  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 13:58:18.198  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.0.13]
    2017-05-04 13:58:18.198  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 13:58:18.208  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.0.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 13:58:18.242  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.0.13]:5701
    2017-05-04 13:58:18.243  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 13:58:18.243  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 13:58:18.795  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.0.13]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 13:58:19.714  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.0.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 13:58:19.974  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.13]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 13:58:19.975  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.0.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 13:58:19.990  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.13]:5701 [someGroup] [3.8] [10.100.0.13]:5701 is STARTING
    2017-05-04 13:58:20.012  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.0.13]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 13:58:20.015  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.0.13]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.0.13]:5701 - 93005f3a-5625-44dd-b7aa-7fb0f3f1b1de this
    }
    
    2017-05-04 13:58:20.087  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.0.13]:5701 [someGroup] [3.8] [10.100.0.13]:5701 is STARTED
    2017-05-04 13:58:20.092  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.057 seconds (JVM running for 5.892)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4210a74e0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-c9d8d\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  14:13:39 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  14:13:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.12; broadcast_rpc_address=10.100.2.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-c9d8d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  14:13:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  14:13:41 Global memtable on-heap threshold is enabled at 128MB\nINFO  14:13:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:13:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-c9d8d
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  14:13:39 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  14:13:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.12; broadcast_rpc_address=10.100.2.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-c9d8d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  14:13:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  14:13:41 Global memtable on-heap threshold is enabled at 128MB
    INFO  14:13:41 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 14:13:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-p8mg8] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421208870 exit status 1 <nil> <nil> true [0xc42000e528 0xc42000e558 0xc42000e598] [0xc42000e528 0xc42000e558 0xc42000e598] [0xc42000e548 0xc42000e588] [0x182d7e0 0x182d7e0] 0xc42120f560 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-p8mg8] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421208870 exit status 1 <nil> <nil> true [0xc42000e528 0xc42000e558 0xc42000e598] [0xc42000e528 0xc42000e558 0xc42000e598] [0xc42000e548 0xc42000e588] [0x182d7e0 0x182d7e0] 0xc42120f560 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4825/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420d464c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 15:20:00.868  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-fl551 with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 15:20:00.875  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 15:20:00.983  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 15:20:00 GMT 2017]; root of context hierarchy\n2017-05-04 15:20:02.712  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 15:20:02.732  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 15:20:03.457  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 15:20:03.646  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.23]\n2017-05-04 15:20:03.653  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 15:20:03.667  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 15:20:03.703  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.23]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.23]:5701\n2017-05-04 15:20:03.704  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.23]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 15:20:03.704  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.23]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 15:20:04.265  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.23]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 15:20:05.362  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.23]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 15:20:05.658  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.23]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 15:20:05.659  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.23]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 15:20:05.675  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.23]:5701 [someGroup] [3.8] [10.100.1.23]:5701 is STARTING\n2017-05-04 15:20:05.705  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.23]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 15:20:05.707  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.23]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.23]:5701 - fdc3e8e6-147c-425f-bd01-8f262c94664c this\n}\n\n2017-05-04 15:20:05.784  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.23]:5701 [someGroup] [3.8] [10.100.1.23]:5701 is STARTED\n2017-05-04 15:20:05.791  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.871 seconds (JVM running for 6.731)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 15:20:00.868  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-fl551 with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 15:20:00.875  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 15:20:00.983  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 15:20:00 GMT 2017]; root of context hierarchy
    2017-05-04 15:20:02.712  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 15:20:02.732  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 15:20:03.457  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 15:20:03.646  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.23]
    2017-05-04 15:20:03.653  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 15:20:03.667  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 15:20:03.703  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.23]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.23]:5701
    2017-05-04 15:20:03.704  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.23]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 15:20:03.704  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.23]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 15:20:04.265  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.23]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 15:20:05.362  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.23]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 15:20:05.658  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.23]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 15:20:05.659  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.23]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 15:20:05.675  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.23]:5701 [someGroup] [3.8] [10.100.1.23]:5701 is STARTING
    2017-05-04 15:20:05.705  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.23]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 15:20:05.707  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.23]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.23]:5701 - fdc3e8e6-147c-425f-bd01-8f262c94664c this
    }
    
    2017-05-04 15:20:05.784  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.23]:5701 [someGroup] [3.8] [10.100.1.23]:5701 is STARTED
    2017-05-04 15:20:05.791  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.871 seconds (JVM running for 6.731)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-cgm47] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421339e30 exit status 1 <nil> <nil> true [0xc42000e218 0xc42000e238 0xc42000e250] [0xc42000e218 0xc42000e238 0xc42000e250] [0xc42000e230 0xc42000e248] [0x182d7e0 0x182d7e0] 0xc421182de0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-cgm47] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421339e30 exit status 1 <nil> <nil> true [0xc42000e218 0xc42000e238 0xc42000e250] [0xc42000e218 0xc42000e238 0xc42000e250] [0xc42000e230 0xc42000e248] [0x182d7e0 0x182d7e0] 0xc421182de0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420ee8740>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.1.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.1.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.1.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-b2g9s\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:02:46 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:02:48 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.10; broadcast_rpc_address=10.100.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b2g9s}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:02:48 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:02:48 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:02:48 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:02:48 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.1.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.1.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.1.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-b2g9s
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  15:02:46 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:02:48 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.10; broadcast_rpc_address=10.100.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b2g9s}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:02:48 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:02:48 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:02:48 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:02:48 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4211d4070>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4826/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0g748] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421689950 exit status 1 <nil> <nil> true [0xc4203d0880 0xc4203d08a8 0xc4203d08c0] [0xc4203d0880 0xc4203d08a8 0xc4203d08c0] [0xc4203d08a0 0xc4203d08b8] [0x182d7e0 0x182d7e0] 0xc420fbf1a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0g748] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421689950 exit status 1 <nil> <nil> true [0xc4203d0880 0xc4203d08a8 0xc4203d08c0] [0xc4203d0880 0xc4203d08a8 0xc4203d08c0] [0xc4203d08a0 0xc4203d08b8] [0x182d7e0 0x182d7e0] 0xc420fbf1a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42048a6a0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420d103f0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 15:54:35.599  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bw0x6 with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 15:54:35.613  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 15:54:35.735  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 15:54:35 GMT 2017]; root of context hierarchy\n2017-05-04 15:54:37.553  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 15:54:37.572  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 15:54:38.321  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 15:54:38.457  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.7]\n2017-05-04 15:54:38.458  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 15:54:38.469  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 15:54:38.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.7]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.7]:5701\n2017-05-04 15:54:38.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.7]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 15:54:38.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.7]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 15:54:39.103  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.7]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 15:54:40.339  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.7]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 15:54:40.653  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.7]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 15:54:40.657  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.7]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 15:54:40.668  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.7]:5701 [someGroup] [3.8] [10.100.2.7]:5701 is STARTING\n2017-05-04 15:54:40.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.7]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 15:54:40.690  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.7]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.7]:5701 - 1a9fba87-c57e-42e6-9d36-c221b99f3af2 this\n}\n\n2017-05-04 15:54:40.768  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.7]:5701 [someGroup] [3.8] [10.100.2.7]:5701 is STARTED\n2017-05-04 15:54:40.773  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.266 seconds (JVM running for 7.078)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 15:54:35.599  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bw0x6 with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 15:54:35.613  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 15:54:35.735  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 15:54:35 GMT 2017]; root of context hierarchy
    2017-05-04 15:54:37.553  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 15:54:37.572  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 15:54:38.321  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 15:54:38.457  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.7]
    2017-05-04 15:54:38.458  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 15:54:38.469  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 15:54:38.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.7]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.7]:5701
    2017-05-04 15:54:38.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.7]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 15:54:38.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.7]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 15:54:39.103  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.7]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 15:54:40.339  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.7]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 15:54:40.653  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.7]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 15:54:40.657  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.7]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 15:54:40.668  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.7]:5701 [someGroup] [3.8] [10.100.2.7]:5701 is STARTING
    2017-05-04 15:54:40.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.7]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 15:54:40.690  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.7]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.7]:5701 - 1a9fba87-c57e-42e6-9d36-c221b99f3af2 this
    }
    
    2017-05-04 15:54:40.768  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.7]:5701 [someGroup] [3.8] [10.100.2.7]:5701 is STARTED
    2017-05-04 15:54:40.773  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.266 seconds (JVM running for 7.078)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420d10400>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.17\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.17\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.17\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.17\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gpzfh\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  16:21:54 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  16:21:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.17; broadcast_rpc_address=10.100.2.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gpzfh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  16:21:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  16:21:56 Global memtable on-heap threshold is enabled at 128MB\nINFO  16:21:56 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:21:56 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.17
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.17
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.17
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.17
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-gpzfh
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  16:21:54 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  16:21:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.17; broadcast_rpc_address=10.100.2.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gpzfh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  16:21:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  16:21:56 Global memtable on-heap threshold is enabled at 128MB
    INFO  16:21:56 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 16:21:56 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4827/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42001c320>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.0.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.0.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.0.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0zfns\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  16:52:29 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  16:52:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.6; broadcast_rpc_address=10.100.0.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0zfns}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  16:52:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  16:52:30 Global memtable on-heap threshold is enabled at 128MB\nINFO  16:52:30 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:52:30 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.0.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.0.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.0.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0zfns
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  16:52:29 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  16:52:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.6; broadcast_rpc_address=10.100.0.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0zfns}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  16:52:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  16:52:30 Global memtable on-heap threshold is enabled at 128MB
    INFO  16:52:30 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 16:52:30 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.181.4 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-q5vbg] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421058660 exit status 1 <nil> <nil> true [0xc4203d26b0 0xc4203d26c8 0xc4203d26e0] [0xc4203d26b0 0xc4203d26c8 0xc4203d26e0] [0xc4203d26c0 0xc4203d26d8] [0x182d7e0 0x182d7e0] 0xc420e80120 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.181.4 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-q5vbg] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421058660 exit status 1 <nil> <nil> true [0xc4203d26b0 0xc4203d26c8 0xc4203d26e0] [0xc4203d26b0 0xc4203d26c8 0xc4203d26e0] [0xc4203d26c0 0xc4203d26d8] [0x182d7e0 0x182d7e0] 0xc420e80120 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4211bc8f0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc42037cd50>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 17:07:18.822  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-1nwhr with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 17:07:18.828  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 17:07:18.911  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 17:07:18 GMT 2017]; root of context hierarchy\n2017-05-04 17:07:20.474  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 17:07:20.490  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 17:07:21.264  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 17:07:21.382  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.16]\n2017-05-04 17:07:21.383  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 17:07:21.395  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 17:07:21.429  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.16]:5701\n2017-05-04 17:07:21.429  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 17:07:21.430  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 17:07:21.925  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.16]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 17:07:22.891  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.16]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 17:07:23.144  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.16]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 17:07:23.145  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.16]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 17:07:23.158  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.16]:5701 [someGroup] [3.8] [10.100.2.16]:5701 is STARTING\n2017-05-04 17:07:23.188  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 17:07:23.191  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.16]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.16]:5701 - 11e6adda-fe72-4e23-a480-051d85308d07 this\n}\n\n2017-05-04 17:07:23.262  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.16]:5701 [someGroup] [3.8] [10.100.2.16]:5701 is STARTED\n2017-05-04 17:07:23.268  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.258 seconds (JVM running for 6.052)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 17:07:18.822  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-1nwhr with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 17:07:18.828  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 17:07:18.911  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 17:07:18 GMT 2017]; root of context hierarchy
    2017-05-04 17:07:20.474  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 17:07:20.490  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 17:07:21.264  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 17:07:21.382  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.16]
    2017-05-04 17:07:21.383  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 17:07:21.395  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 17:07:21.429  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.16]:5701
    2017-05-04 17:07:21.429  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 17:07:21.430  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 17:07:21.925  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.16]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 17:07:22.891  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.16]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 17:07:23.144  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.16]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 17:07:23.145  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.16]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 17:07:23.158  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.16]:5701 [someGroup] [3.8] [10.100.2.16]:5701 is STARTING
    2017-05-04 17:07:23.188  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.16]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 17:07:23.191  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.16]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.16]:5701 - 11e6adda-fe72-4e23-a480-051d85308d07 this
    }
    
    2017-05-04 17:07:23.262  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.16]:5701 [someGroup] [3.8] [10.100.2.16]:5701 is STARTED
    2017-05-04 17:07:23.268  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.258 seconds (JVM running for 6.052)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4828/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc421872940>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.33.64 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b2hck] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4211bf170 exit status 1 <nil> <nil> true [0xc4223b6138 0xc4223b6150 0xc4223b6168] [0xc4223b6138 0xc4223b6150 0xc4223b6168] [0xc4223b6148 0xc4223b6160] [0x182d7e0 0x182d7e0] 0xc420b63380 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.33.64 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b2hck] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4211bf170 exit status 1 <nil> <nil> true [0xc4223b6138 0xc4223b6150 0xc4223b6168] [0xc4223b6138 0xc4223b6150 0xc4223b6168] [0xc4223b6148 0xc4223b6160] [0x182d7e0 0x182d7e0] 0xc420b63380 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420b198a0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 17:47:43.527  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-nfmcc with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 17:47:43.536  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 17:47:43.680  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 17:47:43 GMT 2017]; root of context hierarchy\n2017-05-04 17:47:45.786  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 17:47:45.811  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 17:47:46.642  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 17:47:46.783  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.7]\n2017-05-04 17:47:46.783  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 17:47:46.795  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 17:47:46.835  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.7]:5701\n2017-05-04 17:47:46.836  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 17:47:46.836  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 17:47:47.443  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.7]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 17:47:48.481  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.7]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 17:47:48.753  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.7]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 17:47:48.761  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.7]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 17:47:48.776  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.7]:5701 [someGroup] [3.8] [10.100.3.7]:5701 is STARTING\n2017-05-04 17:47:48.796  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 17:47:48.802  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.7]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.7]:5701 - edef709e-6e9a-4a24-9cea-aa401babfc72 this\n}\n\n2017-05-04 17:47:48.877  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.7]:5701 [someGroup] [3.8] [10.100.3.7]:5701 is STARTED\n2017-05-04 17:47:48.880  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.445 seconds (JVM running for 7.341)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 17:47:43.527  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-nfmcc with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 17:47:43.536  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 17:47:43.680  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 17:47:43 GMT 2017]; root of context hierarchy
    2017-05-04 17:47:45.786  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 17:47:45.811  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 17:47:46.642  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 17:47:46.783  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.7]
    2017-05-04 17:47:46.783  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 17:47:46.795  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 17:47:46.835  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.7]:5701
    2017-05-04 17:47:46.836  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 17:47:46.836  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 17:47:47.443  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.7]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 17:47:48.481  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.7]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 17:47:48.753  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.7]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 17:47:48.761  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.7]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 17:47:48.776  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.7]:5701 [someGroup] [3.8] [10.100.3.7]:5701 is STARTING
    2017-05-04 17:47:48.796  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 17:47:48.802  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.7]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.7]:5701 - edef709e-6e9a-4a24-9cea-aa401babfc72 this
    }
    
    2017-05-04 17:47:48.877  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.7]:5701 [someGroup] [3.8] [10.100.3.7]:5701 is STARTED
    2017-05-04 17:47:48.880  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.445 seconds (JVM running for 7.341)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420c4d360>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-15f9n\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:07:34 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:07:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.10; broadcast_rpc_address=10.100.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-15f9n}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:07:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:07:35 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:07:35 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:07:35 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-15f9n
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  18:07:34 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:07:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.10; broadcast_rpc_address=10.100.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-15f9n}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:07:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:07:35 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:07:35 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:07:35 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gci-gce-examples/4829/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420476050>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 18:54:43.238  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-rsjf9 with PID 7 (/bootstrapper.jar started by root in /)\n2017-05-04 18:54:43.247  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 18:54:43.367  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 18:54:43 GMT 2017]; root of context hierarchy\n2017-05-04 18:54:44.895  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 18:54:44.910  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 18:54:45.677  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 18:54:45.806  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.5]\n2017-05-04 18:54:45.807  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 18:54:45.817  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 18:54:45.856  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.5]:5701\n2017-05-04 18:54:45.856  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 18:54:45.856  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 18:54:46.367  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.5]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 18:54:47.273  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.3.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 18:54:47.527  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 18:54:47.533  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 18:54:47.548  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTING\n2017-05-04 18:54:47.569  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 18:54:47.571  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.5]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.5]:5701 - d5cc10e5-5483-4a1d-8be5-5c186bd11a3e this\n}\n\n2017-05-04 18:54:47.634  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTED\n2017-05-04 18:54:47.639  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.307 seconds (JVM running for 6.098)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 18:54:43.238  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-rsjf9 with PID 7 (/bootstrapper.jar started by root in /)
    2017-05-04 18:54:43.247  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 18:54:43.367  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 18:54:43 GMT 2017]; root of context hierarchy
    2017-05-04 18:54:44.895  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 18:54:44.910  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 18:54:45.677  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 18:54:45.806  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.5]
    2017-05-04 18:54:45.807  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 18:54:45.817  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 18:54:45.856  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.5]:5701
    2017-05-04 18:54:45.856  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 18:54:45.856  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 18:54:46.367  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.5]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 18:54:47.273  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.3.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 18:54:47.527  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 18:54:47.533  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 18:54:47.548  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTING
    2017-05-04 18:54:47.569  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 18:54:47.571  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.5]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.5]:5701 - d5cc10e5-5483-4a1d-8be5-5c186bd11a3e this
    }
    
    2017-05-04 18:54:47.634  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTED
    2017-05-04 18:54:47.639  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.307 seconds (JVM running for 6.098)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc422172220>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-61337] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421eac810 exit status 1 <nil> <nil> true [0xc42004fa28 0xc42004fa40 0xc42004fa58] [0xc42004fa28 0xc42004fa40 0xc42004fa58] [0xc42004fa38 0xc42004fa50] [0x182d7e0 0x182d7e0] 0xc421ebc060 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.40.125 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-61337] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421eac810 exit status 1 <nil> <nil> true [0xc42004fa28 0xc42004fa40 0xc42004fa58] [0xc42004fa28 0xc42004fa40 0xc42004fa58] [0xc42004fa38 0xc42004fa50] [0x182d7e0 0x182d7e0] 0xc421ebc060 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42039c750>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.0.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.0.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.0.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-q4g2x\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:52:31 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:52:33 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.8; broadcast_rpc_address=10.100.0.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q4g2x}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:52:33 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:52:33 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:52:33 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:52:33 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.0.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.0.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.0.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.0.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-q4g2x
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  18:52:31 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:52:33 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.0.8; broadcast_rpc_address=10.100.0.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.0.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q4g2x}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:52:33 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:52:33 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:52:33 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:52:33 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@thockin thockin removed this from the v1.6.1 milestone May 27, 2017
@k8s-github-robot k8s-github-robot added the needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. label May 31, 2017
@k8s-github-robot
Copy link
Author

This Issue hasn't been active in 80 days. It will be closed in 9 days (Jun 15, 2017).

cc @apelisse @k8s-merge-robot

You can add 'keep-open' label to prevent this from happening, or add a comment to keep it open another 90 days

@spiffxp
Copy link
Member

spiffxp commented Jun 14, 2017

/remove-priority P0
/priority critical-urgent
(I'm not actually sure this is the right priority, just trying to remove the old priority/PN labels)

@k8s-ci-robot k8s-ci-robot added priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. and removed priority/P0 labels Jun 14, 2017
@spiffxp
Copy link
Member

spiffxp commented Jun 14, 2017

/assign

closing due to inactivity

@spiffxp
Copy link
Member

spiffxp commented Jun 14, 2017

/close

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@spiffxp spiffxp

@apelisse apelisse

Labels
kind/flake Categorizes issue or PR as related to a flaky test. needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@spiffxp @calebamiles @apelisse @ethernetdan @thockin @k8s-github-robot @k8s-ci-robot