Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ci-kubernetes-e2e-gce-examples: broken test run #43193

Closed
k8s-github-robot opened this issue Mar 16, 2017 · 1,295 comments
Closed

ci-kubernetes-e2e-gce-examples: broken test run #43193

k8s-github-robot opened this issue Mar 16, 2017 · 1,295 comments
Labels
area/example/cassandra area/example kind/flake Categorizes issue or PR as related to a flaky test.

Comments

@k8s-github-robot
Copy link

k8s-github-robot commented Mar 16, 2017 •
edited by fejta
Loading

https://storage.googleapis.com/k8s-gubernator/triage/index.html#451144a9be5d4451ad3c

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4198/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4211e6310>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 04:39:24.296  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-xzmwt with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 04:39:24.319  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 04:39:24.435  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 04:39:24 GMT 2017]; root of context hierarchy\n2017-03-16 04:39:26.181  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 04:39:26.202  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 04:39:26.855  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed\n\njava.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]\n\tat com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]\n\tat org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]\n\tat java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]\n\tat org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]\n\n2017-03-16 04:39:26.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.\n2017-03-16 04:39:26.990  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []\n2017-03-16 04:39:26.992  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 04:39:26.992  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.\n2017-03-16 04:39:27.009  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 04:39:27.045  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 04:39:27.404  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 04:39:28.250  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 04:39:28.527  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 04:39:28.537  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 04:39:28.546  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-16 04:39:28.552  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 04:39:28.594  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 2ea824d1-646d-467c-a70f-d7aedc318e9f this\n}\n\n2017-03-16 04:39:28.671  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-16 04:39:28.676  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.313 seconds (JVM running for 6.194)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 04:39:24.296  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-xzmwt with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 04:39:24.319  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 04:39:24.435  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 04:39:24 GMT 2017]; root of context hierarchy
    2017-03-16 04:39:26.181  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 04:39:26.202  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 04:39:26.855  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed
    
    java.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast
    	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]
    	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]
    	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]
    	at com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]
    	at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]
    	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]
    	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]
    
    2017-03-16 04:39:26.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.
    2017-03-16 04:39:26.990  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []
    2017-03-16 04:39:26.992  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 04:39:26.992  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.
    2017-03-16 04:39:27.009  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
    2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 04:39:27.045  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 04:39:27.404  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 04:39:28.250  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 04:39:28.527  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 04:39:28.537  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 04:39:28.546  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
    2017-03-16 04:39:28.552  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 04:39:28.594  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.6]:5701 - 2ea824d1-646d-467c-a70f-d7aedc318e9f this
    }
    
    2017-03-16 04:39:28.671  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
    2017-03-16 04:39:28.676  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.313 seconds (JVM running for 6.194)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5frwm] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420fd98f0 exit status 1 <nil> <nil> true [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886e0 0xc4204886f8] [0xc35000 0xc35000] 0xc420d5d800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5frwm] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420fd98f0 exit status 1 <nil> <nil> true [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886e0 0xc4204886f8] [0xc35000 0xc35000] 0xc420d5d800 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421357f70>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3bthz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:04:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:04:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3bthz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:04:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:04:41 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:04:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:04:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3bthz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  05:04:40 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:04:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3bthz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:04:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:04:41 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:04:41 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:04:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Previous issues for this suite: #36930 #37437 #38393 #38578 #39379 #40341 #43015
@k8s-github-robot k8s-github-robot added kind/flake Categorizes issue or PR as related to a flaky test. priority/P2 labels Mar 16, 2017
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4199/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4210a7570>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 05:38:22.790  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-kqv1m with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 05:38:22.818  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 05:38:22.915  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 05:38:22 GMT 2017]; root of context hierarchy\n2017-03-16 05:38:24.395  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 05:38:24.417  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 05:38:24.938  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed\n\njava.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]\n\tat com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]\n\tat org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]\n\tat java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]\n\tat org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]\n\n2017-03-16 05:38:24.939  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.\n2017-03-16 05:38:25.063  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []\n2017-03-16 05:38:25.065  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 05:38:25.065  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.\n2017-03-16 05:38:25.078  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701\n2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 05:38:25.407  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 05:38:26.150  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 05:38:26.398  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 05:38:26.410  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 05:38:26.447  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING\n2017-03-16 05:38:26.457  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 05:38:26.474  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.8]:5701 - c3b7548a-3ae9-428f-9bbf-2c323b11240c this\n}\n\n2017-03-16 05:38:26.554  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED\n2017-03-16 05:38:26.557  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.671 seconds (JVM running for 5.506)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 05:38:22.790  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-kqv1m with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 05:38:22.818  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 05:38:22.915  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 05:38:22 GMT 2017]; root of context hierarchy
    2017-03-16 05:38:24.395  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 05:38:24.417  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 05:38:24.938  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed
    
    java.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast
    	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]
    	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]
    	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]
    	at com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]
    	at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
    	at com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]
    	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]
    	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]
    	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]
    
    2017-03-16 05:38:24.939  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.
    2017-03-16 05:38:25.063  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []
    2017-03-16 05:38:25.065  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 05:38:25.065  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.
    2017-03-16 05:38:25.078  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701
    2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 05:38:25.407  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 05:38:26.150  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 05:38:26.398  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 05:38:26.410  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 05:38:26.447  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING
    2017-03-16 05:38:26.457  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 05:38:26.474  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.8]:5701 - c3b7548a-3ae9-428f-9bbf-2c323b11240c this
    }
    
    2017-03-16 05:38:26.554  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED
    2017-03-16 05:38:26.557  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.671 seconds (JVM running for 5.506)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-4lnmf] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f4ee40 exit status 1 <nil> <nil> true [0xc420488058 0xc420488088 0xc4204880c0] [0xc420488058 0xc420488088 0xc4204880c0] [0xc420488078 0xc4204880b0] [0xc35000 0xc35000] 0xc42109d140 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-4lnmf] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f4ee40 exit status 1 <nil> <nil> true [0xc420488058 0xc420488088 0xc4204880c0] [0xc420488058 0xc420488088 0xc4204880c0] [0xc420488078 0xc4204880b0] [0xc35000 0xc35000] 0xc42109d140 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4215c3bd0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0h0dt\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:02:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:02:31 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0h0dt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:02:31 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:02:31 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:02:31 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:02:31 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0h0dt
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  06:02:30 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:02:31 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0h0dt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:02:31 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:02:31 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:02:31 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:02:31 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4200/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420d2ef00>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-1tjzk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:38:08 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:38:08 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1tjzk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:38:08 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:38:08 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:38:08 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:38:08 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-1tjzk
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  06:38:08 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:38:08 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1tjzk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:38:08 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:38:08 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:38:08 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:38:08 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://108.59.87.136 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-r8f8x] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421118210 exit status 1 <nil> <nil> true [0xc42204e180 0xc42204e198 0xc42204e1b0] [0xc42204e180 0xc42204e198 0xc42204e1b0] [0xc42204e190 0xc42204e1a8] [0xc35000 0xc35000] 0xc420c384e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://108.59.87.136 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-r8f8x] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421118210 exit status 1 <nil> <nil> true [0xc42204e180 0xc42204e198 0xc42204e1b0] [0xc42204e180 0xc42204e198 0xc42204e1b0] [0xc42204e190 0xc42204e1a8] [0xc35000 0xc35000] 0xc420c384e0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4222b2270>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 06:55:50.428  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-3x850 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 06:55:50.442  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 06:55:50.552  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 06:55:50 GMT 2017]; root of context hierarchy\n2017-03-16 06:55:52.339  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 06:55:52.360  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 06:55:52.997  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 06:55:53.113  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.22]\n2017-03-16 06:55:53.113  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 06:55:53.125  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 06:55:53.157  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.22]:5701\n2017-03-16 06:55:53.158  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 06:55:53.158  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 06:55:53.518  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.22]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 06:55:54.628  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 06:55:54.875  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 06:55:54.883  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 06:55:54.895  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.22]:5701 [someGroup] [3.7.5] [10.180.2.22]:5701 is STARTING\n2017-03-16 06:55:54.896  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 06:55:54.954  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.22]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.22]:5701 - 6a4a687a-5a04-4243-8382-1f22cd9eaf8e this\n}\n\n2017-03-16 06:55:55.003  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.22]:5701 [someGroup] [3.7.5] [10.180.2.22]:5701 is STARTED\n2017-03-16 06:55:55.015  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.732 seconds (JVM running for 6.676)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 06:55:50.428  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-3x850 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 06:55:50.442  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 06:55:50.552  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 06:55:50 GMT 2017]; root of context hierarchy
    2017-03-16 06:55:52.339  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 06:55:52.360  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 06:55:52.997  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 06:55:53.113  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.22]
    2017-03-16 06:55:53.113  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 06:55:53.125  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 06:55:53.157  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.22]:5701
    2017-03-16 06:55:53.158  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 06:55:53.158  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 06:55:53.518  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.22]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 06:55:54.628  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 06:55:54.875  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 06:55:54.883  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 06:55:54.895  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.22]:5701 [someGroup] [3.7.5] [10.180.2.22]:5701 is STARTING
    2017-03-16 06:55:54.896  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 06:55:54.954  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.22]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.22]:5701 - 6a4a687a-5a04-4243-8382-1f22cd9eaf8e this
    }
    
    2017-03-16 06:55:55.003  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.22]:5701 [someGroup] [3.7.5] [10.180.2.22]:5701 is STARTED
    2017-03-16 06:55:55.015  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.732 seconds (JVM running for 6.676)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4201/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.21.252 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v0spg] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420b8aea0 exit status 1 <nil> <nil> true [0xc42044e0c0 0xc42044e0d8 0xc42044e0f0] [0xc42044e0c0 0xc42044e0d8 0xc42044e0f0] [0xc42044e0d0 0xc42044e0e8] [0xc35000 0xc35000] 0xc4207ac3c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.21.252 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v0spg] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420b8aea0 exit status 1 <nil> <nil> true [0xc42044e0c0 0xc42044e0d8 0xc42044e0f0] [0xc42044e0c0 0xc42044e0d8 0xc42044e0f0] [0xc42044e0d0 0xc42044e0e8] [0xc35000 0xc35000] 0xc4207ac3c0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420d64690>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-vm6z8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  07:40:58 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  07:40:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.7; broadcast_rpc_address=10.180.0.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vm6z8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  07:40:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  07:40:58 Global memtable on-heap threshold is enabled at 128MB\nINFO  07:40:58 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:40:58 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.0.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.0.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-vm6z8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  07:40:58 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  07:40:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.7; broadcast_rpc_address=10.180.0.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vm6z8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  07:40:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  07:40:58 Global memtable on-heap threshold is enabled at 128MB
    INFO  07:40:58 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 07:40:58 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420c82dd0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 07:46:00.934  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gngjk with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 07:46:00.949  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 07:46:01.078  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 07:46:01 GMT 2017]; root of context hierarchy\n2017-03-16 07:46:02.752  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 07:46:02.769  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 07:46:03.359  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 07:46:03.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]\n2017-03-16 07:46:03.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 07:46:03.481  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701\n2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 07:46:03.830  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 07:46:04.679  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 07:46:04.952  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 07:46:04.966  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 07:46:04.995  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING\n2017-03-16 07:46:04.998  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 07:46:05.029  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.9]:5701 - 34a1a1e7-a99d-4900-bffc-5b851dd1b1a8 this\n}\n\n2017-03-16 07:46:05.138  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED\n2017-03-16 07:46:05.143  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.11 seconds (JVM running for 6.03)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 07:46:00.934  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gngjk with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 07:46:00.949  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 07:46:01.078  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 07:46:01 GMT 2017]; root of context hierarchy
    2017-03-16 07:46:02.752  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 07:46:02.769  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 07:46:03.359  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 07:46:03.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]
    2017-03-16 07:46:03.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 07:46:03.481  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701
    2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 07:46:03.830  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 07:46:04.679  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 07:46:04.952  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 07:46:04.966  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 07:46:04.995  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING
    2017-03-16 07:46:04.998  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 07:46:05.029  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.9]:5701 - 34a1a1e7-a99d-4900-bffc-5b851dd1b1a8 this
    }
    
    2017-03-16 07:46:05.138  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED
    2017-03-16 07:46:05.143  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.11 seconds (JVM running for 6.03)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4202/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.246.223 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7hc6w] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e7b9e0 exit status 1 <nil> <nil> true [0xc420b24608 0xc420b24660 0xc420b24688] [0xc420b24608 0xc420b24660 0xc420b24688] [0xc420b24648 0xc420b24678] [0xc35000 0xc35000] 0xc420851800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.246.223 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7hc6w] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e7b9e0 exit status 1 <nil> <nil> true [0xc420b24608 0xc420b24660 0xc420b24688] [0xc420b24608 0xc420b24660 0xc420b24688] [0xc420b24648 0xc420b24678] [0xc35000 0xc35000] 0xc420851800 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421c0ce20>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-17bjb\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  08:37:36 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  08:37:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-17bjb}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  08:37:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  08:37:36 Global memtable on-heap threshold is enabled at 128MB\nINFO  08:37:36 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:37:36 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-17bjb
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  08:37:36 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  08:37:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-17bjb}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  08:37:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  08:37:36 Global memtable on-heap threshold is enabled at 128MB
    INFO  08:37:36 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 08:37:36 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420c8c050>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 08:40:12.084  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hldm8 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 08:40:12.093  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 08:40:12.243  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 08:40:12 GMT 2017]; root of context hierarchy\n2017-03-16 08:40:13.958  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 08:40:13.993  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 08:40:14.749  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 08:40:14.980  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]\n2017-03-16 08:40:14.981  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 08:40:14.993  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 08:40:15.030  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701\n2017-03-16 08:40:15.030  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 08:40:15.031  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 08:40:15.399  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 08:40:16.282  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 08:40:16.623  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 08:40:16.652  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 08:40:16.666  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING\n2017-03-16 08:40:16.669  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 08:40:16.702  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.8]:5701 - c01642a3-6a7a-4026-861c-cfaa925aed21 this\n}\n\n2017-03-16 08:40:16.789  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED\n2017-03-16 08:40:16.794  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.774 seconds (JVM running for 6.683)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 08:40:12.084  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hldm8 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 08:40:12.093  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 08:40:12.243  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 08:40:12 GMT 2017]; root of context hierarchy
    2017-03-16 08:40:13.958  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 08:40:13.993  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 08:40:14.749  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 08:40:14.980  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]
    2017-03-16 08:40:14.981  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 08:40:14.993  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 08:40:15.030  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701
    2017-03-16 08:40:15.030  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 08:40:15.031  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 08:40:15.399  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 08:40:16.282  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 08:40:16.623  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 08:40:16.652  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 08:40:16.666  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING
    2017-03-16 08:40:16.669  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 08:40:16.702  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.8]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.8]:5701 - c01642a3-6a7a-4026-861c-cfaa925aed21 this
    }
    
    2017-03-16 08:40:16.789  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED
    2017-03-16 08:40:16.794  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.774 seconds (JVM running for 6.683)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4203/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421b12570>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-6g2bt\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:35:00 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:35:01 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6g2bt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:35:01 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:35:01 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:35:01 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:35:01 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-6g2bt
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  09:35:00 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:35:01 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6g2bt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:35:01 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:35:01 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:35:01 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:35:01 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421afa4d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 09:45:44.253  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hjwxd with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 09:45:44.279  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 09:45:44.384  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 09:45:44 GMT 2017]; root of context hierarchy\n2017-03-16 09:45:46.067  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 09:45:46.084  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 09:45:46.761  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 09:45:46.907  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.19]\n2017-03-16 09:45:46.908  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 09:45:46.920  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 09:45:46.954  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.19]:5701\n2017-03-16 09:45:46.955  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 09:45:46.955  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 09:45:47.330  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.19]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 09:45:48.190  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 09:45:48.450  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 09:45:48.466  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 09:45:48.482  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTING\n2017-03-16 09:45:48.486  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 09:45:48.535  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.19]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.19]:5701 - 62a749fc-bba0-4f81-8b6c-02acfda01109 this\n}\n\n2017-03-16 09:45:48.610  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTED\n2017-03-16 09:45:48.616  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.349 seconds (JVM running for 6.223)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 09:45:44.253  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hjwxd with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 09:45:44.279  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 09:45:44.384  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 09:45:44 GMT 2017]; root of context hierarchy
    2017-03-16 09:45:46.067  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 09:45:46.084  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 09:45:46.761  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 09:45:46.907  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.19]
    2017-03-16 09:45:46.908  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 09:45:46.920  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 09:45:46.954  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.19]:5701
    2017-03-16 09:45:46.955  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 09:45:46.955  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 09:45:47.330  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.19]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 09:45:48.190  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 09:45:48.450  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 09:45:48.466  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 09:45:48.482  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTING
    2017-03-16 09:45:48.486  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 09:45:48.535  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.19]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.19]:5701 - 62a749fc-bba0-4f81-8b6c-02acfda01109 this
    }
    
    2017-03-16 09:45:48.610  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTED
    2017-03-16 09:45:48.616  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.349 seconds (JVM running for 6.223)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.13.129 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wj2w6] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dfc270 exit status 1 <nil> <nil> true [0xc420ec4608 0xc420ec4620 0xc420ec4638] [0xc420ec4608 0xc420ec4620 0xc420ec4638] [0xc420ec4618 0xc420ec4630] [0xc35000 0xc35000] 0xc4211fe000 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.13.129 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wj2w6] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420dfc270 exit status 1 <nil> <nil> true [0xc420ec4608 0xc420ec4620 0xc420ec4638] [0xc420ec4608 0xc420ec4620 0xc420ec4638] [0xc420ec4618 0xc420ec4630] [0xc35000 0xc35000] 0xc4211fe000 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4204/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421ba22b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-5xcq8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  10:37:21 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  10:37:21 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5xcq8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  10:37:21 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  10:37:21 Global memtable on-heap threshold is enabled at 128MB\nINFO  10:37:21 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:37:21 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-5xcq8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  10:37:21 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  10:37:21 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5xcq8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  10:37:21 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  10:37:21 Global memtable on-heap threshold is enabled at 128MB
    INFO  10:37:21 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 10:37:21 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421bce020>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 10:45:14.474  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ccwg8 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 10:45:14.490  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 10:45:14.597  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 10:45:14 GMT 2017]; root of context hierarchy\n2017-03-16 10:45:16.537  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 10:45:16.556  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 10:45:17.178  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 10:45:17.349  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.20]\n2017-03-16 10:45:17.349  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 10:45:17.362  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.20]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 10:45:17.440  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.20]:5701\n2017-03-16 10:45:17.441  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 10:45:17.441  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 10:45:17.883  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.20]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 10:45:18.807  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.20]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 10:45:19.088  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.20]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 10:45:19.098  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.20]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 10:45:19.111  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.20]:5701 [someGroup] [3.7.5] [10.180.2.20]:5701 is STARTING\n2017-03-16 10:45:19.113  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.20]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 10:45:19.164  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.20]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.20]:5701 - 8575eac0-6efb-428f-ae58-ae27e35b45b9 this\n}\n\n2017-03-16 10:45:19.236  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.20]:5701 [someGroup] [3.7.5] [10.180.2.20]:5701 is STARTED\n2017-03-16 10:45:19.244  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.789 seconds (JVM running for 6.7)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 10:45:14.474  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ccwg8 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 10:45:14.490  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 10:45:14.597  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 10:45:14 GMT 2017]; root of context hierarchy
    2017-03-16 10:45:16.537  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 10:45:16.556  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 10:45:17.178  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 10:45:17.349  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.20]
    2017-03-16 10:45:17.349  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 10:45:17.362  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.20]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 10:45:17.440  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.20]:5701
    2017-03-16 10:45:17.441  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 10:45:17.441  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 10:45:17.883  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.20]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 10:45:18.807  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.20]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 10:45:19.088  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.20]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 10:45:19.098  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.20]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 10:45:19.111  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.20]:5701 [someGroup] [3.7.5] [10.180.2.20]:5701 is STARTING
    2017-03-16 10:45:19.113  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.20]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 10:45:19.164  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.20]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.20]:5701 - 8575eac0-6efb-428f-ae58-ae27e35b45b9 this
    }
    
    2017-03-16 10:45:19.236  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.20]:5701 [someGroup] [3.7.5] [10.180.2.20]:5701 is STARTED
    2017-03-16 10:45:19.244  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.789 seconds (JVM running for 6.7)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ds4dn] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4211100c0 exit status 1 <nil> <nil> true [0xc4200369f0 0xc420036a08 0xc420036a20] [0xc4200369f0 0xc420036a08 0xc420036a20] [0xc420036a00 0xc420036a18] [0xc35000 0xc35000] 0xc42135dbc0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ds4dn] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4211100c0 exit status 1 <nil> <nil> true [0xc4200369f0 0xc420036a08 0xc420036a20] [0xc4200369f0 0xc420036a08 0xc420036a20] [0xc420036a00 0xc420036a18] [0xc35000 0xc35000] 0xc42135dbc0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4205/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420de8090>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.5\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.5\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.5\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.5\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-b13pg\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:30:11 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:30:11 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.5; broadcast_rpc_address=10.180.3.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b13pg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:30:11 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:30:12 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:30:12 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:30:12 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.5
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.5
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.5
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.5
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-b13pg
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  11:30:11 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:30:11 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.5; broadcast_rpc_address=10.180.3.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b13pg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:30:11 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:30:12 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:30:12 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:30:12 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4219c7800>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 11:43:31.514  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-rvmv1 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 11:43:31.521  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 11:43:31.644  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 11:43:31 GMT 2017]; root of context hierarchy\n2017-03-16 11:43:33.543  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 11:43:33.572  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 11:43:34.234  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 11:43:34.347  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-16 11:43:34.348  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 11:43:34.361  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 11:43:34.394  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-16 11:43:34.395  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 11:43:34.395  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 11:43:34.714  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 11:43:35.602  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 11:43:35.960  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 11:43:35.963  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 11:43:35.978  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-16 11:43:35.982  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 11:43:36.008  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - 462447fe-75cb-48ed-9318-3d8ba6e85f67 this\n}\n\n2017-03-16 11:43:36.087  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-16 11:43:36.098  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.54 seconds (JVM running for 6.48)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 11:43:31.514  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-rvmv1 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 11:43:31.521  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 11:43:31.644  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 11:43:31 GMT 2017]; root of context hierarchy
    2017-03-16 11:43:33.543  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 11:43:33.572  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 11:43:34.234  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 11:43:34.347  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
    2017-03-16 11:43:34.348  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 11:43:34.361  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 11:43:34.394  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
    2017-03-16 11:43:34.395  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 11:43:34.395  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 11:43:34.714  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 11:43:35.602  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 11:43:35.960  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 11:43:35.963  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 11:43:35.978  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
    2017-03-16 11:43:35.982  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 11:43:36.008  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.15]:5701 - 462447fe-75cb-48ed-9318-3d8ba6e85f67 this
    }
    
    2017-03-16 11:43:36.087  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
    2017-03-16 11:43:36.098  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.54 seconds (JVM running for 6.48)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.178.224 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nhqgs] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421125410 exit status 1 <nil> <nil> true [0xc4205a66c8 0xc4205a6700 0xc4205a6728] [0xc4205a66c8 0xc4205a6700 0xc4205a6728] [0xc4205a66e8 0xc4205a6718] [0xc35000 0xc35000] 0xc420eee4e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.178.224 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nhqgs] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421125410 exit status 1 <nil> <nil> true [0xc4205a66c8 0xc4205a6700 0xc4205a6728] [0xc4205a66c8 0xc4205a6700 0xc4205a6728] [0xc4205a66e8 0xc4205a6718] [0xc35000 0xc35000] 0xc420eee4e0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4206/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4215325b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 12:36:46.265  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5xsz3 with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 12:36:46.283  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 12:36:46.444  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 12:36:46 GMT 2017]; root of context hierarchy\n2017-03-16 12:36:47.916  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 12:36:47.936  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 12:36:48.595  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 12:36:48.719  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.8]\n2017-03-16 12:36:48.719  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 12:36:48.732  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 12:36:48.768  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.8]:5701\n2017-03-16 12:36:48.768  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 12:36:48.769  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 12:36:49.215  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 12:36:49.998  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 12:36:50.250  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 12:36:50.266  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 12:36:50.299  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTING\n2017-03-16 12:36:50.318  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 12:36:50.376  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.8]:5701 - 14b1add2-c0f5-49ba-bc87-d39a91e899dd this\n}\n\n2017-03-16 12:36:50.452  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTED\n2017-03-16 12:36:50.460  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.169 seconds (JVM running for 6.001)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 12:36:46.265  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5xsz3 with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 12:36:46.283  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 12:36:46.444  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 12:36:46 GMT 2017]; root of context hierarchy
    2017-03-16 12:36:47.916  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 12:36:47.936  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 12:36:48.595  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 12:36:48.719  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.8]
    2017-03-16 12:36:48.719  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 12:36:48.732  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 12:36:48.768  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.8]:5701
    2017-03-16 12:36:48.768  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 12:36:48.769  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 12:36:49.215  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 12:36:49.998  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 12:36:50.250  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 12:36:50.266  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 12:36:50.299  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTING
    2017-03-16 12:36:50.318  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 12:36:50.376  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.8]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.8]:5701 - 14b1add2-c0f5-49ba-bc87-d39a91e899dd this
    }
    
    2017-03-16 12:36:50.452  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTED
    2017-03-16 12:36:50.460  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.169 seconds (JVM running for 6.001)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.1.59 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gp3j7] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f07b60 exit status 1 <nil> <nil> true [0xc4200364e8 0xc420036508 0xc420036530] [0xc4200364e8 0xc420036508 0xc420036530] [0xc420036500 0xc420036528] [0xc35000 0xc35000] 0xc420c22d80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.1.59 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gp3j7] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f07b60 exit status 1 <nil> <nil> true [0xc4200364e8 0xc420036508 0xc420036530] [0xc4200364e8 0xc420036508 0xc420036530] [0xc420036500 0xc420036528] [0xc35000 0xc35000] 0xc420c22d80 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420b0f270>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0454d\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  12:33:57 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  12:33:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.7; broadcast_rpc_address=10.180.2.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0454d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  12:33:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  12:33:58 Global memtable on-heap threshold is enabled at 128MB\nINFO  12:33:58 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:33:58 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0454d
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  12:33:57 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  12:33:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.7; broadcast_rpc_address=10.180.2.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0454d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  12:33:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  12:33:58 Global memtable on-heap threshold is enabled at 128MB
    INFO  12:33:58 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 12:33:58 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4207/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42119a4b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 13:28:54.809  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gg22v with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 13:28:54.822  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 13:28:54.925  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 13:28:54 GMT 2017]; root of context hierarchy\n2017-03-16 13:28:56.541  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 13:28:56.563  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 13:28:57.155  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 13:28:57.287  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.12]\n2017-03-16 13:28:57.287  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 13:28:57.298  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 13:28:57.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.12]:5701\n2017-03-16 13:28:57.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 13:28:57.332  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 13:28:57.677  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.12]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 13:28:58.570  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 13:28:58.875  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 13:28:58.882  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 13:28:58.892  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.12]:5701 [someGroup] [3.7.5] [10.180.1.12]:5701 is STARTING\n2017-03-16 13:28:58.894  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 13:28:58.940  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.12]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.12]:5701 - a6d73a88-b142-499b-8d48-a85e905cd9f3 this\n}\n\n2017-03-16 13:28:59.018  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.12]:5701 [someGroup] [3.7.5] [10.180.1.12]:5701 is STARTED\n2017-03-16 13:28:59.021  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.262 seconds (JVM running for 6.105)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 13:28:54.809  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gg22v with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 13:28:54.822  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 13:28:54.925  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 13:28:54 GMT 2017]; root of context hierarchy
    2017-03-16 13:28:56.541  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 13:28:56.563  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 13:28:57.155  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 13:28:57.287  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.12]
    2017-03-16 13:28:57.287  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 13:28:57.298  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 13:28:57.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.12]:5701
    2017-03-16 13:28:57.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 13:28:57.332  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 13:28:57.677  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.12]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 13:28:58.570  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 13:28:58.875  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 13:28:58.882  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 13:28:58.892  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.12]:5701 [someGroup] [3.7.5] [10.180.1.12]:5701 is STARTING
    2017-03-16 13:28:58.894  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 13:28:58.940  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.12]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.12]:5701 - a6d73a88-b142-499b-8d48-a85e905cd9f3 this
    }
    
    2017-03-16 13:28:59.018  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.12]:5701 [someGroup] [3.7.5] [10.180.1.12]:5701 is STARTED
    2017-03-16 13:28:59.021  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.262 seconds (JVM running for 6.105)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420ba4210>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-7bd6d\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:43:48 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:43:48 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7bd6d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:43:48 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:43:48 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:43:48 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:43:48 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-7bd6d
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  13:43:48 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:43:48 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7bd6d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:43:48 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:43:48 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:43:48 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:43:48 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-sqwfr] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dd1770 exit status 1 <nil> <nil> true [0xc4200365e0 0xc420036608 0xc420036640] [0xc4200365e0 0xc420036608 0xc420036640] [0xc4200365f8 0xc420036620] [0xc35000 0xc35000] 0xc4211b7320 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-sqwfr] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420dd1770 exit status 1 <nil> <nil> true [0xc4200365e0 0xc420036608 0xc420036640] [0xc4200365e0 0xc420036608 0xc420036640] [0xc4200365f8 0xc420036620] [0xc35000 0xc35000] 0xc4211b7320 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4208/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wkslf] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420a36210 exit status 1 <nil> <nil> true [0xc4202627b0 0xc4202627c8 0xc4202627e0] [0xc4202627b0 0xc4202627c8 0xc4202627e0] [0xc4202627c0 0xc4202627d8] [0xc35000 0xc35000] 0xc420c04de0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wkslf] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420a36210 exit status 1 <nil> <nil> true [0xc4202627b0 0xc4202627c8 0xc4202627e0] [0xc4202627b0 0xc4202627c8 0xc4202627e0] [0xc4202627c0 0xc4202627d8] [0xc35000 0xc35000] 0xc420c04de0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4207ce570>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.22\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.22\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.22\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.22\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-kt0xh\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  14:33:48 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  14:33:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.22; broadcast_rpc_address=10.180.1.22; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.22; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-kt0xh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  14:33:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  14:33:49 Global memtable on-heap threshold is enabled at 128MB\nINFO  14:33:49 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:33:49 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.22
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.22
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.22
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.22
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-kt0xh
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  14:33:48 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  14:33:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.22; broadcast_rpc_address=10.180.1.22; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.22; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-kt0xh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  14:33:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  14:33:49 Global memtable on-heap threshold is enabled at 128MB
    INFO  14:33:49 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 14:33:49 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42177a200>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 14:36:32.415  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gxc8b with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 14:36:32.430  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 14:36:32.561  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 14:36:32 GMT 2017]; root of context hierarchy\n2017-03-16 14:36:34.177  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 14:36:34.208  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 14:36:34.812  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 14:36:34.951  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.23]\n2017-03-16 14:36:34.951  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 14:36:34.963  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.23]:5701\n2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 14:36:35.410  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.23]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 14:36:36.323  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.23]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 14:36:36.596  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.23]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 14:36:36.597  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.23]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 14:36:36.607  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.23]:5701 [someGroup] [3.7.5] [10.180.1.23]:5701 is STARTING\n2017-03-16 14:36:36.608  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.23]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 14:36:36.634  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.23]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.23]:5701 - 59d5a498-0b91-4767-bfa7-67b983ad987a this\n}\n\n2017-03-16 14:36:36.706  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.23]:5701 [someGroup] [3.7.5] [10.180.1.23]:5701 is STARTED\n2017-03-16 14:36:36.715  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.341 seconds (JVM running for 6.19)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 14:36:32.415  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gxc8b with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 14:36:32.430  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 14:36:32.561  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 14:36:32 GMT 2017]; root of context hierarchy
    2017-03-16 14:36:34.177  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 14:36:34.208  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 14:36:34.812  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 14:36:34.951  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.23]
    2017-03-16 14:36:34.951  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 14:36:34.963  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.23]:5701
    2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 14:36:35.410  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.23]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 14:36:36.323  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.23]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 14:36:36.596  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.23]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 14:36:36.597  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.23]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 14:36:36.607  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.23]:5701 [someGroup] [3.7.5] [10.180.1.23]:5701 is STARTING
    2017-03-16 14:36:36.608  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.23]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 14:36:36.634  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.23]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.23]:5701 - 59d5a498-0b91-4767-bfa7-67b983ad987a this
    }
    
    2017-03-16 14:36:36.706  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.23]:5701 [someGroup] [3.7.5] [10.180.1.23]:5701 is STARTED
    2017-03-16 14:36:36.715  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.341 seconds (JVM running for 6.19)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4209/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420b2b7b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 15:20:53.795  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wzlps with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 15:20:53.818  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 15:20:53.935  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 15:20:53 GMT 2017]; root of context hierarchy\n2017-03-16 15:20:55.761  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 15:20:55.781  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 15:20:56.404  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 15:20:56.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.11]\n2017-03-16 15:20:56.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 15:20:56.536  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 15:20:56.568  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.11]:5701\n2017-03-16 15:20:56.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 15:20:56.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 15:20:56.905  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 15:20:57.935  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 15:20:58.231  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 15:20:58.242  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 15:20:58.256  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTING\n2017-03-16 15:20:58.259  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 15:20:58.297  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.11]:5701 - 61c4a6d9-0cfb-4ff8-a372-bb066076a680 this\n}\n\n2017-03-16 15:20:58.375  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTED\n2017-03-16 15:20:58.379  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.598 seconds (JVM running for 6.505)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 15:20:53.795  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wzlps with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 15:20:53.818  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 15:20:53.935  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 15:20:53 GMT 2017]; root of context hierarchy
    2017-03-16 15:20:55.761  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 15:20:55.781  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 15:20:56.404  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 15:20:56.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.11]
    2017-03-16 15:20:56.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 15:20:56.536  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 15:20:56.568  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.11]:5701
    2017-03-16 15:20:56.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 15:20:56.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 15:20:56.905  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 15:20:57.935  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 15:20:58.231  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 15:20:58.242  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 15:20:58.256  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTING
    2017-03-16 15:20:58.259  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 15:20:58.297  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.11]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.11]:5701 - 61c4a6d9-0cfb-4ff8-a372-bb066076a680 this
    }
    
    2017-03-16 15:20:58.375  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTED
    2017-03-16 15:20:58.379  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.598 seconds (JVM running for 6.505)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420b2a790>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gj3fp\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:40:55 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:40:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.14; broadcast_rpc_address=10.180.1.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gj3fp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:40:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:40:56 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:40:56 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:40:56 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-gj3fp
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  15:40:55 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:40:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.14; broadcast_rpc_address=10.180.1.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gj3fp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:40:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:40:56 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:40:56 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:40:56 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wfmjl] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420a0ae10 exit status 1 <nil> <nil> true [0xc4202c6210 0xc4202c6350 0xc4202c6368] [0xc4202c6210 0xc4202c6350 0xc4202c6368] [0xc4202c6330 0xc4202c6360] [0xc35000 0xc35000] 0xc420bfea80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wfmjl] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420a0ae10 exit status 1 <nil> <nil> true [0xc4202c6210 0xc4202c6350 0xc4202c6368] [0xc4202c6210 0xc4202c6350 0xc4202c6368] [0xc4202c6330 0xc4202c6360] [0xc35000 0xc35000] 0xc420bfea80 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4210/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421124a30>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-dp66l\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  16:26:38 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  16:26:38 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dp66l}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  16:26:38 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  16:26:38 Global memtable on-heap threshold is enabled at 128MB\nINFO  16:26:38 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:26:38 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-dp66l
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  16:26:38 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  16:26:38 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dp66l}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  16:26:38 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  16:26:38 Global memtable on-heap threshold is enabled at 128MB
    INFO  16:26:38 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 16:26:38 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-64wtp] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c69dd0 exit status 1 <nil> <nil> true [0xc420036ae8 0xc420036b00 0xc420036b18] [0xc420036ae8 0xc420036b00 0xc420036b18] [0xc420036af8 0xc420036b10] [0xc35000 0xc35000] 0xc420da7d40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-64wtp] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c69dd0 exit status 1 <nil> <nil> true [0xc420036ae8 0xc420036b00 0xc420036b18] [0xc420036ae8 0xc420036b00 0xc420036b18] [0xc420036af8 0xc420036b10] [0xc35000 0xc35000] 0xc420da7d40 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421f13130>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 16:31:59.772  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-lcwvh with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 16:31:59.786  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 16:31:59.878  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 16:31:59 GMT 2017]; root of context hierarchy\n2017-03-16 16:32:01.504  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 16:32:01.523  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 16:32:02.096  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 16:32:02.226  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-16 16:32:02.226  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 16:32:02.239  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 16:32:02.279  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-16 16:32:02.280  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 16:32:02.280  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 16:32:02.789  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 16:32:03.603  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 16:32:03.884  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 16:32:03.886  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 16:32:03.900  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-16 16:32:03.903  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 16:32:03.931  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - 83d6559e-2564-46a2-9833-ee93e777854b this\n}\n\n2017-03-16 16:32:03.983  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-16 16:32:03.999  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.201 seconds (JVM running for 6.124)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 16:31:59.772  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-lcwvh with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 16:31:59.786  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 16:31:59.878  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 16:31:59 GMT 2017]; root of context hierarchy
    2017-03-16 16:32:01.504  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 16:32:01.523  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 16:32:02.096  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 16:32:02.226  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
    2017-03-16 16:32:02.226  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 16:32:02.239  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 16:32:02.279  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
    2017-03-16 16:32:02.280  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 16:32:02.280  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 16:32:02.789  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 16:32:03.603  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 16:32:03.884  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 16:32:03.886  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 16:32:03.900  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
    2017-03-16 16:32:03.903  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 16:32:03.931  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.18]:5701 - 83d6559e-2564-46a2-9833-ee93e777854b this
    }
    
    2017-03-16 16:32:03.983  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
    2017-03-16 16:32:03.999  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.201 seconds (JVM running for 6.124)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4211/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42180b4f0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-d3p7j\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  17:44:11 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  17:44:12 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.19; broadcast_rpc_address=10.180.1.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-d3p7j}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  17:44:12 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  17:44:12 Global memtable on-heap threshold is enabled at 128MB\nINFO  17:44:12 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:44:12 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.19
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.19
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.19
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.19
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-d3p7j
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  17:44:11 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  17:44:12 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.19; broadcast_rpc_address=10.180.1.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-d3p7j}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  17:44:12 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  17:44:12 Global memtable on-heap threshold is enabled at 128MB
    INFO  17:44:12 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 17:44:12 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7t64h] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421523140 exit status 1 <nil> <nil> true [0xc4205b4260 0xc4205b42a8 0xc4205b42d8] [0xc4205b4260 0xc4205b42a8 0xc4205b42d8] [0xc4205b42a0 0xc4205b42c8] [0xc35000 0xc35000] 0xc4211603c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7t64h] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421523140 exit status 1 <nil> <nil> true [0xc4205b4260 0xc4205b42a8 0xc4205b42d8] [0xc4205b4260 0xc4205b42a8 0xc4205b42d8] [0xc4205b42a0 0xc4205b42c8] [0xc35000 0xc35000] 0xc4211603c0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420f66740>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 17:24:18.963  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-sctgs with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 17:24:18.971  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 17:24:19.134  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 17:24:19 GMT 2017]; root of context hierarchy\n2017-03-16 17:24:20.831  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 17:24:20.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 17:24:21.639  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 17:24:21.755  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.15]\n2017-03-16 17:24:21.755  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 17:24:21.767  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 17:24:21.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.15]:5701\n2017-03-16 17:24:21.801  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 17:24:21.801  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 17:24:22.170  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 17:24:23.093  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 17:24:23.412  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 17:24:23.422  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 17:24:23.435  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.15]:5701 [someGroup] [3.7.5] [10.180.0.15]:5701 is STARTING\n2017-03-16 17:24:23.438  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 17:24:23.496  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.15]:5701 - 8ba46f5b-dc8b-4ab2-ad88-c63e302c0541 this\n}\n\n2017-03-16 17:24:23.579  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.15]:5701 [someGroup] [3.7.5] [10.180.0.15]:5701 is STARTED\n2017-03-16 17:24:23.581  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.786 seconds (JVM running for 6.612)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 17:24:18.963  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-sctgs with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 17:24:18.971  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 17:24:19.134  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 17:24:19 GMT 2017]; root of context hierarchy
    2017-03-16 17:24:20.831  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 17:24:20.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 17:24:21.639  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 17:24:21.755  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.15]
    2017-03-16 17:24:21.755  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 17:24:21.767  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 17:24:21.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.15]:5701
    2017-03-16 17:24:21.801  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 17:24:21.801  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 17:24:22.170  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 17:24:23.093  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 17:24:23.412  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 17:24:23.422  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 17:24:23.435  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.15]:5701 [someGroup] [3.7.5] [10.180.0.15]:5701 is STARTING
    2017-03-16 17:24:23.438  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 17:24:23.496  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.15]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.0.15]:5701 - 8ba46f5b-dc8b-4ab2-ad88-c63e302c0541 this
    }
    
    2017-03-16 17:24:23.579  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.15]:5701 [someGroup] [3.7.5] [10.180.0.15]:5701 is STARTED
    2017-03-16 17:24:23.581  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.786 seconds (JVM running for 6.612)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@calebamiles calebamiles modified the milestone: v1.6 Mar 16, 2017
@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4212/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4209c18e0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-7pzbn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:19:26 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:19:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7pzbn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:19:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:19:26 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:19:26 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:19:26 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-7pzbn
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  18:19:26 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:19:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7pzbn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:19:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:19:26 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:19:26 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:19:26 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-blg5s] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42117f260 exit status 1 <nil> <nil> true [0xc4205923e0 0xc4205923f8 0xc420592410] [0xc4205923e0 0xc4205923f8 0xc420592410] [0xc4205923f0 0xc420592408] [0xc360d0 0xc360d0] 0xc420fe9620 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-blg5s] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42117f260 exit status 1 <nil> <nil> true [0xc4205923e0 0xc4205923f8 0xc420592410] [0xc4205923e0 0xc4205923f8 0xc420592410] [0xc4205923f0 0xc420592408] [0xc360d0 0xc360d0] 0xc420fe9620 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42207ac70>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 18:36:38.045  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bx36p with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 18:36:38.057  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 18:36:38.200  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 18:36:38 GMT 2017]; root of context hierarchy\n2017-03-16 18:36:39.880  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 18:36:39.901  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 18:36:40.690  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 18:36:40.805  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.19]\n2017-03-16 18:36:40.806  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 18:36:40.821  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.19]:5701\n2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 18:36:41.259  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.19]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 18:36:42.140  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 18:36:42.484  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 18:36:42.492  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 18:36:42.503  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTING\n2017-03-16 18:36:42.512  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 18:36:42.544  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.19]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.19]:5701 - 882980fa-eabe-4add-895b-88706a047df1 this\n}\n\n2017-03-16 18:36:42.605  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTED\n2017-03-16 18:36:42.636  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.581 seconds (JVM running for 8.99)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 18:36:38.045  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bx36p with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 18:36:38.057  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 18:36:38.200  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 18:36:38 GMT 2017]; root of context hierarchy
    2017-03-16 18:36:39.880  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 18:36:39.901  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 18:36:40.690  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 18:36:40.805  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.19]
    2017-03-16 18:36:40.806  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 18:36:40.821  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.19]:5701
    2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 18:36:41.259  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.19]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 18:36:42.140  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 18:36:42.484  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 18:36:42.492  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 18:36:42.503  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTING
    2017-03-16 18:36:42.512  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 18:36:42.544  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.19]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.19]:5701 - 882980fa-eabe-4add-895b-88706a047df1 this
    }
    
    2017-03-16 18:36:42.605  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTED
    2017-03-16 18:36:42.636  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.581 seconds (JVM running for 8.99)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4213/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42212c730>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 19:24:29.691  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-djbvz with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 19:24:29.698  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 19:24:29.803  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 19:24:29 GMT 2017]; root of context hierarchy\n2017-03-16 19:24:31.452  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 19:24:31.470  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 19:24:32.111  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 19:24:32.238  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.12]\n2017-03-16 19:24:32.239  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 19:24:32.251  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 19:24:32.284  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.12]:5701\n2017-03-16 19:24:32.284  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 19:24:32.285  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 19:24:32.632  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.12]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 19:24:33.612  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 19:24:33.889  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 19:24:33.899  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 19:24:33.908  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTING\n2017-03-16 19:24:33.911  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 19:24:33.934  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.12]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.12]:5701 - 0dc372e6-d7ff-475a-b39e-343bb1f3d8c6 this\n}\n\n2017-03-16 19:24:34.004  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTED\n2017-03-16 19:24:34.008  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.192 seconds (JVM running for 6.1)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 19:24:29.691  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-djbvz with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 19:24:29.698  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 19:24:29.803  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 19:24:29 GMT 2017]; root of context hierarchy
    2017-03-16 19:24:31.452  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 19:24:31.470  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 19:24:32.111  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 19:24:32.238  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.12]
    2017-03-16 19:24:32.239  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 19:24:32.251  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 19:24:32.284  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.12]:5701
    2017-03-16 19:24:32.284  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 19:24:32.285  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 19:24:32.632  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.12]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 19:24:33.612  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 19:24:33.889  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 19:24:33.899  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 19:24:33.908  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTING
    2017-03-16 19:24:33.911  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 19:24:33.934  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.12]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.2.12]:5701 - 0dc372e6-d7ff-475a-b39e-343bb1f3d8c6 this
    }
    
    2017-03-16 19:24:34.004  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTED
    2017-03-16 19:24:34.008  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.192 seconds (JVM running for 6.1)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-468qk] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4216cd050 exit status 1 <nil> <nil> true [0xc420037548 0xc420037560 0xc420037578] [0xc420037548 0xc420037560 0xc420037578] [0xc420037558 0xc420037570] [0xc360d0 0xc360d0] 0xc42123fc20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-468qk] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4216cd050 exit status 1 <nil> <nil> true [0xc420037548 0xc420037560 0xc420037578] [0xc420037548 0xc420037560 0xc420037578] [0xc420037558 0xc420037570] [0xc360d0 0xc360d0] 0xc42123fc20 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4216081b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-66mjq\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  19:21:36 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  19:21:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-66mjq}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  19:21:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  19:21:36 Global memtable on-heap threshold is enabled at 128MB\nINFO  19:21:36 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 19:21:36 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-66mjq
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  19:21:36 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  19:21:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-66mjq}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  19:21:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  19:21:36 Global memtable on-heap threshold is enabled at 128MB
    INFO  19:21:36 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 19:21:36 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4214/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42190c820>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9dcns\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  20:37:43 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  20:37:43 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.11; broadcast_rpc_address=10.180.0.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9dcns}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  20:37:43 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  20:37:43 Global memtable on-heap threshold is enabled at 128MB\nINFO  20:37:43 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:37:43 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.0.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.0.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9dcns
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  20:37:43 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  20:37:43 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.11; broadcast_rpc_address=10.180.0.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9dcns}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  20:37:43 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  20:37:43 Global memtable on-heap threshold is enabled at 128MB
    INFO  20:37:43 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 20:37:43 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jxt8z] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4213347e0 exit status 1 <nil> <nil> true [0xc42054e6d8 0xc42054e6f0 0xc42054e708] [0xc42054e6d8 0xc42054e6f0 0xc42054e708] [0xc42054e6e8 0xc42054e700] [0xc360d0 0xc360d0] 0xc421050fc0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jxt8z] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4213347e0 exit status 1 <nil> <nil> true [0xc42054e6d8 0xc42054e6f0 0xc42054e708] [0xc42054e6d8 0xc42054e6f0 0xc42054e708] [0xc42054e6e8 0xc42054e700] [0xc360d0 0xc360d0] 0xc421050fc0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421078800>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 20:22:33.809  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9r0hb with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 20:22:33.826  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 20:22:33.991  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 20:22:33 GMT 2017]; root of context hierarchy\n2017-03-16 20:22:35.735  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 20:22:35.760  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 20:22:36.585  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 20:22:36.733  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-16 20:22:36.733  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 20:22:36.745  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 20:22:37.152  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 20:22:38.161  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 20:22:38.429  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 20:22:38.434  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 20:22:38.462  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-16 20:22:38.463  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 20:22:38.497  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - f03b4406-e5bc-46ae-a5de-42448e37ab1b this\n}\n\n2017-03-16 20:22:38.553  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-16 20:22:38.565  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.938 seconds (JVM running for 6.785)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 20:22:33.809  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9r0hb with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 20:22:33.826  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 20:22:33.991  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 20:22:33 GMT 2017]; root of context hierarchy
    2017-03-16 20:22:35.735  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 20:22:35.760  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 20:22:36.585  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 20:22:36.733  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
    2017-03-16 20:22:36.733  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 20:22:36.745  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
    2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 20:22:37.152  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 20:22:38.161  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 20:22:38.429  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 20:22:38.434  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 20:22:38.462  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
    2017-03-16 20:22:38.463  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 20:22:38.497  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.15]:5701 - f03b4406-e5bc-46ae-a5de-42448e37ab1b this
    }
    
    2017-03-16 20:22:38.553  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
    2017-03-16 20:22:38.565  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.938 seconds (JVM running for 6.785)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4215/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421992870>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3jdbm\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  21:33:42 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  21:33:43 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3jdbm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  21:33:43 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  21:33:43 Global memtable on-heap threshold is enabled at 128MB\nINFO  21:33:43 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:33:43 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3jdbm
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  21:33:42 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  21:33:43 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3jdbm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  21:33:43 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  21:33:43 Global memtable on-heap threshold is enabled at 128MB
    INFO  21:33:43 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 21:33:43 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nq6n3] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ae6e10 exit status 1 <nil> <nil> true [0xc420e3e3f0 0xc420e3e408 0xc420e3e420] [0xc420e3e3f0 0xc420e3e408 0xc420e3e420] [0xc420e3e400 0xc420e3e418] [0xc360d0 0xc360d0] 0xc420be40c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nq6n3] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ae6e10 exit status 1 <nil> <nil> true [0xc420e3e3f0 0xc420e3e408 0xc420e3e420] [0xc420e3e3f0 0xc420e3e408 0xc420e3e420] [0xc420e3e400 0xc420e3e418] [0xc360d0 0xc360d0] 0xc420be40c0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420d77170>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 21:18:41.525  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0904p with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 21:18:41.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 21:18:41.601  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 21:18:41 GMT 2017]; root of context hierarchy\n2017-03-16 21:18:43.098  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 21:18:43.122  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 21:18:43.706  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 21:18:43.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-16 21:18:43.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 21:18:43.825  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 21:18:44.176  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 21:18:44.934  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 21:18:45.169  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 21:18:45.172  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 21:18:45.182  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-16 21:18:45.185  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 21:18:45.215  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - 1990fd58-2d11-4980-af58-71f4bce23619 this\n}\n\n2017-03-16 21:18:45.301  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-16 21:18:45.303  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.811 seconds (JVM running for 5.636)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 21:18:41.525  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0904p with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 21:18:41.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 21:18:41.601  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 21:18:41 GMT 2017]; root of context hierarchy
    2017-03-16 21:18:43.098  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 21:18:43.122  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 21:18:43.706  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 21:18:43.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
    2017-03-16 21:18:43.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 21:18:43.825  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
    2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 21:18:44.176  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 21:18:44.934  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 21:18:45.169  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 21:18:45.172  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 21:18:45.182  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
    2017-03-16 21:18:45.185  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 21:18:45.215  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.14]:5701 - 1990fd58-2d11-4980-af58-71f4bce23619 this
    }
    
    2017-03-16 21:18:45.301  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
    2017-03-16 21:18:45.303  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.811 seconds (JVM running for 5.636)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4216/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421be8620>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-vtwzp\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  22:40:03 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  22:40:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.18; broadcast_rpc_address=10.180.3.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vtwzp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  22:40:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  22:40:03 Global memtable on-heap threshold is enabled at 128MB\nINFO  22:40:03 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 22:40:03 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.18
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.18
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.18
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.18
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-vtwzp
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  22:40:03 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  22:40:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.18; broadcast_rpc_address=10.180.3.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vtwzp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  22:40:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  22:40:03 Global memtable on-heap threshold is enabled at 128MB
    INFO  22:40:03 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 22:40:03 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5l9w2] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4210508d0 exit status 1 <nil> <nil> true [0xc420038530 0xc420038568 0xc4200385b0] [0xc420038530 0xc420038568 0xc4200385b0] [0xc420038548 0xc4200385a0] [0xc360d0 0xc360d0] 0xc4212570e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5l9w2] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4210508d0 exit status 1 <nil> <nil> true [0xc420038530 0xc420038568 0xc4200385b0] [0xc420038530 0xc420038568 0xc4200385b0] [0xc420038548 0xc4200385a0] [0xc360d0 0xc360d0] 0xc4212570e0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421b37740>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 22:25:16.230  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-f5qfv with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 22:25:16.238  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 22:25:16.371  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 22:25:16 GMT 2017]; root of context hierarchy\n2017-03-16 22:25:17.967  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 22:25:17.988  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 22:25:18.810  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 22:25:18.940  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.17]\n2017-03-16 22:25:18.941  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 22:25:18.953  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 22:25:18.984  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.17]:5701\n2017-03-16 22:25:18.984  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 22:25:18.985  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 22:25:19.321  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 22:25:20.255  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.3.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 22:25:20.544  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 22:25:20.546  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 22:25:20.560  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTING\n2017-03-16 22:25:20.562  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 22:25:20.599  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.17]:5701 - c869a394-6eca-4270-a884-12dbebb0225b this\n}\n\n2017-03-16 22:25:20.667  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTED\n2017-03-16 22:25:20.670  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.329 seconds (JVM running for 6.317)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 22:25:16.230  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-f5qfv with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 22:25:16.238  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 22:25:16.371  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 22:25:16 GMT 2017]; root of context hierarchy
    2017-03-16 22:25:17.967  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 22:25:17.988  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 22:25:18.810  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 22:25:18.940  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.17]
    2017-03-16 22:25:18.941  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 22:25:18.953  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 22:25:18.984  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.17]:5701
    2017-03-16 22:25:18.984  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 22:25:18.985  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 22:25:19.321  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 22:25:20.255  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.3.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 22:25:20.544  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 22:25:20.546  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 22:25:20.560  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTING
    2017-03-16 22:25:20.562  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 22:25:20.599  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.17]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.17]:5701 - c869a394-6eca-4270-a884-12dbebb0225b this
    }
    
    2017-03-16 22:25:20.667  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTED
    2017-03-16 22:25:20.670  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.329 seconds (JVM running for 6.317)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4217/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b49fq] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4213af140 exit status 1 <nil> <nil> true [0xc420036268 0xc420036280 0xc420036298] [0xc420036268 0xc420036280 0xc420036298] [0xc420036278 0xc420036290] [0xc35e70 0xc35e70] 0xc422359980 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b49fq] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4213af140 exit status 1 <nil> <nil> true [0xc420036268 0xc420036280 0xc420036298] [0xc420036268 0xc420036280 0xc420036298] [0xc420036278 0xc420036290] [0xc35e70 0xc35e70] 0xc422359980 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420ce50d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 23:14:33.448  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5rzjg with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 23:14:33.455  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 23:14:33.635  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 23:14:33 GMT 2017]; root of context hierarchy\n2017-03-16 23:14:35.433  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 23:14:35.460  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 23:14:36.103  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 23:14:36.220  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]\n2017-03-16 23:14:36.220  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 23:14:36.233  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 23:14:36.265  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-16 23:14:36.265  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 23:14:36.266  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 23:14:36.635  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 23:14:37.492  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 23:14:37.779  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 23:14:37.791  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 23:14:37.818  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-16 23:14:37.819  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 23:14:37.844  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 3a8b3590-26c7-4a4e-a2af-6c354c52b1be this\n}\n\n2017-03-16 23:14:37.919  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-16 23:14:37.924  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.539 seconds (JVM running for 6.399)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 23:14:33.448  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5rzjg with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 23:14:33.455  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 23:14:33.635  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 23:14:33 GMT 2017]; root of context hierarchy
    2017-03-16 23:14:35.433  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 23:14:35.460  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 23:14:36.103  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 23:14:36.220  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]
    2017-03-16 23:14:36.220  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 23:14:36.233  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 23:14:36.265  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
    2017-03-16 23:14:36.265  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 23:14:36.266  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 23:14:36.635  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 23:14:37.492  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 23:14:37.779  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 23:14:37.791  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 23:14:37.818  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
    2017-03-16 23:14:37.819  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 23:14:37.844  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.6]:5701 - 3a8b3590-26c7-4a4e-a2af-6c354c52b1be this
    }
    
    2017-03-16 23:14:37.919  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
    2017-03-16 23:14:37.924  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.539 seconds (JVM running for 6.399)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4212dd2b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.17\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.17\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.17\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.17\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9z7mj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  23:41:20 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  23:41:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.17; broadcast_rpc_address=10.180.2.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9z7mj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  23:41:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  23:41:21 Global memtable on-heap threshold is enabled at 128MB\nINFO  23:41:21 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 23:41:21 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.17
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.17
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.17
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.17
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9z7mj
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  23:41:20 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  23:41:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.17; broadcast_rpc_address=10.180.2.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9z7mj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  23:41:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  23:41:21 Global memtable on-heap threshold is enabled at 128MB
    INFO  23:41:21 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 23:41:21 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4218/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420ce4bb0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 00:27:19.880  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-2vmqc with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-17 00:27:19.904  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 00:27:20.062  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 00:27:20 GMT 2017]; root of context hierarchy\n2017-03-17 00:27:21.883  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 00:27:21.903  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 00:27:22.518  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 00:27:22.643  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.17]\n2017-03-17 00:27:22.643  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 00:27:22.656  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 00:27:22.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.17]:5701\n2017-03-17 00:27:22.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 00:27:22.690  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 00:27:23.031  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 00:27:23.994  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 00:27:24.318  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 00:27:24.322  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 00:27:24.330  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTING\n2017-03-17 00:27:24.335  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 00:27:24.384  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.17]:5701 - 83bd78a7-8497-417d-b039-3f592c265323 this\n}\n\n2017-03-17 00:27:24.464  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTED\n2017-03-17 00:27:24.469  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.547 seconds (JVM running for 6.564)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 00:27:19.880  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-2vmqc with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-17 00:27:19.904  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 00:27:20.062  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 00:27:20 GMT 2017]; root of context hierarchy
    2017-03-17 00:27:21.883  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 00:27:21.903  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 00:27:22.518  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 00:27:22.643  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.17]
    2017-03-17 00:27:22.643  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 00:27:22.656  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 00:27:22.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.17]:5701
    2017-03-17 00:27:22.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 00:27:22.690  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 00:27:23.031  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 00:27:23.994  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 00:27:24.318  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 00:27:24.322  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 00:27:24.330  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTING
    2017-03-17 00:27:24.335  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 00:27:24.384  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.17]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.3.17]:5701 - 83bd78a7-8497-417d-b039-3f592c265323 this
    }
    
    2017-03-17 00:27:24.464  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTED
    2017-03-17 00:27:24.469  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.547 seconds (JVM running for 6.564)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420773b50>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.20\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.20\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.20\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.20\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-5fsgt\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  00:44:59 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  00:44:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.20; broadcast_rpc_address=10.180.3.20; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.20; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5fsgt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  00:44:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  00:45:00 Global memtable on-heap threshold is enabled at 128MB\nINFO  00:45:00 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 00:45:00 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.20
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.20
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.20
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.20
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-5fsgt
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  00:44:59 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  00:44:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.20; broadcast_rpc_address=10.180.3.20; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.20; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5fsgt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  00:44:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  00:45:00 Global memtable on-heap threshold is enabled at 128MB
    INFO  00:45:00 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 00:45:00 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tk5rc] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ea3980 exit status 1 <nil> <nil> true [0xc420498540 0xc420498570 0xc420498598] [0xc420498540 0xc420498570 0xc420498598] [0xc420498560 0xc420498588] [0xc35e70 0xc35e70] 0xc4212cfc80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tk5rc] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ea3980 exit status 1 <nil> <nil> true [0xc420498540 0xc420498570 0xc420498598] [0xc420498540 0xc420498570 0xc420498598] [0xc420498560 0xc420498588] [0xc35e70 0xc35e70] 0xc4212cfc80 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4219/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421c8a7a0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 01:25:20.064  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bj59v with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-17 01:25:20.072  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 01:25:20.187  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 01:25:20 GMT 2017]; root of context hierarchy\n2017-03-17 01:25:22.035  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 01:25:22.062  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 01:25:22.809  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 01:25:22.941  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-17 01:25:22.942  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 01:25:22.954  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 01:25:22.987  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-17 01:25:22.988  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 01:25:22.988  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 01:25:23.384  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 01:25:24.324  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 01:25:24.621  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 01:25:24.632  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 01:25:24.645  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-17 01:25:24.649  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 01:25:24.673  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - dd912a5f-8195-4137-a8e0-4b434267ab41 this\n}\n\n2017-03-17 01:25:24.779  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-17 01:25:24.782  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.824 seconds (JVM running for 6.751)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 01:25:20.064  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bj59v with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-17 01:25:20.072  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 01:25:20.187  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 01:25:20 GMT 2017]; root of context hierarchy
    2017-03-17 01:25:22.035  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 01:25:22.062  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 01:25:22.809  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 01:25:22.941  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
    2017-03-17 01:25:22.942  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 01:25:22.954  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 01:25:22.987  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
    2017-03-17 01:25:22.988  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 01:25:22.988  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 01:25:23.384  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 01:25:24.324  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 01:25:24.621  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 01:25:24.632  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 01:25:24.645  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
    2017-03-17 01:25:24.649  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 01:25:24.673  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] 
    
    
    Members [1] {
    	Member [10.180.1.16]:5701 - dd912a5f-8195-4137-a8e0-4b434267ab41 this
    }
    
    2017-03-17 01:25:24.779  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
    2017-03-17 01:25:24.782  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.824 seconds (JVM running for 6.751)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421cee8b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.17\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.17\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.17\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.17\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0j7h5\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:40:28 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:40:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.17; broadcast_rpc_address=10.180.1.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0j7h5}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:40:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:40:28 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:40:28 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:40:28 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.17
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.17
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.17
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.17
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0j7h5
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  01:40:28 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:40:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.17; broadcast_rpc_address=10.180.1.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0j7h5}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:40:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:40:28 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:40:28 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:40:28 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.63.79 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gc9kl] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42127a480 exit status 1 <nil> <nil> true [0xc4204901b0 0xc4204901c8 0xc4204901e8] [0xc4204901b0 0xc4204901c8 0xc4204901e8] [0xc4204901c0 0xc4204901d8] [0xc35e70 0xc35e70] 0xc4212bac00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.63.79 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gc9kl] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42127a480 exit status 1 <nil> <nil> true [0xc4204901b0 0xc4204901c8 0xc4204901e8] [0xc4204901b0 0xc4204901c8 0xc4204901e8] [0xc4204901c0 0xc4204901d8] [0xc35e70 0xc35e70] 0xc4212bac00 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

@ethernetdan
Copy link
Contributor

Fixes are in the works (#43243) but I don't think we should block for this job.

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5490/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc421114590>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xqqx0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42101d440 exit status 1 <nil> <nil> true [0xc4202e8e08 0xc4202e8e20 0xc4202e8e38] [0xc4202e8e08 0xc4202e8e20 0xc4202e8e38] [0xc4202e8e18 0xc4202e8e30] [0x182d7e0 0x182d7e0] 0xc4202d0cc0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xqqx0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42101d440 exit status 1 <nil> <nil> true [0xc4202e8e08 0xc4202e8e20 0xc4202e8e38] [0xc4202e8e08 0xc4202e8e20 0xc4202e8e38] [0xc4202e8e18 0xc4202e8e30] [0x182d7e0 0x182d7e0] 0xc4202d0cc0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420d5a9f0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-03 18:44:12.593  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-29xzt with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-03 18:44:12.598  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-03 18:44:12.657  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 18:44:12 GMT 2017]; root of context hierarchy\n2017-05-03 18:44:14.104  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-03 18:44:14.120  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-03 18:44:14.708  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-03 18:44:14.835  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.14]\n2017-05-03 18:44:14.835  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-03 18:44:14.846  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-03 18:44:14.877  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.14]:5701\n2017-05-03 18:44:14.877  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-03 18:44:14.877  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-03 18:44:15.256  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.14]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-03 18:44:16.267  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-03 18:44:16.518  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.14]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-03 18:44:16.525  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-03 18:44:16.543  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.14]:5701 [someGroup] [3.8] [10.100.2.14]:5701 is STARTING\n2017-05-03 18:44:16.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.14]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-03 18:44:16.570  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.14]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.14]:5701 - ed174398-364b-4a51-acac-fbdb68564c03 this\n}\n\n2017-05-03 18:44:16.628  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.14]:5701 [someGroup] [3.8] [10.100.2.14]:5701 is STARTED\n2017-05-03 18:44:16.631  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.842 seconds (JVM running for 5.595)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-03 18:44:12.593  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-29xzt with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-03 18:44:12.598  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-03 18:44:12.657  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 18:44:12 GMT 2017]; root of context hierarchy
    2017-05-03 18:44:14.104  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-03 18:44:14.120  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-03 18:44:14.708  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-03 18:44:14.835  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.14]
    2017-05-03 18:44:14.835  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-03 18:44:14.846  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-03 18:44:14.877  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.14]:5701
    2017-05-03 18:44:14.877  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-03 18:44:14.877  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-03 18:44:15.256  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.14]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-03 18:44:16.267  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-03 18:44:16.518  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.14]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-03 18:44:16.525  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-03 18:44:16.543  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.14]:5701 [someGroup] [3.8] [10.100.2.14]:5701 is STARTING
    2017-05-03 18:44:16.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.14]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-03 18:44:16.570  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.14]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.14]:5701 - ed174398-364b-4a51-acac-fbdb68564c03 this
    }
    
    2017-05-03 18:44:16.628  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.14]:5701 [someGroup] [3.8] [10.100.2.14]:5701 is STARTED
    2017-05-03 18:44:16.631  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.842 seconds (JVM running for 5.595)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4211c82d0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-f1186\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:59:11 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:59:12 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.10; broadcast_rpc_address=10.100.3.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-f1186}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:59:12 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:59:12 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:59:12 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:59:12 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-f1186
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  18:59:11 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:59:12 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.10; broadcast_rpc_address=10.100.3.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-f1186}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:59:12 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:59:12 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:59:12 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:59:12 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5491/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4212c44e0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420fe6200>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-8bjc0\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  19:48:51 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  19:48:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.15; broadcast_rpc_address=10.100.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-8bjc0}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  19:48:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  19:48:52 Global memtable on-heap threshold is enabled at 128MB\nINFO  19:48:52 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 19:48:52 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-8bjc0
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  19:48:51 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  19:48:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.15; broadcast_rpc_address=10.100.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-8bjc0}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  19:48:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  19:48:52 Global memtable on-heap threshold is enabled at 128MB
    INFO  19:48:52 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 19:48:52 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc42001b0c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-03 19:56:48.484  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-fmflw with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-03 19:56:48.517  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-03 19:56:48.603  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 19:56:48 GMT 2017]; root of context hierarchy\n2017-05-03 19:56:50.200  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-03 19:56:50.222  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-03 19:56:50.921  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-03 19:56:51.044  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.14]\n2017-05-03 19:56:51.044  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-03 19:56:51.054  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-03 19:56:51.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.14]:5701\n2017-05-03 19:56:51.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-03 19:56:51.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-03 19:56:51.476  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.14]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-03 19:56:52.416  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-03 19:56:52.672  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.14]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-03 19:56:52.681  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-03 19:56:52.719  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.14]:5701 [someGroup] [3.8] [10.100.1.14]:5701 is STARTING\n2017-05-03 19:56:52.778  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.14]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-03 19:56:52.779  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.14]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.14]:5701 - a675f415-09ed-4668-97ec-1c2c35d4d8b8 this\n}\n\n2017-05-03 19:56:52.852  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.14]:5701 [someGroup] [3.8] [10.100.1.14]:5701 is STARTED\n2017-05-03 19:56:52.856  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.401 seconds (JVM running for 6.142)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-03 19:56:48.484  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-fmflw with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-03 19:56:48.517  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-03 19:56:48.603  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 19:56:48 GMT 2017]; root of context hierarchy
    2017-05-03 19:56:50.200  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-03 19:56:50.222  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-03 19:56:50.921  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-03 19:56:51.044  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.14]
    2017-05-03 19:56:51.044  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-03 19:56:51.054  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-03 19:56:51.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.14]:5701
    2017-05-03 19:56:51.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-03 19:56:51.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-03 19:56:51.476  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.14]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-03 19:56:52.416  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-03 19:56:52.672  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.14]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-03 19:56:52.681  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-03 19:56:52.719  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.14]:5701 [someGroup] [3.8] [10.100.1.14]:5701 is STARTING
    2017-05-03 19:56:52.778  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.14]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-03 19:56:52.779  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.14]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.14]:5701 - a675f415-09ed-4668-97ec-1c2c35d4d8b8 this
    }
    
    2017-05-03 19:56:52.852  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.14]:5701 [someGroup] [3.8] [10.100.1.14]:5701 is STARTED
    2017-05-03 19:56:52.856  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.401 seconds (JVM running for 6.142)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.37.40 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-fq140] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421349f20 exit status 1 <nil> <nil> true [0xc42000e680 0xc42000e6b8 0xc42000e6d8] [0xc42000e680 0xc42000e6b8 0xc42000e6d8] [0xc42000e6a0 0xc42000e6d0] [0x182d7e0 0x182d7e0] 0xc4213aea20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.37.40 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-fq140] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421349f20 exit status 1 <nil> <nil> true [0xc42000e680 0xc42000e6b8 0xc42000e6d8] [0xc42000e680 0xc42000e6b8 0xc42000e6d8] [0xc42000e6a0 0xc42000e6d0] [0x182d7e0 0x182d7e0] 0xc4213aea20 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5492/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42044c310>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-dqrdx\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  20:32:10 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  20:32:11 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.7; broadcast_rpc_address=10.100.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dqrdx}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  20:32:11 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  20:32:11 Global memtable on-heap threshold is enabled at 128MB\nINFO  20:32:11 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:32:11 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-dqrdx
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  20:32:10 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  20:32:11 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.7; broadcast_rpc_address=10.100.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dqrdx}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  20:32:11 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  20:32:11 Global memtable on-heap threshold is enabled at 128MB
    INFO  20:32:11 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 20:32:11 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4203e2ad0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-03 20:37:02.873  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bmsz5 with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-03 20:37:02.901  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-03 20:37:03.107  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 20:37:03 GMT 2017]; root of context hierarchy\n2017-05-03 20:37:04.508  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-03 20:37:04.530  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-03 20:37:05.301  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-03 20:37:05.416  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.11]\n2017-05-03 20:37:05.416  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-03 20:37:05.427  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-03 20:37:05.459  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.11]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.11]:5701\n2017-05-03 20:37:05.459  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.11]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-03 20:37:05.460  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.11]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-03 20:37:05.931  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.11]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-03 20:37:06.840  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.11]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-03 20:37:07.082  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.11]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-03 20:37:07.095  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.11]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-03 20:37:07.105  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.11]:5701 [someGroup] [3.8] [10.100.1.11]:5701 is STARTING\n2017-05-03 20:37:07.151  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.11]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-03 20:37:07.152  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.11]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.11]:5701 - 429fa9ae-d776-4535-b996-eb683ef7772f this\n}\n\n2017-05-03 20:37:07.219  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.11]:5701 [someGroup] [3.8] [10.100.1.11]:5701 is STARTED\n2017-05-03 20:37:07.222  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.262 seconds (JVM running for 5.969)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-03 20:37:02.873  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bmsz5 with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-03 20:37:02.901  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-03 20:37:03.107  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 20:37:03 GMT 2017]; root of context hierarchy
    2017-05-03 20:37:04.508  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-03 20:37:04.530  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-03 20:37:05.301  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-03 20:37:05.416  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.11]
    2017-05-03 20:37:05.416  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-03 20:37:05.427  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-03 20:37:05.459  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.11]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.11]:5701
    2017-05-03 20:37:05.459  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.11]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-03 20:37:05.460  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.11]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-03 20:37:05.931  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.11]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-03 20:37:06.840  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.11]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-03 20:37:07.082  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.11]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-03 20:37:07.095  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.11]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-03 20:37:07.105  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.11]:5701 [someGroup] [3.8] [10.100.1.11]:5701 is STARTING
    2017-05-03 20:37:07.151  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.11]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-03 20:37:07.152  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.11]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.11]:5701 - 429fa9ae-d776-4535-b996-eb683ef7772f this
    }
    
    2017-05-03 20:37:07.219  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.11]:5701 [someGroup] [3.8] [10.100.1.11]:5701 is STARTED
    2017-05-03 20:37:07.222  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.262 seconds (JVM running for 5.969)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420eec9d0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7pc24] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4215e8090 exit status 1 <nil> <nil> true [0xc4204bea58 0xc4204bea78 0xc4204beab0] [0xc4204bea58 0xc4204bea78 0xc4204beab0] [0xc4204bea68 0xc4204beaa8] [0x182d7e0 0x182d7e0] 0xc420833e00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7pc24] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4215e8090 exit status 1 <nil> <nil> true [0xc4204bea58 0xc4204bea78 0xc4204beab0] [0xc4204bea58 0xc4204bea78 0xc4204beab0] [0xc4204bea68 0xc4204beaa8] [0x182d7e0 0x182d7e0] 0xc420833e00 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5493/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc421d424d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-03 21:46:26.124  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-z2k9q with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-03 21:46:26.135  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-03 21:46:26.232  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 21:46:26 GMT 2017]; root of context hierarchy\n2017-05-03 21:46:27.528  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-03 21:46:27.552  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-03 21:46:28.297  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-03 21:46:28.418  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.26]\n2017-05-03 21:46:28.418  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-03 21:46:28.429  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.26]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-03 21:46:28.460  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.26]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.26]:5701\n2017-05-03 21:46:28.460  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.26]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-03 21:46:28.460  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.26]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-03 21:46:28.889  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.26]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-03 21:46:29.766  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.1.26]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-03 21:46:30.009  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.26]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-03 21:46:30.015  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.26]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-03 21:46:30.037  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.26]:5701 [someGroup] [3.8] [10.100.1.26]:5701 is STARTING\n2017-05-03 21:46:30.087  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.26]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-03 21:46:30.088  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.26]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.26]:5701 - b92df4e0-8072-49e5-93ac-9a572f0207f1 this\n}\n\n2017-05-03 21:46:30.146  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.26]:5701 [someGroup] [3.8] [10.100.1.26]:5701 is STARTED\n2017-05-03 21:46:30.149  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.887 seconds (JVM running for 5.631)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-03 21:46:26.124  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-z2k9q with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-03 21:46:26.135  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-03 21:46:26.232  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 21:46:26 GMT 2017]; root of context hierarchy
    2017-05-03 21:46:27.528  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-03 21:46:27.552  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-03 21:46:28.297  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-03 21:46:28.418  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.26]
    2017-05-03 21:46:28.418  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-03 21:46:28.429  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.26]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-03 21:46:28.460  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.26]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.26]:5701
    2017-05-03 21:46:28.460  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.26]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-03 21:46:28.460  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.26]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-03 21:46:28.889  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.26]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-03 21:46:29.766  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.1.26]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-03 21:46:30.009  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.26]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-03 21:46:30.015  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.26]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-03 21:46:30.037  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.26]:5701 [someGroup] [3.8] [10.100.1.26]:5701 is STARTING
    2017-05-03 21:46:30.087  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.26]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-03 21:46:30.088  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.26]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.26]:5701 - b92df4e0-8072-49e5-93ac-9a572f0207f1 this
    }
    
    2017-05-03 21:46:30.146  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.26]:5701 [someGroup] [3.8] [10.100.1.26]:5701 is STARTED
    2017-05-03 21:46:30.149  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.887 seconds (JVM running for 5.631)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421010730>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0fp3f\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  21:30:01 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  21:30:01 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.13; broadcast_rpc_address=10.100.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0fp3f}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  21:30:01 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  21:30:01 Global memtable on-heap threshold is enabled at 128MB\nINFO  21:30:01 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:30:01 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0fp3f
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  21:30:01 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  21:30:01 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.13; broadcast_rpc_address=10.100.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0fp3f}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  21:30:01 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  21:30:01 Global memtable on-heap threshold is enabled at 128MB
    INFO  21:30:01 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 21:30:01 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4211551a0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.239.11 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zjvrb] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4213c5500 exit status 1 <nil> <nil> true [0xc42043acd8 0xc42043ad10 0xc42043ad30] [0xc42043acd8 0xc42043ad10 0xc42043ad30] [0xc42043ad00 0xc42043ad28] [0x182d7e0 0x182d7e0] 0xc4213b6900 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.239.11 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zjvrb] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4213c5500 exit status 1 <nil> <nil> true [0xc42043acd8 0xc42043ad10 0xc42043ad30] [0xc42043acd8 0xc42043ad10 0xc42043ad30] [0xc42043ad00 0xc42043ad28] [0x182d7e0 0x182d7e0] 0xc4213b6900 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5494/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.134.71 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l9zw7] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420be6de0 exit status 1 <nil> <nil> true [0xc42000e498 0xc42000e4b0 0xc42000e4c8] [0xc42000e498 0xc42000e4b0 0xc42000e4c8] [0xc42000e4a8 0xc42000e4c0] [0x182d7e0 0x182d7e0] 0xc420be3e00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.134.71 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l9zw7] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420be6de0 exit status 1 <nil> <nil> true [0xc42000e498 0xc42000e4b0 0xc42000e4c8] [0xc42000e498 0xc42000e4b0 0xc42000e4c8] [0xc42000e4a8 0xc42000e4c0] [0x182d7e0 0x182d7e0] 0xc420be3e00 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420bf4960>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420f59360>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-03 22:27:43.715  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-6zq6j with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-03 22:27:43.742  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-03 22:27:43.860  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 22:27:43 GMT 2017]; root of context hierarchy\n2017-05-03 22:27:45.715  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-03 22:27:45.748  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-03 22:27:46.509  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-03 22:27:46.671  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.9]\n2017-05-03 22:27:46.672  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-03 22:27:46.685  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-03 22:27:46.728  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.9]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.9]:5701\n2017-05-03 22:27:46.729  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.9]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-03 22:27:46.729  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.9]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-03 22:27:47.302  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.9]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-03 22:27:48.363  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.9]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-03 22:27:48.643  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.9]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-03 22:27:48.650  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.9]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-03 22:27:48.661  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.9]:5701 [someGroup] [3.8] [10.100.2.9]:5701 is STARTING\n2017-05-03 22:27:48.706  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.9]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-03 22:27:48.707  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.9]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.9]:5701 - 972f4442-5c15-4f06-86ec-0f9193c375f8 this\n}\n\n2017-05-03 22:27:48.784  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.9]:5701 [someGroup] [3.8] [10.100.2.9]:5701 is STARTED\n2017-05-03 22:27:48.794  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.237 seconds (JVM running for 7.258)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-03 22:27:43.715  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-6zq6j with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-03 22:27:43.742  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-03 22:27:43.860  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 22:27:43 GMT 2017]; root of context hierarchy
    2017-05-03 22:27:45.715  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-03 22:27:45.748  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-03 22:27:46.509  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-03 22:27:46.671  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.9]
    2017-05-03 22:27:46.672  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-03 22:27:46.685  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-03 22:27:46.728  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.9]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.9]:5701
    2017-05-03 22:27:46.729  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.9]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-03 22:27:46.729  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.9]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-03 22:27:47.302  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.9]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-03 22:27:48.363  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.9]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-03 22:27:48.643  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.9]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-03 22:27:48.650  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.9]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-03 22:27:48.661  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.9]:5701 [someGroup] [3.8] [10.100.2.9]:5701 is STARTING
    2017-05-03 22:27:48.706  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.9]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-03 22:27:48.707  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.9]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.9]:5701 - 972f4442-5c15-4f06-86ec-0f9193c375f8 this
    }
    
    2017-05-03 22:27:48.784  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.9]:5701 [someGroup] [3.8] [10.100.2.9]:5701 is STARTED
    2017-05-03 22:27:48.794  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.237 seconds (JVM running for 7.258)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42084c0a0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-m5psz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  22:43:23 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  22:43:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.12; broadcast_rpc_address=10.100.2.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-m5psz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  22:43:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  22:43:24 Global memtable on-heap threshold is enabled at 128MB\nINFO  22:43:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 22:43:24 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-m5psz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  22:43:23 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  22:43:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.12; broadcast_rpc_address=10.100.2.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-m5psz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  22:43:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  22:43:24 Global memtable on-heap threshold is enabled at 128MB
    INFO  22:43:24 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 22:43:24 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5495/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.150.185 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7s6tg] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e02ff0 exit status 1 <nil> <nil> true [0xc420140560 0xc4201405c8 0xc4201405f8] [0xc420140560 0xc4201405c8 0xc4201405f8] [0xc4201405b0 0xc4201405e8] [0x182d7e0 0x182d7e0] 0xc420f4ff80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.150.185 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7s6tg] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e02ff0 exit status 1 <nil> <nil> true [0xc420140560 0xc4201405c8 0xc4201405f8] [0xc420140560 0xc4201405c8 0xc4201405f8] [0xc4201405b0 0xc4201405e8] [0x182d7e0 0x182d7e0] 0xc420f4ff80 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421920380>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9f1dh\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  23:28:57 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  23:28:57 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.6; broadcast_rpc_address=10.100.2.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9f1dh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  23:28:57 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  23:28:57 Global memtable on-heap threshold is enabled at 128MB\nINFO  23:28:57 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 23:28:57 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9f1dh
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  23:28:57 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  23:28:57 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.6; broadcast_rpc_address=10.100.2.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9f1dh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  23:28:57 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  23:28:57 Global memtable on-heap threshold is enabled at 128MB
    INFO  23:28:57 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 23:28:57 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42190e520>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc42040d030>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-03 23:13:42.104  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-8rj8t with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-03 23:13:42.111  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-03 23:13:42.226  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 23:13:42 GMT 2017]; root of context hierarchy\n2017-05-03 23:13:43.837  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-03 23:13:43.858  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-03 23:13:44.583  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-03 23:13:44.726  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.5]\n2017-05-03 23:13:44.727  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-03 23:13:44.740  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-03 23:13:44.775  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.5]:5701\n2017-05-03 23:13:44.776  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-03 23:13:44.776  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-03 23:13:45.248  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.5]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-03 23:13:46.263  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-03 23:13:46.531  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-03 23:13:46.537  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-03 23:13:46.552  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTING\n2017-05-03 23:13:46.590  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-03 23:13:46.591  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.5]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.5]:5701 - cb7f813d-9b41-4695-8949-1f6e85a7d5fe this\n}\n\n2017-05-03 23:13:46.663  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTED\n2017-05-03 23:13:46.683  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.509 seconds (JVM running for 6.38)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-03 23:13:42.104  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-8rj8t with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-03 23:13:42.111  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-03 23:13:42.226  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Wed May 03 23:13:42 GMT 2017]; root of context hierarchy
    2017-05-03 23:13:43.837  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-03 23:13:43.858  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-03 23:13:44.583  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-03 23:13:44.726  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.5]
    2017-05-03 23:13:44.727  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-03 23:13:44.740  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-03 23:13:44.775  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.5]:5701
    2017-05-03 23:13:44.776  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-03 23:13:44.776  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-03 23:13:45.248  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.5]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-03 23:13:46.263  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-03 23:13:46.531  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-03 23:13:46.537  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-03 23:13:46.552  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTING
    2017-05-03 23:13:46.590  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-03 23:13:46.591  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.5]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.5]:5701 - cb7f813d-9b41-4695-8949-1f6e85a7d5fe this
    }
    
    2017-05-03 23:13:46.663  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTED
    2017-05-03 23:13:46.683  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.509 seconds (JVM running for 6.38)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5496/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420ef80d0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9w0kg\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  00:43:54 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  00:43:54 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.18; broadcast_rpc_address=10.100.2.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9w0kg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  00:43:54 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  00:43:54 Global memtable on-heap threshold is enabled at 128MB\nINFO  00:43:54 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 00:43:54 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.18
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.18
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.18
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.18
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9w0kg
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  00:43:54 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  00:43:54 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.18; broadcast_rpc_address=10.100.2.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9w0kg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  00:43:54 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  00:43:54 Global memtable on-heap threshold is enabled at 128MB
    INFO  00:43:54 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 00:43:54 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420481a50>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 00:13:21.380  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-8rdwq with PID 7 (/bootstrapper.jar started by root in /)\n2017-05-04 00:13:21.387  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 00:13:21.495  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 00:13:21 GMT 2017]; root of context hierarchy\n2017-05-04 00:13:22.922  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 00:13:22.947  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 00:13:23.613  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 00:13:23.732  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.8]\n2017-05-04 00:13:23.732  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 00:13:23.744  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 00:13:23.785  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.8]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.8]:5701\n2017-05-04 00:13:23.786  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.8]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 00:13:23.786  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.8]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 00:13:24.215  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.8]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 00:13:25.264  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.2.8]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 00:13:25.543  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.8]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 00:13:25.549  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.8]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 00:13:25.578  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.8]:5701 [someGroup] [3.8] [10.100.2.8]:5701 is STARTING\n2017-05-04 00:13:25.610  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.8]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 00:13:25.613  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.8]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.8]:5701 - f6a30b6a-fd52-4285-b6f2-4065ee71e4fc this\n}\n\n2017-05-04 00:13:25.707  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.8]:5701 [someGroup] [3.8] [10.100.2.8]:5701 is STARTED\n2017-05-04 00:13:25.713  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.309 seconds (JVM running for 6.416)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 00:13:21.380  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-8rdwq with PID 7 (/bootstrapper.jar started by root in /)
    2017-05-04 00:13:21.387  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 00:13:21.495  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 00:13:21 GMT 2017]; root of context hierarchy
    2017-05-04 00:13:22.922  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 00:13:22.947  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 00:13:23.613  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 00:13:23.732  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.8]
    2017-05-04 00:13:23.732  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 00:13:23.744  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 00:13:23.785  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.8]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.8]:5701
    2017-05-04 00:13:23.786  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.8]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 00:13:23.786  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.8]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 00:13:24.215  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.8]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 00:13:25.264  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.2.8]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 00:13:25.543  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.8]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 00:13:25.549  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.8]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 00:13:25.578  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.8]:5701 [someGroup] [3.8] [10.100.2.8]:5701 is STARTING
    2017-05-04 00:13:25.610  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.8]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 00:13:25.613  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.8]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.8]:5701 - f6a30b6a-fd52-4285-b6f2-4065ee71e4fc this
    }
    
    2017-05-04 00:13:25.707  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.8]:5701 [someGroup] [3.8] [10.100.2.8]:5701 is STARTED
    2017-05-04 00:13:25.713  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.309 seconds (JVM running for 6.416)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.134.71 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-fp5mq] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4218e28d0 exit status 1 <nil> <nil> true [0xc4200964f0 0xc420096560 0xc4200965b0] [0xc4200964f0 0xc420096560 0xc4200965b0] [0xc420096558 0xc420096580] [0x182d7e0 0x182d7e0] 0xc420de4a20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.134.71 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-fp5mq] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4218e28d0 exit status 1 <nil> <nil> true [0xc4200964f0 0xc420096560 0xc4200965b0] [0xc4200964f0 0xc420096560 0xc4200965b0] [0xc420096558 0xc420096580] [0x182d7e0 0x182d7e0] 0xc420de4a20 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42035f1d0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5497/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4203dd8d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 01:16:21.917  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bwdxs with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 01:16:21.948  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 01:16:22.077  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 01:16:22 GMT 2017]; root of context hierarchy\n2017-05-04 01:16:23.670  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 01:16:23.698  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 01:16:24.534  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 01:16:24.673  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.12]\n2017-05-04 01:16:24.675  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 01:16:24.688  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 01:16:24.728  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.12]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.12]:5701\n2017-05-04 01:16:24.728  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.12]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 01:16:24.729  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.12]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 01:16:25.306  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.12]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 01:16:26.294  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.12]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 01:16:26.584  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.12]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 01:16:26.590  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.12]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 01:16:26.624  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.12]:5701 [someGroup] [3.8] [10.100.3.12]:5701 is STARTING\n2017-05-04 01:16:26.664  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.12]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 01:16:26.665  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.12]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.12]:5701 - c457cf92-68c8-4347-a387-69bd624e9b0d this\n}\n\n2017-05-04 01:16:26.737  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.12]:5701 [someGroup] [3.8] [10.100.3.12]:5701 is STARTED\n2017-05-04 01:16:26.739  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.903 seconds (JVM running for 6.861)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 01:16:21.917  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bwdxs with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 01:16:21.948  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 01:16:22.077  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 01:16:22 GMT 2017]; root of context hierarchy
    2017-05-04 01:16:23.670  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 01:16:23.698  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 01:16:24.534  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 01:16:24.673  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.12]
    2017-05-04 01:16:24.675  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 01:16:24.688  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 01:16:24.728  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.12]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.12]:5701
    2017-05-04 01:16:24.728  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.12]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 01:16:24.729  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.12]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 01:16:25.306  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.12]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 01:16:26.294  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.12]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 01:16:26.584  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.12]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 01:16:26.590  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.12]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 01:16:26.624  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.12]:5701 [someGroup] [3.8] [10.100.3.12]:5701 is STARTING
    2017-05-04 01:16:26.664  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.12]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 01:16:26.665  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.12]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.12]:5701 - c457cf92-68c8-4347-a387-69bd624e9b0d this
    }
    
    2017-05-04 01:16:26.737  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.12]:5701 [someGroup] [3.8] [10.100.3.12]:5701 is STARTED
    2017-05-04 01:16:26.739  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.903 seconds (JVM running for 6.861)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4211b6d60>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-fgl43\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:33:52 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:33:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.12; broadcast_rpc_address=10.100.2.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fgl43}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:33:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:33:53 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:33:53 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:33:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-fgl43
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  01:33:52 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:33:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.12; broadcast_rpc_address=10.100.2.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fgl43}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:33:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:33:53 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:33:53 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:33:53 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4201593d0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.243.196 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-lt51d] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421315590 exit status 1 <nil> <nil> true [0xc420446998 0xc4204469b0 0xc4204469c8] [0xc420446998 0xc4204469b0 0xc4204469c8] [0xc4204469a8 0xc4204469c0] [0x182d7e0 0x182d7e0] 0xc4212e7860 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.243.196 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-lt51d] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421315590 exit status 1 <nil> <nil> true [0xc420446998 0xc4204469b0 0xc4204469c8] [0xc420446998 0xc4204469b0 0xc4204469c8] [0xc4204469a8 0xc4204469c0] [0x182d7e0 0x182d7e0] 0xc4212e7860 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5498/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4201466b0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc42001aa90>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 02:16:47.386  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-l28p0 with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 02:16:47.405  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 02:16:47.521  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 02:16:47 GMT 2017]; root of context hierarchy\n2017-05-04 02:16:49.102  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 02:16:49.128  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 02:16:49.882  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 02:16:50.008  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.13]\n2017-05-04 02:16:50.009  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 02:16:50.022  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 02:16:50.056  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.13]:5701\n2017-05-04 02:16:50.057  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 02:16:50.057  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 02:16:50.529  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.13]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 02:16:51.512  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 02:16:51.812  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.13]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 02:16:51.814  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 02:16:51.834  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.13]:5701 [someGroup] [3.8] [10.100.1.13]:5701 is STARTING\n2017-05-04 02:16:51.894  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 02:16:51.895  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.13]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.13]:5701 - 2285303f-1105-484b-a679-3e5da533b2ab this\n}\n\n2017-05-04 02:16:51.991  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.13]:5701 [someGroup] [3.8] [10.100.1.13]:5701 is STARTED\n2017-05-04 02:16:51.995  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.779 seconds (JVM running for 6.701)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 02:16:47.386  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-l28p0 with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 02:16:47.405  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 02:16:47.521  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 02:16:47 GMT 2017]; root of context hierarchy
    2017-05-04 02:16:49.102  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 02:16:49.128  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 02:16:49.882  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 02:16:50.008  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.13]
    2017-05-04 02:16:50.009  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 02:16:50.022  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 02:16:50.056  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.13]:5701
    2017-05-04 02:16:50.057  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 02:16:50.057  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 02:16:50.529  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.13]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 02:16:51.512  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 02:16:51.812  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.13]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 02:16:51.814  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 02:16:51.834  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.13]:5701 [someGroup] [3.8] [10.100.1.13]:5701 is STARTING
    2017-05-04 02:16:51.894  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 02:16:51.895  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.13]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.13]:5701 - 2285303f-1105-484b-a679-3e5da533b2ab this
    }
    
    2017-05-04 02:16:51.991  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.13]:5701 [someGroup] [3.8] [10.100.1.13]:5701 is STARTED
    2017-05-04 02:16:51.995  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.779 seconds (JVM running for 6.701)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.155.166.98 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wmkc6] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4201f23f0 exit status 1 <nil> <nil> true [0xc4204a8650 0xc4204a8668 0xc4204a8680] [0xc4204a8650 0xc4204a8668 0xc4204a8680] [0xc4204a8660 0xc4204a8678] [0x182d7e0 0x182d7e0] 0xc421933a40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.155.166.98 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wmkc6] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4201f23f0 exit status 1 <nil> <nil> true [0xc4204a8650 0xc4204a8668 0xc4204a8680] [0xc4204a8650 0xc4204a8668 0xc4204a8680] [0xc4204a8660 0xc4204a8678] [0x182d7e0 0x182d7e0] 0xc421933a40 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421b4e650>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0zx6h\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  02:37:14 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  02:37:14 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.15; broadcast_rpc_address=10.100.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0zx6h}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  02:37:14 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  02:37:14 Global memtable on-heap threshold is enabled at 128MB\nINFO  02:37:14 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 02:37:14 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0zx6h
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  02:37:14 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  02:37:14 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.15; broadcast_rpc_address=10.100.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0zx6h}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  02:37:14 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  02:37:14 Global memtable on-heap threshold is enabled at 128MB
    INFO  02:37:14 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 02:37:14 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5499/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420fd9170>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420201d60>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-l5v7m\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  03:09:34 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  03:09:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.6; broadcast_rpc_address=10.100.2.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-l5v7m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  03:09:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  03:09:35 Global memtable on-heap threshold is enabled at 128MB\nINFO  03:09:35 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 03:09:35 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-l5v7m
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  03:09:34 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  03:09:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.6; broadcast_rpc_address=10.100.2.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-l5v7m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  03:09:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  03:09:35 Global memtable on-heap threshold is enabled at 128MB
    INFO  03:09:35 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 03:09:35 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4201d6d70>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 03:15:14.332  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-p8z2q with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 03:15:14.346  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 03:15:14.485  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 03:15:14 GMT 2017]; root of context hierarchy\n2017-05-04 03:15:16.404  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 03:15:16.429  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 03:15:17.173  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 03:15:17.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.11]\n2017-05-04 03:15:17.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 03:15:17.323  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 03:15:17.363  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.11]:5701\n2017-05-04 03:15:17.363  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 03:15:17.364  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 03:15:17.898  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.11]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 03:15:18.944  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.11]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 03:15:19.242  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.11]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 03:15:19.249  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.11]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 03:15:19.269  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.11]:5701 [someGroup] [3.8] [10.100.3.11]:5701 is STARTING\n2017-05-04 03:15:19.293  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 03:15:19.295  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.11]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.11]:5701 - ac1b6580-5a8e-4783-8cc2-070cf50197b3 this\n}\n\n2017-05-04 03:15:19.368  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.11]:5701 [someGroup] [3.8] [10.100.3.11]:5701 is STARTED\n2017-05-04 03:15:19.372  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.044 seconds (JVM running for 6.949)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 03:15:14.332  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-p8z2q with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 03:15:14.346  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 03:15:14.485  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 03:15:14 GMT 2017]; root of context hierarchy
    2017-05-04 03:15:16.404  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 03:15:16.429  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 03:15:17.173  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 03:15:17.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.11]
    2017-05-04 03:15:17.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 03:15:17.323  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 03:15:17.363  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.11]:5701
    2017-05-04 03:15:17.363  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 03:15:17.364  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 03:15:17.898  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.11]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 03:15:18.944  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.11]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 03:15:19.242  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.11]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 03:15:19.249  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.11]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 03:15:19.269  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.11]:5701 [someGroup] [3.8] [10.100.3.11]:5701 is STARTING
    2017-05-04 03:15:19.293  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.11]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 03:15:19.295  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.11]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.11]:5701 - ac1b6580-5a8e-4783-8cc2-070cf50197b3 this
    }
    
    2017-05-04 03:15:19.368  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.11]:5701 [someGroup] [3.8] [10.100.3.11]:5701 is STARTED
    2017-05-04 03:15:19.372  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.044 seconds (JVM running for 6.949)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.155.166.98 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0nlf5] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4210bb2f0 exit status 1 <nil> <nil> true [0xc42000e2e0 0xc42000e308 0xc42000e338] [0xc42000e2e0 0xc42000e308 0xc42000e338] [0xc42000e300 0xc42000e330] [0x182d7e0 0x182d7e0] 0xc4210b48a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.155.166.98 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0nlf5] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4210bb2f0 exit status 1 <nil> <nil> true [0xc42000e2e0 0xc42000e308 0xc42000e338] [0xc42000e2e0 0xc42000e308 0xc42000e338] [0xc42000e300 0xc42000e330] [0x182d7e0 0x182d7e0] 0xc4210b48a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5500/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42195a750>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gfnqj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  04:33:01 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  04:33:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.19; broadcast_rpc_address=10.100.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gfnqj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  04:33:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  04:33:02 Global memtable on-heap threshold is enabled at 128MB\nINFO  04:33:02 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 04:33:02 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.19
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.19
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.19
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.19
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-gfnqj
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  04:33:01 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  04:33:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.19; broadcast_rpc_address=10.100.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gfnqj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  04:33:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  04:33:02 Global memtable on-heap threshold is enabled at 128MB
    INFO  04:33:02 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 04:33:02 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.231.223 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vx15t] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421582720 exit status 1 <nil> <nil> true [0xc42000eea0 0xc42000eec0 0xc42000eee0] [0xc42000eea0 0xc42000eec0 0xc42000eee0] [0xc42000eeb0 0xc42000eed8] [0x182d7e0 0x182d7e0] 0xc4212102a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.231.223 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vx15t] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421582720 exit status 1 <nil> <nil> true [0xc42000eea0 0xc42000eec0 0xc42000eee0] [0xc42000eea0 0xc42000eec0 0xc42000eee0] [0xc42000eeb0 0xc42000eed8] [0x182d7e0 0x182d7e0] 0xc4212102a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc42049c640>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 04:10:08.269  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-vxqnv with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 04:10:08.283  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 04:10:08.447  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 04:10:08 GMT 2017]; root of context hierarchy\n2017-05-04 04:10:10.358  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 04:10:10.397  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 04:10:11.268  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 04:10:11.448  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.16]\n2017-05-04 04:10:11.448  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 04:10:11.460  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 04:10:11.500  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.16]:5701\n2017-05-04 04:10:11.500  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 04:10:11.500  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 04:10:12.058  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.16]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 04:10:13.240  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.16]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 04:10:13.534  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.16]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 04:10:13.540  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.16]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 04:10:13.554  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.16]:5701 [someGroup] [3.8] [10.100.3.16]:5701 is STARTING\n2017-05-04 04:10:13.576  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 04:10:13.580  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.16]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.16]:5701 - a8da2380-da01-4ea4-82de-249bdee92d3b this\n}\n\n2017-05-04 04:10:13.656  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.16]:5701 [someGroup] [3.8] [10.100.3.16]:5701 is STARTED\n2017-05-04 04:10:13.668  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.675 seconds (JVM running for 7.561)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 04:10:08.269  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-vxqnv with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 04:10:08.283  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 04:10:08.447  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 04:10:08 GMT 2017]; root of context hierarchy
    2017-05-04 04:10:10.358  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 04:10:10.397  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 04:10:11.268  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 04:10:11.448  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.16]
    2017-05-04 04:10:11.448  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 04:10:11.460  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 04:10:11.500  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.16]:5701
    2017-05-04 04:10:11.500  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 04:10:11.500  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 04:10:12.058  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.16]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 04:10:13.240  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.16]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 04:10:13.534  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.16]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 04:10:13.540  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.16]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 04:10:13.554  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.16]:5701 [someGroup] [3.8] [10.100.3.16]:5701 is STARTING
    2017-05-04 04:10:13.576  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.16]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 04:10:13.580  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.16]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.16]:5701 - a8da2380-da01-4ea4-82de-249bdee92d3b this
    }
    
    2017-05-04 04:10:13.656  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.16]:5701 [someGroup] [3.8] [10.100.3.16]:5701 is STARTED
    2017-05-04 04:10:13.668  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.675 seconds (JVM running for 7.561)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420fa26a0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5501/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.231.223 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7b5s5] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f518f0 exit status 1 <nil> <nil> true [0xc42014c768 0xc42014c780 0xc42014c798] [0xc42014c768 0xc42014c780 0xc42014c798] [0xc42014c778 0xc42014c790] [0x182d7e0 0x182d7e0] 0xc42110cf00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.231.223 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7b5s5] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f518f0 exit status 1 <nil> <nil> true [0xc42014c768 0xc42014c780 0xc42014c798] [0xc42014c768 0xc42014c780 0xc42014c798] [0xc42014c778 0xc42014c790] [0x182d7e0 0x182d7e0] 0xc42110cf00 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420c26440>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-260fw\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:02:24 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:02:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.8; broadcast_rpc_address=10.100.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-260fw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:02:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:02:24 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:02:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:02:24 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-260fw
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  05:02:24 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:02:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.8; broadcast_rpc_address=10.100.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-260fw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:02:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:02:24 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:02:24 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:02:24 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4203bc3c0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc421365f80>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 05:12:37.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-k97cg with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 05:12:37.539  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 05:12:37.660  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 05:12:37 GMT 2017]; root of context hierarchy\n2017-05-04 05:12:39.459  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 05:12:39.480  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 05:12:40.163  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 05:12:40.296  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.12]\n2017-05-04 05:12:40.297  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 05:12:40.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 05:12:40.346  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.12]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.12]:5701\n2017-05-04 05:12:40.347  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.12]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 05:12:40.347  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.12]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 05:12:40.827  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.12]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 05:12:41.851  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.12]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 05:12:42.134  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.12]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 05:12:42.140  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.12]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 05:12:42.153  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.12]:5701 [someGroup] [3.8] [10.100.1.12]:5701 is STARTING\n2017-05-04 05:12:42.178  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.12]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 05:12:42.181  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.12]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.12]:5701 - 892c7f89-3b62-45e7-9e53-e21d770d3ab2 this\n}\n\n2017-05-04 05:12:42.255  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.12]:5701 [someGroup] [3.8] [10.100.1.12]:5701 is STARTED\n2017-05-04 05:12:42.268  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.782 seconds (JVM running for 6.644)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 05:12:37.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-k97cg with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 05:12:37.539  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 05:12:37.660  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 05:12:37 GMT 2017]; root of context hierarchy
    2017-05-04 05:12:39.459  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 05:12:39.480  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 05:12:40.163  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 05:12:40.296  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.12]
    2017-05-04 05:12:40.297  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 05:12:40.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 05:12:40.346  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.12]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.12]:5701
    2017-05-04 05:12:40.347  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.12]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 05:12:40.347  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.12]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 05:12:40.827  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.12]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 05:12:41.851  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.1.12]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 05:12:42.134  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.12]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 05:12:42.140  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.12]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 05:12:42.153  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.12]:5701 [someGroup] [3.8] [10.100.1.12]:5701 is STARTING
    2017-05-04 05:12:42.178  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.1.12]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 05:12:42.181  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.12]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.12]:5701 - 892c7f89-3b62-45e7-9e53-e21d770d3ab2 this
    }
    
    2017-05-04 05:12:42.255  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.12]:5701 [someGroup] [3.8] [10.100.1.12]:5701 is STARTED
    2017-05-04 05:12:42.268  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.782 seconds (JVM running for 6.644)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5502/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.243.196 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-2x3r0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c852c0 exit status 1 <nil> <nil> true [0xc420418aa0 0xc420418ac8 0xc420418af0] [0xc420418aa0 0xc420418ac8 0xc420418af0] [0xc420418ab8 0xc420418ae8] [0x182d7e0 0x182d7e0] 0xc420815020 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.243.196 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-2x3r0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c852c0 exit status 1 <nil> <nil> true [0xc420418aa0 0xc420418ac8 0xc420418af0] [0xc420418aa0 0xc420418ac8 0xc420418af0] [0xc420418ab8 0xc420418ae8] [0x182d7e0 0x182d7e0] 0xc420815020 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4213685c0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420b30e10>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-00vhw\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:09:46 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:09:46 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.10; broadcast_rpc_address=10.100.3.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-00vhw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:09:46 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:09:46 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:09:46 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:09:46 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-00vhw
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  06:09:46 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:09:46 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.10; broadcast_rpc_address=10.100.3.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-00vhw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:09:46 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:09:46 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:09:46 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:09:46 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420f768c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 06:17:13.599  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-2x2s0 with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 06:17:13.613  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 06:17:13.716  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 06:17:13 GMT 2017]; root of context hierarchy\n2017-05-04 06:17:15.002  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 06:17:15.019  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 06:17:15.632  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 06:17:15.731  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.23]\n2017-05-04 06:17:15.732  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 06:17:15.742  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 06:17:15.771  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.23]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.23]:5701\n2017-05-04 06:17:15.772  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.23]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 06:17:15.772  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.23]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 06:17:16.166  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.23]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 06:17:16.981  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.23]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 06:17:17.267  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.23]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 06:17:17.277  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.23]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 06:17:17.285  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.23]:5701 [someGroup] [3.8] [10.100.2.23]:5701 is STARTING\n2017-05-04 06:17:17.312  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.23]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 06:17:17.314  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.23]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.23]:5701 - fc2b430a-b22f-4dee-b8ec-6993c0f92756 this\n}\n\n2017-05-04 06:17:17.373  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.23]:5701 [someGroup] [3.8] [10.100.2.23]:5701 is STARTED\n2017-05-04 06:17:17.376  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.592 seconds (JVM running for 5.32)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 06:17:13.599  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-2x2s0 with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 06:17:13.613  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 06:17:13.716  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 06:17:13 GMT 2017]; root of context hierarchy
    2017-05-04 06:17:15.002  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 06:17:15.019  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 06:17:15.632  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 06:17:15.731  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.23]
    2017-05-04 06:17:15.732  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 06:17:15.742  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 06:17:15.771  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.23]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.23]:5701
    2017-05-04 06:17:15.772  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.23]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 06:17:15.772  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.23]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 06:17:16.166  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.23]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 06:17:16.981  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.2.23]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 06:17:17.267  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.23]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 06:17:17.277  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.23]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 06:17:17.285  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.23]:5701 [someGroup] [3.8] [10.100.2.23]:5701 is STARTING
    2017-05-04 06:17:17.312  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.2.23]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 06:17:17.314  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.23]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.23]:5701 - fc2b430a-b22f-4dee-b8ec-6993c0f92756 this
    }
    
    2017-05-04 06:17:17.373  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.23]:5701 [someGroup] [3.8] [10.100.2.23]:5701 is STARTED
    2017-05-04 06:17:17.376  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.592 seconds (JVM running for 5.32)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5503/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4203c6550>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ptl9q] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dfd9e0 exit status 1 <nil> <nil> true [0xc420b7c448 0xc420b7c460 0xc420b7c478] [0xc420b7c448 0xc420b7c460 0xc420b7c478] [0xc420b7c458 0xc420b7c470] [0x182d7e0 0x182d7e0] 0xc420e0d800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ptl9q] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420dfd9e0 exit status 1 <nil> <nil> true [0xc420b7c448 0xc420b7c460 0xc420b7c478] [0xc420b7c448 0xc420b7c460 0xc420b7c478] [0xc420b7c458 0xc420b7c470] [0x182d7e0 0x182d7e0] 0xc420e0d800 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4213c00e0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 06:59:09.111  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-w2403 with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 06:59:09.145  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 06:59:09.271  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 06:59:09 GMT 2017]; root of context hierarchy\n2017-05-04 06:59:11.023  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 06:59:11.043  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 06:59:11.824  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 06:59:11.970  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.19]\n2017-05-04 06:59:11.970  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 06:59:11.984  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 06:59:12.022  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.19]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.19]:5701\n2017-05-04 06:59:12.023  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.19]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 06:59:12.023  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.19]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 06:59:12.596  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.19]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 06:59:13.569  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.19]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 06:59:13.865  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.19]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 06:59:13.875  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.19]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 06:59:13.888  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.19]:5701 [someGroup] [3.8] [10.100.3.19]:5701 is STARTING\n2017-05-04 06:59:13.921  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.19]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 06:59:13.924  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.19]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.19]:5701 - 26fd35b7-1ceb-459f-a618-2fd821585ad0 this\n}\n\n2017-05-04 06:59:14.015  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.19]:5701 [someGroup] [3.8] [10.100.3.19]:5701 is STARTED\n2017-05-04 06:59:14.020  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.932 seconds (JVM running for 6.877)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 06:59:09.111  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-w2403 with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 06:59:09.145  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 06:59:09.271  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 06:59:09 GMT 2017]; root of context hierarchy
    2017-05-04 06:59:11.023  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 06:59:11.043  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 06:59:11.824  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 06:59:11.970  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.19]
    2017-05-04 06:59:11.970  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 06:59:11.984  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 06:59:12.022  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.19]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.19]:5701
    2017-05-04 06:59:12.023  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.19]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 06:59:12.023  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.19]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 06:59:12.596  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.19]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 06:59:13.569  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.19]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 06:59:13.865  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.19]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 06:59:13.875  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.19]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 06:59:13.888  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.19]:5701 [someGroup] [3.8] [10.100.3.19]:5701 is STARTING
    2017-05-04 06:59:13.921  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.19]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 06:59:13.924  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.19]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.19]:5701 - 26fd35b7-1ceb-459f-a618-2fd821585ad0 this
    }
    
    2017-05-04 06:59:14.015  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.19]:5701 [someGroup] [3.8] [10.100.3.19]:5701 is STARTED
    2017-05-04 06:59:14.020  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.932 seconds (JVM running for 6.877)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420a96aa0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.1.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.1.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.1.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-1ftfh\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  07:17:09 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  07:17:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.12; broadcast_rpc_address=10.100.1.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1ftfh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  07:17:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  07:17:09 Global memtable on-heap threshold is enabled at 128MB\nINFO  07:17:09 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:17:09 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.1.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.1.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.1.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-1ftfh
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  07:17:09 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  07:17:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.12; broadcast_rpc_address=10.100.1.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1ftfh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  07:17:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  07:17:09 Global memtable on-heap threshold is enabled at 128MB
    INFO  07:17:09 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 07:17:09 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5504/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4202999d0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.173.153 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-mb9v4] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4212654d0 exit status 1 <nil> <nil> true [0xc42000e7b8 0xc42000e7e0 0xc42000e800] [0xc42000e7b8 0xc42000e7e0 0xc42000e800] [0xc42000e7d0 0xc42000e7f8] [0x182d7e0 0x182d7e0] 0xc4213d88a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.173.153 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-mb9v4] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4212654d0 exit status 1 <nil> <nil> true [0xc42000e7b8 0xc42000e7e0 0xc42000e800] [0xc42000e7b8 0xc42000e7e0 0xc42000e800] [0xc42000e7d0 0xc42000e7f8] [0x182d7e0 0x182d7e0] 0xc4213d88a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420c02070>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 07:59:39.655  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-ww5xj with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 07:59:39.673  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 07:59:39.761  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 07:59:39 GMT 2017]; root of context hierarchy\n2017-05-04 07:59:41.204  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 07:59:41.221  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 07:59:41.942  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 07:59:42.082  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.13]\n2017-05-04 07:59:42.082  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 07:59:42.093  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 07:59:42.127  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.13]:5701\n2017-05-04 07:59:42.127  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 07:59:42.128  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 07:59:42.576  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.13]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 07:59:43.412  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.1.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 07:59:43.654  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.13]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 07:59:43.659  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 07:59:43.668  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.13]:5701 [someGroup] [3.8] [10.100.1.13]:5701 is STARTING\n2017-05-04 07:59:43.714  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 07:59:43.717  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.13]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.1.13]:5701 - 5a819202-b2cb-4767-a8d2-fe01f5aabfd6 this\n}\n\n2017-05-04 07:59:43.771  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.13]:5701 [someGroup] [3.8] [10.100.1.13]:5701 is STARTED\n2017-05-04 07:59:43.777  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.913 seconds (JVM running for 5.656)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 07:59:39.655  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-ww5xj with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 07:59:39.673  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 07:59:39.761  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 07:59:39 GMT 2017]; root of context hierarchy
    2017-05-04 07:59:41.204  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 07:59:41.221  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 07:59:41.942  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 07:59:42.082  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.1.13]
    2017-05-04 07:59:42.082  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 07:59:42.093  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 07:59:42.127  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.1.13]:5701
    2017-05-04 07:59:42.127  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 07:59:42.128  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 07:59:42.576  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.1.13]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 07:59:43.412  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.1.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 07:59:43.654  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.13]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 07:59:43.659  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.1.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 07:59:43.668  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.13]:5701 [someGroup] [3.8] [10.100.1.13]:5701 is STARTING
    2017-05-04 07:59:43.714  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.1.13]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 07:59:43.717  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.1.13]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.1.13]:5701 - 5a819202-b2cb-4767-a8d2-fe01f5aabfd6 this
    }
    
    2017-05-04 07:59:43.771  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.1.13]:5701 [someGroup] [3.8] [10.100.1.13]:5701 is STARTED
    2017-05-04 07:59:43.777  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.913 seconds (JVM running for 5.656)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421846050>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2dd90\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  08:14:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  08:14:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.14; broadcast_rpc_address=10.100.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2dd90}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  08:14:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  08:14:41 Global memtable on-heap threshold is enabled at 128MB\nINFO  08:14:41 Global memtable off-heap threshold is enabled at 128MB\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:14:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-2dd90
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  08:14:40 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  08:14:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.14; broadcast_rpc_address=10.100.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2dd90}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  08:14:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  08:14:41 Global memtable on-heap threshold is enabled at 128MB
    INFO  08:14:41 Global memtable off-heap threshold is enabled at 128MB
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 08:14:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5505/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420150e50>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2znbc\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  08:44:29 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  08:44:29 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.6; broadcast_rpc_address=10.100.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2znbc}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  08:44:29 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  08:44:29 Global memtable on-heap threshold is enabled at 128MB\nINFO  08:44:29 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:44:30 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-2znbc
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  08:44:29 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  08:44:29 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.6; broadcast_rpc_address=10.100.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2znbc}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  08:44:29 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  08:44:29 Global memtable on-heap threshold is enabled at 128MB
    INFO  08:44:29 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 08:44:30 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420c8e2b0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zmwrq] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4207c6a80 exit status 1 <nil> <nil> true [0xc42084c418 0xc42084c430 0xc42084c448] [0xc42084c418 0xc42084c430 0xc42084c448] [0xc42084c428 0xc42084c440] [0x182d7e0 0x182d7e0] 0xc420bdd7a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zmwrq] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4207c6a80 exit status 1 <nil> <nil> true [0xc42084c418 0xc42084c430 0xc42084c448] [0xc42084c418 0xc42084c430 0xc42084c448] [0xc42084c428 0xc42084c440] [0x182d7e0 0x182d7e0] 0xc420bdd7a0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420c990a0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 09:00:43.661  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bz848 with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 09:00:43.684  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 09:00:43.805  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 09:00:43 GMT 2017]; root of context hierarchy\n2017-05-04 09:00:45.304  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 09:00:45.323  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 09:00:46.113  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 09:00:46.242  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.14]\n2017-05-04 09:00:46.243  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 09:00:46.254  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 09:00:46.291  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.14]:5701\n2017-05-04 09:00:46.291  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 09:00:46.292  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 09:00:46.805  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.14]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 09:00:47.814  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 09:00:48.120  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 09:00:48.127  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 09:00:48.145  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTING\n2017-05-04 09:00:48.178  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 09:00:48.179  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.14]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.14]:5701 - f543437d-55f5-458e-9f0b-80e0a0cde279 this\n}\n\n2017-05-04 09:00:48.238  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTED\n2017-05-04 09:00:48.249  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.673 seconds (JVM running for 6.58)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 09:00:43.661  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-bz848 with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 09:00:43.684  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 09:00:43.805  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 09:00:43 GMT 2017]; root of context hierarchy
    2017-05-04 09:00:45.304  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 09:00:45.323  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 09:00:46.113  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 09:00:46.242  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.14]
    2017-05-04 09:00:46.243  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 09:00:46.254  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 09:00:46.291  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.14]:5701
    2017-05-04 09:00:46.291  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 09:00:46.292  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 09:00:46.805  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.14]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 09:00:47.814  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 09:00:48.120  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 09:00:48.127  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 09:00:48.145  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTING
    2017-05-04 09:00:48.178  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 09:00:48.179  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.14]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.14]:5701 - f543437d-55f5-458e-9f0b-80e0a0cde279 this
    }
    
    2017-05-04 09:00:48.238  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTED
    2017-05-04 09:00:48.249  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.673 seconds (JVM running for 6.58)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5506/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420318a10>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-03q57\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:46:56 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:46:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.11; broadcast_rpc_address=10.100.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-03q57}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:46:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:46:56 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:46:56 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:46:56 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-03q57
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  09:46:56 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:46:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.11; broadcast_rpc_address=10.100.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-03q57}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:46:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:46:56 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:46:56 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:46:56 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420ea8020>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 09:58:43.327  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-2cdcl with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 09:58:43.362  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 09:58:43.485  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 09:58:43 GMT 2017]; root of context hierarchy\n2017-05-04 09:58:45.272  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 09:58:45.298  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 09:58:46.017  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 09:58:46.183  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.18]\n2017-05-04 09:58:46.184  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 09:58:46.197  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 09:58:46.240  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.18]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.18]:5701\n2017-05-04 09:58:46.241  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.18]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 09:58:46.241  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.18]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 09:58:46.903  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.18]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 09:58:47.880  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.2.18]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 09:58:48.197  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.18]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 09:58:48.210  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.18]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 09:58:48.223  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.18]:5701 [someGroup] [3.8] [10.100.2.18]:5701 is STARTING\n2017-05-04 09:58:48.268  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.18]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 09:58:48.272  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.18]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.18]:5701 - 19bde825-d7bd-4e87-87a1-96027ba20744 this\n}\n\n2017-05-04 09:58:48.349  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.18]:5701 [someGroup] [3.8] [10.100.2.18]:5701 is STARTED\n2017-05-04 09:58:48.353  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.076 seconds (JVM running for 6.928)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 09:58:43.327  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-2cdcl with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 09:58:43.362  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 09:58:43.485  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 09:58:43 GMT 2017]; root of context hierarchy
    2017-05-04 09:58:45.272  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 09:58:45.298  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 09:58:46.017  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 09:58:46.183  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.18]
    2017-05-04 09:58:46.184  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 09:58:46.197  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 09:58:46.240  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.18]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.18]:5701
    2017-05-04 09:58:46.241  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.18]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 09:58:46.241  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.18]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 09:58:46.903  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.18]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 09:58:47.880  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.2.18]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 09:58:48.197  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.18]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 09:58:48.210  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.18]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 09:58:48.223  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.18]:5701 [someGroup] [3.8] [10.100.2.18]:5701 is STARTING
    2017-05-04 09:58:48.268  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.18]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 09:58:48.272  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.18]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.18]:5701 - 19bde825-d7bd-4e87-87a1-96027ba20744 this
    }
    
    2017-05-04 09:58:48.349  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.18]:5701 [someGroup] [3.8] [10.100.2.18]:5701 is STARTED
    2017-05-04 09:58:48.353  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.076 seconds (JVM running for 6.928)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420ae16a0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.184.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1m07m] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42226f110 exit status 1 <nil> <nil> true [0xc42000f3b8 0xc42000f3d0 0xc42000f3e8] [0xc42000f3b8 0xc42000f3d0 0xc42000f3e8] [0xc42000f3c8 0xc42000f3e0] [0x182d7e0 0x182d7e0] 0xc4216f1140 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.184.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1m07m] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42226f110 exit status 1 <nil> <nil> true [0xc42000f3b8 0xc42000f3d0 0xc42000f3e8] [0xc42000f3b8 0xc42000f3d0 0xc42000f3e8] [0xc42000f3c8 0xc42000f3e0] [0x182d7e0 0x182d7e0] 0xc4216f1140 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5507/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421203f40>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.24\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.24\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.24\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.24\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2skht\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:06:06 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:06:06 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.24; broadcast_rpc_address=10.100.2.24; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.24; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2skht}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:06:06 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:06:06 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:06:06 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:06:06 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.24
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.24
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.24
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.24
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-2skht
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  11:06:06 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:06:06 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.24; broadcast_rpc_address=10.100.2.24; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.24; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2skht}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:06:06 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:06:06 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:06:06 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:06:06 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.157.205 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-z322h] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4207a2b70 exit status 1 <nil> <nil> true [0xc420213090 0xc4202130b0 0xc4202130c8] [0xc420213090 0xc4202130b0 0xc4202130c8] [0xc4202130a8 0xc4202130c0] [0x182d7e0 0x182d7e0] 0xc4213d4780 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.157.205 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-z322h] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4207a2b70 exit status 1 <nil> <nil> true [0xc420213090 0xc4202130b0 0xc4202130c8] [0xc420213090 0xc4202130b0 0xc4202130c8] [0xc4202130a8 0xc4202130c0] [0x182d7e0 0x182d7e0] 0xc4213d4780 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420f74320>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4212e0030>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 10:46:00.893  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-2bh59 with PID 7 (/bootstrapper.jar started by root in /)\n2017-05-04 10:46:00.900  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 10:46:00.975  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 10:46:00 GMT 2017]; root of context hierarchy\n2017-05-04 10:46:02.685  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 10:46:02.710  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 10:46:03.451  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 10:46:03.604  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.17]\n2017-05-04 10:46:03.604  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 10:46:03.616  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 10:46:03.658  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.17]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.17]:5701\n2017-05-04 10:46:03.668  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.17]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 10:46:03.668  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.17]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 10:46:04.160  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.17]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 10:46:05.132  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.2.17]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 10:46:05.438  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.17]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 10:46:05.448  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.17]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 10:46:05.460  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.17]:5701 [someGroup] [3.8] [10.100.2.17]:5701 is STARTING\n2017-05-04 10:46:05.483  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.17]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 10:46:05.487  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.17]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.17]:5701 - 5c9c2e9d-e2c8-4237-ba14-1a3c7653fa40 this\n}\n\n2017-05-04 10:46:05.570  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.17]:5701 [someGroup] [3.8] [10.100.2.17]:5701 is STARTED\n2017-05-04 10:46:05.575  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.704 seconds (JVM running for 6.489)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 10:46:00.893  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-2bh59 with PID 7 (/bootstrapper.jar started by root in /)
    2017-05-04 10:46:00.900  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 10:46:00.975  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 10:46:00 GMT 2017]; root of context hierarchy
    2017-05-04 10:46:02.685  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 10:46:02.710  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 10:46:03.451  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 10:46:03.604  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.17]
    2017-05-04 10:46:03.604  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 10:46:03.616  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 10:46:03.658  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.17]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.17]:5701
    2017-05-04 10:46:03.668  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.17]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 10:46:03.668  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.17]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 10:46:04.160  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.17]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 10:46:05.132  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.100.2.17]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 10:46:05.438  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.17]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 10:46:05.448  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.17]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 10:46:05.460  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.17]:5701 [someGroup] [3.8] [10.100.2.17]:5701 is STARTING
    2017-05-04 10:46:05.483  INFO 7 --- [           main] com.hazelcast.system                     : [10.100.2.17]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 10:46:05.487  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.17]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.17]:5701 - 5c9c2e9d-e2c8-4237-ba14-1a3c7653fa40 this
    }
    
    2017-05-04 10:46:05.570  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.17]:5701 [someGroup] [3.8] [10.100.2.17]:5701 is STARTED
    2017-05-04 10:46:05.575  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.704 seconds (JVM running for 6.489)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5508/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421191bc0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.1.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.1.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.1.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bmfzj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:50:34 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:50:34 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.12; broadcast_rpc_address=10.100.1.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bmfzj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:50:34 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:50:34 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:50:34 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:50:34 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.1.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.1.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.1.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-bmfzj
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  11:50:34 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:50:34 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.12; broadcast_rpc_address=10.100.1.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bmfzj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:50:34 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:50:34 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:50:34 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:50:34 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.184.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vtnb7] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420bea030 exit status 1 <nil> <nil> true [0xc420174dd0 0xc420174de8 0xc420174e08] [0xc420174dd0 0xc420174de8 0xc420174e08] [0xc420174de0 0xc420174df8] [0x182d7e0 0x182d7e0] 0xc420df1aa0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.184.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vtnb7] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420bea030 exit status 1 <nil> <nil> true [0xc420174dd0 0xc420174de8 0xc420174e08] [0xc420174dd0 0xc420174de8 0xc420174e08] [0xc420174de0 0xc420174df8] [0x182d7e0 0x182d7e0] 0xc420df1aa0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420c12070>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 11:58:13.314  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-m7ppw with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 11:58:13.325  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 11:58:13.427  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 11:58:13 GMT 2017]; root of context hierarchy\n2017-05-04 11:58:14.641  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 11:58:14.655  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 11:58:15.409  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 11:58:15.531  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.21]\n2017-05-04 11:58:15.532  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 11:58:15.543  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 11:58:15.579  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.21]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.21]:5701\n2017-05-04 11:58:15.579  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.21]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 11:58:15.579  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.21]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 11:58:16.075  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.21]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 11:58:16.948  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.2.21]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 11:58:17.216  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.21]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 11:58:17.239  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.21]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 11:58:17.261  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.21]:5701 [someGroup] [3.8] [10.100.2.21]:5701 is STARTING\n2017-05-04 11:58:17.285  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.21]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 11:58:17.286  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.21]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.2.21]:5701 - c6030a4b-2d93-4ac3-81b7-c2de4008773d this\n}\n\n2017-05-04 11:58:17.342  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.21]:5701 [someGroup] [3.8] [10.100.2.21]:5701 is STARTED\n2017-05-04 11:58:17.346  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.894 seconds (JVM running for 5.638)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 11:58:13.314  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-m7ppw with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 11:58:13.325  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 11:58:13.427  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 11:58:13 GMT 2017]; root of context hierarchy
    2017-05-04 11:58:14.641  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 11:58:14.655  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 11:58:15.409  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 11:58:15.531  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.2.21]
    2017-05-04 11:58:15.532  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 11:58:15.543  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.2.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 11:58:15.579  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.21]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.2.21]:5701
    2017-05-04 11:58:15.579  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.21]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 11:58:15.579  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.21]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 11:58:16.075  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.2.21]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 11:58:16.948  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.2.21]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 11:58:17.216  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.21]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 11:58:17.239  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.2.21]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 11:58:17.261  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.21]:5701 [someGroup] [3.8] [10.100.2.21]:5701 is STARTING
    2017-05-04 11:58:17.285  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.2.21]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 11:58:17.286  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.2.21]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.2.21]:5701 - c6030a4b-2d93-4ac3-81b7-c2de4008773d this
    }
    
    2017-05-04 11:58:17.342  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.2.21]:5701 [someGroup] [3.8] [10.100.2.21]:5701 is STARTED
    2017-05-04 11:58:17.346  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.894 seconds (JVM running for 5.638)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4203e4240>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5509/
Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420278af0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc420e35160>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.1.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.1.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.1.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-03lll\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  12:39:28 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  12:39:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.7; broadcast_rpc_address=10.100.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-03lll}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  12:39:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  12:39:28 Global memtable on-heap threshold is enabled at 128MB\nINFO  12:39:28 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:39:28 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.1.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.1.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.1.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.1.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-03lll
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  12:39:28 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  12:39:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.1.7; broadcast_rpc_address=10.100.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-03lll}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  12:39:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  12:39:28 Global memtable on-heap threshold is enabled at 128MB
    INFO  12:39:28 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 12:39:28 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.44.235 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-km15r] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420807b00 exit status 1 <nil> <nil> true [0xc4202dcce8 0xc4202dcd00 0xc4202dcd18] [0xc4202dcce8 0xc4202dcd00 0xc4202dcd18] [0xc4202dccf8 0xc4202dcd10] [0x182d7e0 0x182d7e0] 0xc420f42780 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.44.235 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-km15r] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420807b00 exit status 1 <nil> <nil> true [0xc4202dcce8 0xc4202dcd00 0xc4202dcd18] [0xc4202dcce8 0xc4202dcd00 0xc4202dcd18] [0xc4202dccf8 0xc4202dcd10] [0x182d7e0 0x182d7e0] 0xc420f42780 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4201bfca0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 12:46:46.844  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-kcrmb with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 12:46:46.851  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 12:46:46.935  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 12:46:46 GMT 2017]; root of context hierarchy\n2017-05-04 12:46:48.324  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 12:46:48.352  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 12:46:48.997  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 12:46:49.133  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.13]\n2017-05-04 12:46:49.134  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 12:46:49.145  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 12:46:49.178  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.13]:5701\n2017-05-04 12:46:49.179  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 12:46:49.179  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 12:46:49.636  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.13]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 12:46:50.541  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 12:46:50.809  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.13]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 12:46:50.821  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 12:46:50.839  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.13]:5701 [someGroup] [3.8] [10.100.3.13]:5701 is STARTING\n2017-05-04 12:46:50.887  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 12:46:50.890  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.13]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.13]:5701 - ceb18942-3fc5-4a2e-a8ec-0a1bd4326370 this\n}\n\n2017-05-04 12:46:50.960  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.13]:5701 [someGroup] [3.8] [10.100.3.13]:5701 is STARTED\n2017-05-04 12:46:50.965  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.913 seconds (JVM running for 5.707)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 12:46:46.844  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-kcrmb with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 12:46:46.851  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 12:46:46.935  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 12:46:46 GMT 2017]; root of context hierarchy
    2017-05-04 12:46:48.324  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 12:46:48.352  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 12:46:48.997  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 12:46:49.133  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.13]
    2017-05-04 12:46:49.134  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 12:46:49.145  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 12:46:49.178  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.13]:5701
    2017-05-04 12:46:49.179  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 12:46:49.179  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 12:46:49.636  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.13]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 12:46:50.541  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 12:46:50.809  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.13]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 12:46:50.821  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 12:46:50.839  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.13]:5701 [someGroup] [3.8] [10.100.3.13]:5701 is STARTING
    2017-05-04 12:46:50.887  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 12:46:50.890  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.13]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.13]:5701 - ceb18942-3fc5-4a2e-a8ec-0a1bd4326370 this
    }
    
    2017-05-04 12:46:50.960  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.13]:5701 [someGroup] [3.8] [10.100.3.13]:5701 is STARTED
    2017-05-04 12:46:50.965  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.913 seconds (JVM running for 5.707)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5510/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420b65b10>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421296890>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-pxvvj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:54:23 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:54:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.13; broadcast_rpc_address=10.100.2.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-pxvvj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:54:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:54:23 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:54:23 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:54:23 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-pxvvj
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  13:54:23 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:54:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.13; broadcast_rpc_address=10.100.2.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-pxvvj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:54:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:54:23 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:54:23 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:54:23 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.218.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-874x9] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42134d380 exit status 1 <nil> <nil> true [0xc4204e43e8 0xc4204e4400 0xc4204e4418] [0xc4204e43e8 0xc4204e4400 0xc4204e4418] [0xc4204e43f8 0xc4204e4410] [0x182d7e0 0x182d7e0] 0xc421346960 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.218.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-874x9] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42134d380 exit status 1 <nil> <nil> true [0xc4204e43e8 0xc4204e4400 0xc4204e4418] [0xc4204e43e8 0xc4204e4400 0xc4204e4418] [0xc4204e43f8 0xc4204e4410] [0x182d7e0 0x182d7e0] 0xc421346960 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420d84c10>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 13:26:52.834  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-q0p7v with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 13:26:52.858  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 13:26:52.965  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 13:26:52 GMT 2017]; root of context hierarchy\n2017-05-04 13:26:54.697  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 13:26:54.728  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 13:26:55.464  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 13:26:55.593  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.13]\n2017-05-04 13:26:55.593  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 13:26:55.607  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 13:26:55.646  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.13]:5701\n2017-05-04 13:26:55.646  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 13:26:55.646  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 13:26:56.125  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.13]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 13:26:57.096  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 13:26:57.432  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.13]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 13:26:57.439  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 13:26:57.461  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.13]:5701 [someGroup] [3.8] [10.100.3.13]:5701 is STARTING\n2017-05-04 13:26:57.498  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 13:26:57.500  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.13]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.13]:5701 - b239404e-6664-4d66-87b7-928e4880d7d0 this\n}\n\n2017-05-04 13:26:57.587  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.13]:5701 [someGroup] [3.8] [10.100.3.13]:5701 is STARTED\n2017-05-04 13:26:57.590  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.949 seconds (JVM running for 6.853)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 13:26:52.834  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-q0p7v with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 13:26:52.858  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 13:26:52.965  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 13:26:52 GMT 2017]; root of context hierarchy
    2017-05-04 13:26:54.697  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 13:26:54.728  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 13:26:55.464  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 13:26:55.593  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.13]
    2017-05-04 13:26:55.593  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 13:26:55.607  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 13:26:55.646  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.13]:5701
    2017-05-04 13:26:55.646  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 13:26:55.646  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 13:26:56.125  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.13]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 13:26:57.096  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.13]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 13:26:57.432  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.13]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 13:26:57.439  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.13]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 13:26:57.461  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.13]:5701 [someGroup] [3.8] [10.100.3.13]:5701 is STARTING
    2017-05-04 13:26:57.498  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.13]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 13:26:57.500  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.13]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.13]:5701 - b239404e-6664-4d66-87b7-928e4880d7d0 this
    }
    
    2017-05-04 13:26:57.587  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.13]:5701 [someGroup] [3.8] [10.100.3.13]:5701 is STARTED
    2017-05-04 13:26:57.590  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.949 seconds (JVM running for 6.853)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5511/
Multiple broken tests:

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4204aeaa0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4203b86c0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-l59rz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  14:53:35 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  14:53:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.19; broadcast_rpc_address=10.100.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-l59rz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  14:53:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  14:53:35 Global memtable on-heap threshold is enabled at 128MB\nINFO  14:53:35 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:53:35 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.19
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.19
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.19
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.19
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-l59rz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  14:53:35 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  14:53:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.19; broadcast_rpc_address=10.100.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-l59rz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  14:53:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  14:53:35 Global memtable on-heap threshold is enabled at 128MB
    INFO  14:53:35 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 14:53:35 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4204442e0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 14:18:50.424  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-mrxwk with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 14:18:50.438  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 14:18:50.531  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 14:18:50 GMT 2017]; root of context hierarchy\n2017-05-04 14:18:52.019  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 14:18:52.039  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 14:18:52.748  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 14:18:52.884  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.5]\n2017-05-04 14:18:52.884  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 14:18:52.895  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 14:18:52.931  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.5]:5701\n2017-05-04 14:18:52.931  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 14:18:52.931  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 14:18:53.400  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.5]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 14:18:54.328  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 14:18:54.590  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 14:18:54.593  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 14:18:54.603  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTING\n2017-05-04 14:18:54.623  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 14:18:54.626  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.5]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.5]:5701 - 9f13b94f-152d-42ea-bd06-936723b8d11d this\n}\n\n2017-05-04 14:18:54.705  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTED\n2017-05-04 14:18:54.708  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.239 seconds (JVM running for 5.973)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 14:18:50.424  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-mrxwk with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 14:18:50.438  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 14:18:50.531  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 14:18:50 GMT 2017]; root of context hierarchy
    2017-05-04 14:18:52.019  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 14:18:52.039  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 14:18:52.748  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 14:18:52.884  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.5]
    2017-05-04 14:18:52.884  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 14:18:52.895  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 14:18:52.931  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.5]:5701
    2017-05-04 14:18:52.931  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 14:18:52.931  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 14:18:53.400  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.5]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 14:18:54.328  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.5]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 14:18:54.590  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 14:18:54.593  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.5]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 14:18:54.603  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTING
    2017-05-04 14:18:54.623  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.5]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 14:18:54.626  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.5]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.5]:5701 - 9f13b94f-152d-42ea-bd06-936723b8d11d this
    }
    
    2017-05-04 14:18:54.705  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.5]:5701 [someGroup] [3.8] [10.100.3.5]:5701 is STARTED
    2017-05-04 14:18:54.708  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.239 seconds (JVM running for 5.973)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.142.117 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7vkgh] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421376f30 exit status 1 <nil> <nil> true [0xc4212a88c0 0xc4212a88d8 0xc4212a88f0] [0xc4212a88c0 0xc4212a88d8 0xc4212a88f0] [0xc4212a88d0 0xc4212a88e8] [0x182d7e0 0x182d7e0] 0xc421374600 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.142.117 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7vkgh] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421376f30 exit status 1 <nil> <nil> true [0xc4212a88c0 0xc4212a88d8 0xc4212a88f0] [0xc4212a88c0 0xc4212a88d8 0xc4212a88f0] [0xc4212a88d0 0xc4212a88e8] [0x182d7e0 0x182d7e0] 0xc421374600 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5512/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-d8krx] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4213c7e60 exit status 1 <nil> <nil> true [0xc420178800 0xc420178840 0xc420178868] [0xc420178800 0xc420178840 0xc420178868] [0xc420178818 0xc420178860] [0x182d7e0 0x182d7e0] 0xc4212a35c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-d8krx] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4213c7e60 exit status 1 <nil> <nil> true [0xc420178800 0xc420178840 0xc420178868] [0xc420178800 0xc420178840 0xc420178868] [0xc420178818 0xc420178860] [0x182d7e0 0x182d7e0] 0xc4212a35c0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420ba1ea0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 15:43:05.240  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-d7zfw with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 15:43:05.249  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 15:43:05.369  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 15:43:05 GMT 2017]; root of context hierarchy\n2017-05-04 15:43:07.009  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 15:43:07.034  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 15:43:07.813  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 15:43:07.953  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.18]\n2017-05-04 15:43:07.953  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 15:43:07.965  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 15:43:08.002  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.18]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.18]:5701\n2017-05-04 15:43:08.003  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.18]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 15:43:08.003  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.18]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 15:43:08.543  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.18]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 15:43:09.606  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.18]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 15:43:09.904  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.18]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 15:43:09.906  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.18]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 15:43:09.930  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.18]:5701 [someGroup] [3.8] [10.100.3.18]:5701 is STARTING\n2017-05-04 15:43:09.990  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.18]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 15:43:09.995  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.18]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.18]:5701 - 53e0cb49-baed-4c1d-aca2-daa303cfb580 this\n}\n\n2017-05-04 15:43:10.087  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.18]:5701 [someGroup] [3.8] [10.100.3.18]:5701 is STARTED\n2017-05-04 15:43:10.095  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.012 seconds (JVM running for 6.898)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 15:43:05.240  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-d7zfw with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 15:43:05.249  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 15:43:05.369  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 15:43:05 GMT 2017]; root of context hierarchy
    2017-05-04 15:43:07.009  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 15:43:07.034  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 15:43:07.813  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 15:43:07.953  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.18]
    2017-05-04 15:43:07.953  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 15:43:07.965  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 15:43:08.002  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.18]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.18]:5701
    2017-05-04 15:43:08.003  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.18]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 15:43:08.003  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.18]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 15:43:08.543  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.18]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 15:43:09.606  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.18]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 15:43:09.904  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.18]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 15:43:09.906  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.18]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 15:43:09.930  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.18]:5701 [someGroup] [3.8] [10.100.3.18]:5701 is STARTING
    2017-05-04 15:43:09.990  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.18]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 15:43:09.995  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.18]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.18]:5701 - 53e0cb49-baed-4c1d-aca2-daa303cfb580 this
    }
    
    2017-05-04 15:43:10.087  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.18]:5701 [someGroup] [3.8] [10.100.3.18]:5701 is STARTED
    2017-05-04 15:43:10.095  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.012 seconds (JVM running for 6.898)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4201bf5a0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-7p6j8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:24:17 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:24:18 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.6; broadcast_rpc_address=10.100.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7p6j8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:24:18 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:24:18 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:24:18 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:24:18 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-7p6j8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  15:24:17 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:24:18 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.6; broadcast_rpc_address=10.100.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7p6j8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:24:18 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:24:18 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:24:18 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:24:18 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc421d2b300>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5513/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jvmsq] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421406a20 exit status 1 <nil> <nil> true [0xc4202e80f8 0xc4202e8128 0xc4202e8140] [0xc4202e80f8 0xc4202e8128 0xc4202e8140] [0xc4202e8110 0xc4202e8138] [0x182d7e0 0x182d7e0] 0xc421038420 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.139.170 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jvmsq] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421406a20 exit status 1 <nil> <nil> true [0xc4202e80f8 0xc4202e8128 0xc4202e8140] [0xc4202e80f8 0xc4202e8128 0xc4202e8140] [0xc4202e8110 0xc4202e8138] [0x182d7e0 0x182d7e0] 0xc421038420 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc4211a5170>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-609rs\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  16:30:17 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  16:30:18 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.14; broadcast_rpc_address=10.100.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-609rs}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  16:30:18 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  16:30:18 Global memtable on-heap threshold is enabled at 128MB\nINFO  16:30:18 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:30:18 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-609rs
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  16:30:17 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  16:30:18 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.14; broadcast_rpc_address=10.100.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-609rs}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  16:30:18 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  16:30:18 Global memtable on-heap threshold is enabled at 128MB
    INFO  16:30:18 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 16:30:18 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc4211e13c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 16:35:54.237  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-n9f7g with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 16:35:54.254  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 16:35:54.392  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 16:35:54 GMT 2017]; root of context hierarchy\n2017-05-04 16:35:56.439  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 16:35:56.459  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 16:35:57.372  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 16:35:57.560  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.17]\n2017-05-04 16:35:57.561  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 16:35:57.572  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 16:35:57.618  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.17]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.17]:5701\n2017-05-04 16:35:57.619  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.17]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 16:35:57.619  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.17]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 16:35:58.141  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.17]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 16:35:59.366  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.17]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 16:35:59.663  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.17]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 16:35:59.671  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.17]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 16:35:59.687  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.17]:5701 [someGroup] [3.8] [10.100.3.17]:5701 is STARTING\n2017-05-04 16:35:59.717  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.17]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 16:35:59.721  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.17]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.17]:5701 - 529dc923-0d63-4aad-b95d-7a4ce10c54a6 this\n}\n\n2017-05-04 16:35:59.791  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.17]:5701 [someGroup] [3.8] [10.100.3.17]:5701 is STARTED\n2017-05-04 16:35:59.797  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.719 seconds (JVM running for 7.615)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 16:35:54.237  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-n9f7g with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 16:35:54.254  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 16:35:54.392  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 16:35:54 GMT 2017]; root of context hierarchy
    2017-05-04 16:35:56.439  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 16:35:56.459  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 16:35:57.372  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 16:35:57.560  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.17]
    2017-05-04 16:35:57.561  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 16:35:57.572  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 16:35:57.618  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.17]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.17]:5701
    2017-05-04 16:35:57.619  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.17]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 16:35:57.619  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.17]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 16:35:58.141  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.17]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 16:35:59.366  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.17]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 16:35:59.663  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.17]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 16:35:59.671  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.17]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 16:35:59.687  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.17]:5701 [someGroup] [3.8] [10.100.3.17]:5701 is STARTING
    2017-05-04 16:35:59.717  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.17]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 16:35:59.721  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.17]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.17]:5701 - 529dc923-0d63-4aad-b95d-7a4ce10c54a6 this
    }
    
    2017-05-04 16:35:59.791  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.17]:5701 [someGroup] [3.8] [10.100.3.17]:5701 is STARTED
    2017-05-04 16:35:59.797  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.719 seconds (JVM running for 7.615)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc420ca2280>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5514/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42013a3f0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.2.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.2.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.2.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-hxf73\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  17:22:46 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  17:22:46 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.9; broadcast_rpc_address=10.100.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hxf73}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  17:22:46 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  17:22:47 Global memtable on-heap threshold is enabled at 128MB\nINFO  17:22:47 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:22:47 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.2.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.2.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.2.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.2.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-hxf73
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  17:22:46 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  17:22:46 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.2.9; broadcast_rpc_address=10.100.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hxf73}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  17:22:46 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  17:22:47 Global memtable on-heap threshold is enabled at 128MB
    INFO  17:22:47 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 17:22:47 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc421180d00>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 17:27:37.585  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-3h933 with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 17:27:37.592  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 17:27:37.728  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 17:27:37 GMT 2017]; root of context hierarchy\n2017-05-04 17:27:39.708  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 17:27:39.733  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 17:27:40.517  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 17:27:40.668  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.14]\n2017-05-04 17:27:40.668  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 17:27:40.679  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 17:27:40.722  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.14]:5701\n2017-05-04 17:27:40.722  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 17:27:40.722  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 17:27:41.300  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.14]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 17:27:42.334  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 17:27:42.603  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 17:27:42.609  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 17:27:42.621  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTING\n2017-05-04 17:27:42.685  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 17:27:42.690  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.14]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.14]:5701 - 1a11f0f9-f9f0-4076-add0-139dba452394 this\n}\n\n2017-05-04 17:27:42.773  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTED\n2017-05-04 17:27:42.777  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.236 seconds (JVM running for 7.167)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 17:27:37.585  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-3h933 with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 17:27:37.592  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 17:27:37.728  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 17:27:37 GMT 2017]; root of context hierarchy
    2017-05-04 17:27:39.708  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 17:27:39.733  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 17:27:40.517  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 17:27:40.668  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.14]
    2017-05-04 17:27:40.668  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 17:27:40.679  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 17:27:40.722  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.14]:5701
    2017-05-04 17:27:40.722  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 17:27:40.722  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 17:27:41.300  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.14]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 17:27:42.334  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.14]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 17:27:42.603  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 17:27:42.609  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.14]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 17:27:42.621  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTING
    2017-05-04 17:27:42.685  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.14]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 17:27:42.690  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.14]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.14]:5701 - 1a11f0f9-f9f0-4076-add0-139dba452394 this
    }
    
    2017-05-04 17:27:42.773  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.14]:5701 [someGroup] [3.8] [10.100.3.14]:5701 is STARTED
    2017-05-04 17:27:42.777  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.236 seconds (JVM running for 7.167)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.242.188 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0831t] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc422166750 exit status 1 <nil> <nil> true [0xc422156008 0xc422156020 0xc422156038] [0xc422156008 0xc422156020 0xc422156038] [0xc422156018 0xc422156030] [0x182d7e0 0x182d7e0] 0xc4210ac7e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.242.188 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0831t] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc422166750 exit status 1 <nil> <nil> true [0xc422156008 0xc422156020 0xc422156038] [0xc422156008 0xc422156020 0xc422156038] [0xc422156018 0xc422156030] [0x182d7e0 0x182d7e0] 0xc4210ac7e0 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4201bf150>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5515/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc42040da70>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-k8cd7\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:19:22 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:19:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.13; broadcast_rpc_address=10.100.3.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-k8cd7}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:19:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:19:23 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:19:23 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:19:23 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-k8cd7
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  18:19:22 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:19:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.13; broadcast_rpc_address=10.100.3.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-k8cd7}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:19:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:19:23 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:19:23 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:19:23 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4222426c0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.242.188 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zdswv] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421769620 exit status 1 <nil> <nil> true [0xc422063ce0 0xc422063cf8 0xc422063d10] [0xc422063ce0 0xc422063cf8 0xc422063d10] [0xc422063cf0 0xc422063d08] [0x182d7e0 0x182d7e0] 0xc421677260 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.242.188 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zdswv] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421769620 exit status 1 <nil> <nil> true [0xc422063ce0 0xc422063cf8 0xc422063d10] [0xc422063ce0 0xc422063cf8 0xc422063d10] [0xc422063cf0 0xc422063d08] [0x182d7e0 0x182d7e0] 0xc421677260 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc42136a4b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 18:33:09.941  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-553tm with PID 5 (/bootstrapper.jar started by root in /)\n2017-05-04 18:33:09.949  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 18:33:10.113  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 18:33:10 GMT 2017]; root of context hierarchy\n2017-05-04 18:33:11.742  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 18:33:11.762  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 18:33:12.520  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 18:33:12.672  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.21]\n2017-05-04 18:33:12.672  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 18:33:12.685  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 18:33:12.743  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.21]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.21]:5701\n2017-05-04 18:33:12.743  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.21]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 18:33:12.743  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.21]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 18:33:13.296  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.21]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 18:33:14.405  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.21]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 18:33:14.663  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.21]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 18:33:14.669  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.21]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 18:33:14.690  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.21]:5701 [someGroup] [3.8] [10.100.3.21]:5701 is STARTING\n2017-05-04 18:33:14.725  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.21]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 18:33:14.728  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.21]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.21]:5701 - 9a134730-5d12-445b-8bd2-4c471758b3c2 this\n}\n\n2017-05-04 18:33:14.848  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.21]:5701 [someGroup] [3.8] [10.100.3.21]:5701 is STARTED\n2017-05-04 18:33:14.853  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.065 seconds (JVM running for 7.004)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 18:33:09.941  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-553tm with PID 5 (/bootstrapper.jar started by root in /)
    2017-05-04 18:33:09.949  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 18:33:10.113  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 18:33:10 GMT 2017]; root of context hierarchy
    2017-05-04 18:33:11.742  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 18:33:11.762  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 18:33:12.520  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 18:33:12.672  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.21]
    2017-05-04 18:33:12.672  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 18:33:12.685  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 18:33:12.743  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.21]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.21]:5701
    2017-05-04 18:33:12.743  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.21]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 18:33:12.743  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.21]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 18:33:13.296  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.21]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 18:33:14.405  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.100.3.21]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 18:33:14.663  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.21]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 18:33:14.669  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.21]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 18:33:14.690  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.21]:5701 [someGroup] [3.8] [10.100.3.21]:5701 is STARTING
    2017-05-04 18:33:14.725  INFO 5 --- [           main] com.hazelcast.system                     : [10.100.3.21]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 18:33:14.728  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.21]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.21]:5701 - 9a134730-5d12-445b-8bd2-4c471758b3c2 this
    }
    
    2017-05-04 18:33:14.848  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.21]:5701 [someGroup] [3.8] [10.100.3.21]:5701 is STARTED
    2017-05-04 18:33:14.853  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.065 seconds (JVM running for 7.004)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/5516/
Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:334
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.184.167 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zzsdw] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f7fa10 exit status 1 <nil> <nil> true [0xc42000f0b0 0xc42000f0c8 0xc42000f0e0] [0xc42000f0b0 0xc42000f0c8 0xc42000f0e0] [0xc42000f0c0 0xc42000f0d8] [0x182d7e0 0x182d7e0] 0xc4214b3c20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.184.167 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-zzsdw] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f7fa10 exit status 1 <nil> <nil> true [0xc42000f0b0 0xc42000f0c8 0xc42000f0e0] [0xc42000f0b0 0xc42000f0c8 0xc42000f0e0] [0xc42000f0c0 0xc42000f0d8] [0x182d7e0 0x182d7e0] 0xc4214b3c20 <nil>}:
    Command stdout:
    
    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
    
    error:
    exit status 1
    
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2102

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:572
Expected error:
    <*errors.errorString | 0xc420315b90>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-05-04 19:04:59.508  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-8g1gj with PID 6 (/bootstrapper.jar started by root in /)\n2017-05-04 19:04:59.518  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-05-04 19:04:59.621  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 19:04:59 GMT 2017]; root of context hierarchy\n2017-05-04 19:05:01.290  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-05-04 19:05:01.309  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-05-04 19:05:02.136  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-05-04 19:05:02.450  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.7]\n2017-05-04 19:05:02.453  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.\n2017-05-04 19:05:02.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-05-04 19:05:02.522  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.7]:5701\n2017-05-04 19:05:02.525  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.\n2017-05-04 19:05:02.526  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1\n2017-05-04 19:05:03.074  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.7]:5701 [someGroup] [3.8] Backpressure is disabled\n2017-05-04 19:05:04.151  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.7]:5701 [someGroup] [3.8] Creating TcpIpJoiner\n2017-05-04 19:05:04.472  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.7]:5701 [someGroup] [3.8] Starting 2 partition threads\n2017-05-04 19:05:04.478  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.7]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-05-04 19:05:04.502  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.7]:5701 [someGroup] [3.8] [10.100.3.7]:5701 is STARTING\n2017-05-04 19:05:04.546  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Cluster version set to 3.8\n2017-05-04 19:05:04.550  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.7]:5701 [someGroup] [3.8] \n\n\nMembers [1] {\n\tMember [10.100.3.7]:5701 - 8616c8b9-0e50-498f-924d-4c9ea7b5072d this\n}\n\n2017-05-04 19:05:04.629  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.7]:5701 [someGroup] [3.8] [10.100.3.7]:5701 is STARTED\n2017-05-04 19:05:04.639  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.046 seconds (JVM running for 7.031)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-05-04 19:04:59.508  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-4022318224-8g1gj with PID 6 (/bootstrapper.jar started by root in /)
    2017-05-04 19:04:59.518  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-05-04 19:04:59.621  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu May 04 19:04:59 GMT 2017]; root of context hierarchy
    2017-05-04 19:05:01.290  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-05-04 19:05:01.309  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-05-04 19:05:02.136  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-05-04 19:05:02.450  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.100.3.7]
    2017-05-04 19:05:02.453  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Prefer IPv4 stack is true.
    2017-05-04 19:05:02.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.8] Picked [10.100.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-05-04 19:05:02.522  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Hazelcast 3.8 (20170217 - d7998b4) starting at [10.100.3.7]:5701
    2017-05-04 19:05:02.525  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
    2017-05-04 19:05:02.526  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Configured Hazelcast Serialization version : 1
    2017-05-04 19:05:03.074  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.100.3.7]:5701 [someGroup] [3.8] Backpressure is disabled
    2017-05-04 19:05:04.151  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.100.3.7]:5701 [someGroup] [3.8] Creating TcpIpJoiner
    2017-05-04 19:05:04.472  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.7]:5701 [someGroup] [3.8] Starting 2 partition threads
    2017-05-04 19:05:04.478  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.100.3.7]:5701 [someGroup] [3.8] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-05-04 19:05:04.502  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.7]:5701 [someGroup] [3.8] [10.100.3.7]:5701 is STARTING
    2017-05-04 19:05:04.546  INFO 6 --- [           main] com.hazelcast.system                     : [10.100.3.7]:5701 [someGroup] [3.8] Cluster version set to 3.8
    2017-05-04 19:05:04.550  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.100.3.7]:5701 [someGroup] [3.8] 
    
    
    Members [1] {
    	Member [10.100.3.7]:5701 - 8616c8b9-0e50-498f-924d-4c9ea7b5072d this
    }
    
    2017-05-04 19:05:04.629  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.100.3.7]:5701 [someGroup] [3.8] [10.100.3.7]:5701 is STARTED
    2017-05-04 19:05:04.639  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.046 seconds (JVM running for 7.031)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:570

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:262
Expected error:
    <*errors.errorString | 0xc421654620>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.100.3.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.100.3.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.100.3.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0zjwf\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  19:20:09 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  19:20:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.8; broadcast_rpc_address=10.100.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0zjwf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  19:20:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  19:20:09 Global memtable on-heap threshold is enabled at 128MB\nINFO  19:20:09 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 19:20:09 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.100.3.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.100.3.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.100.3.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.100.3.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0zjwf
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
    
    INFO  19:20:09 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  19:20:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.100.3.8; broadcast_rpc_address=10.100.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.100.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0zjwf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  19:20:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  19:20:09 Global memtable on-heap threshold is enabled at 128MB
    INFO  19:20:09 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 19:20:09 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    	at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
    	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:251

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc42141e1f0>: {
        s: "Failed to find \"Hello World!\", last result: \"Traceback (most recent call last):\n  File \"client.py\", line 46, in <module>\n    Main()\n  File \"client.py\", line 41, in Main\n    CheckServiceAddress(args.address)\n  File \"client.py\", line 26, in CheckServiceAddress\n    service_address = socket.gethostbyname(hostname)\nsocket.gaierror: [Errno -2] Name or service not known\n\"",
    }
    Failed to find "Hello World!", last result: "Traceback (most recent call last):
      File "client.py", line 46, in <module>
        Main()
      File "client.py", line 41, in Main
        CheckServiceAddress(args.address)
      File "client.py", line 26, in CheckServiceAddress
        service_address = socket.gethostbyname(hostname)
    socket.gaierror: [Errno -2] Name or service not known
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:151

Issues about this test specifically: #36279

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025 #44541

@k8s-github-robot
Copy link
Author

This Issue hasn't been active in 47 days. It will be closed in 42 days (Jun 17, 2017).

cc @k8s-merge-robot @quinton-hoole

You can add 'keep-open' label to prevent this from happening, or add a comment to keep it open another 90 days

@fejta fejta closed this as completed May 13, 2017
@k8s-github-robot k8s-github-robot mentioned this issue May 15, 2017
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/example/cassandra area/example kind/flake Categorizes issue or PR as related to a flaky test.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@calebamiles @fejta @ethernetdan @k8s-github-robot