Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

xds_server_integration_test is flaky #4022

Closed
easwars opened this issue Nov 9, 2020 · 0 comments · Fixed by #4025
Closed

xds_server_integration_test is flaky #4022

easwars opened this issue Nov 9, 2020 · 0 comments · Fixed by #4025
Assignees

Comments

@easwars
Copy link
Contributor

easwars commented Nov 9, 2020

--- FAIL: Test (10.06s)
    --- FAIL: Test/ServerSideXDS (10.06s)
        xds_server_integration_test.go:144: Started xDS management server at 127.0.0.1:36083
        xds_server_integration_test.go:130: Create bootstrap file at /tmp/xds-server-test869123353/bootstrap with contents
            
            		{
            			"node": {
            				"id": "ENVOY_NODE_ID",
            				"metadata": {
            				    "TRAFFICDIRECTOR_GRPC_HOSTNAME": "trafficdirector"
            			    }
            			},
            			"xds_servers" : [{
            				"server_uri": "127.0.0.1:36083",
            				"channel_creds": [
            					{ "type": "insecure" }
            				]
            			}]
            		}
        tlogger.go:99: server.go:145 [xds] [xds-server 0xc0000ba640] Created xds.GRPCServer  (t=+1.157433ms)
        tlogger.go:99: server.go:185 [xds] [xds-server 0xc0000ba640] Serve() called with options: {Network:tcp Address:localhost:9999}  (t=+1.381139ms)
        tlogger.go:99: bootstrap.go:136 [xds] [xds-bootstrap] Got bootstrap file location "/tmp/xds-server-test869123353/bootstrap"  (t=+1.438441ms)
        tlogger.go:99: bootstrap.go:252 [xds] [xds-bootstrap] Bootstrap config for creating xds-client: &{BalancerName:127.0.0.1:36083 Creds:0xc000120420 TransportAPI:0 NodeProto:id:"ENVOY_NODE_ID" metadata:{fields:{key:"TRAFFICDIRECTOR_GRPC_HOSTNAME" value:{string_value:"trafficdirector"}}} build_version:"gRPC Go 1.34.0-dev" user_agent_name:"gRPC Go" user_agent_version:"1.34.0-dev" client_features:"envoy.lb.does_not_support_overprovisioning" CertProviderConfigs:map[]}  (t=+2.282064ms)
        tlogger.go:99: clientconn.go:238 [core] parsed scheme: ""  (t=+2.362367ms)
        tlogger.go:99: clientconn.go:244 [core] scheme "" not registered, fallback to default scheme  (t=+2.413968ms)
        tlogger.go:99: resolver_conn_wrapper.go:143 [core] ccResolverWrapper: sending update to cc: {[{127.0.0.1:36083  <nil> 0 <nil>}] <nil> <nil>}  (t=+2.48587ms)
        tlogger.go:99: clientconn.go:678 [core] ClientConn switching balancer to "pick_first"  (t=+2.537972ms)
        tlogger.go:99: clientconn.go:693 [core] Channel switches to new LB policy "pick_first"  (t=+2.587273ms)
        tlogger.go:99: clientconn.go:1077 [core] Subchannel Connectivity change to CONNECTING  (t=+2.802779ms)
        tlogger.go:99: client.go:408 [xds] [xds-client 0xc000148700] Created ClientConn to xDS server: 127.0.0.1:36083  (t=+3.004685ms)
        tlogger.go:99: client.go:420 [xds] [xds-client 0xc000148700] Created  (t=+3.18789ms)
        tlogger.go:99: server.go:175 [xds] [xds-server 0xc0000ba640] Created an xdsClient  (t=+3.358095ms)
        tlogger.go:99: clientconn.go:417 [core] Channel Connectivity change to CONNECTING  (t=+4.010313ms)
        tlogger.go:99: clientconn.go:1214 [core] Subchannel picks a new address "127.0.0.1:36083" to connect  (t=+4.124716ms)
        tlogger.go:99: clientconn.go:1077 [core] Subchannel Connectivity change to READY  (t=+6.541484ms)
        tlogger.go:99: clientconn.go:417 [core] Channel Connectivity change to READY  (t=+6.623286ms)
        tlogger.go:99: transport_helper.go:208 [xds] [xds-client 0xc000148700] ADS stream created  (t=+6.858493ms)
        tlogger.go:99: client.go:145 [xds] [xds-client 0xc000148700] ADS response received, type: type.googleapis.com/envoy.api.v2.Listener  (t=+8.019325ms)
        tlogger.go:99: client_xds.go:55 [xds] [xds-client 0xc000148700] Resource with name: grpc/server?udpa.resource.listening_address=localhost:9999, type: *envoy_config_listener_v3.Listener, contains: name:"grpc/server?udpa.resource.listening_address=localhost:9999" api_listener:{api_listener:{type_url:"type.googleapis.com/envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager" value:"\x1a\x12\n\x02\x1a\x00\x12\x0croute-config"}}  (t=+8.283333ms)
        tlogger.go:99: client_xds.go:80 [xds] [xds-client 0xc000148700] Resource with type *envoy_extensions_filters_network_http_connection_manager_v3.HttpConnectionManager, contains rds:{config_source:{ads:{}} route_config_name:"route-config"}  (t=+8.651543ms)
        tlogger.go:99: transport_helper.go:340 [xds] [xds-client 0xc000148700] Sending ACK for response type: ListenerResource, version: , nonce:   (t=+8.725145ms)
        tlogger.go:99: server.go:219 [xds] [xds-server 0xc0000ba640] Started a net.Listener on 127.0.0.1:9999  (t=+8.985352ms)
        tlogger.go:99: server.go:252 [xds] [xds-server 0xc0000ba640] Watch started on resource name grpc/server?udpa.resource.listening_address=localhost:9999  (t=+9.058954ms)
        tlogger.go:99: clientconn.go:238 [core] parsed scheme: ""  (t=+9.556668ms)
        tlogger.go:99: clientconn.go:244 [core] scheme "" not registered, fallback to default scheme  (t=+9.61087ms)
        tlogger.go:99: resolver_conn_wrapper.go:143 [core] ccResolverWrapper: sending update to cc: {[{localhost:9999  <nil> 0 <nil>}] <nil> <nil>}  (t=+9.689272ms)
        tlogger.go:99: clientconn.go:678 [core] ClientConn switching balancer to "pick_first"  (t=+9.744374ms)
        tlogger.go:99: clientconn.go:693 [core] Channel switches to new LB policy "pick_first"  (t=+10.978008ms)
        tlogger.go:99: clientconn.go:1077 [core] Subchannel Connectivity change to CONNECTING  (t=+11.196514ms)
        tlogger.go:99: picker_wrapper.go:161 [core] blockingPicker: the picked transport is not ready, loop back to repick  (t=+11.41392ms)
        tlogger.go:99: clientconn.go:1214 [core] Subchannel picks a new address "localhost:9999" to connect  (t=+11.490423ms)
        tlogger.go:99: clientconn.go:417 [core] Channel Connectivity change to CONNECTING  (t=+11.76043ms)
        tlogger.go:99: clientconn.go:417 [core] Channel Connectivity change to SHUTDOWN  (t=+10.005150247s)
        tlogger.go:99: clientconn.go:1077 [core] Subchannel Connectivity change to SHUTDOWN  (t=+10.00524245s)
        tlogger.go:99: clientconn.go:417 [core] Channel Connectivity change to SHUTDOWN  (t=+10.005367153s)
        tlogger.go:99: clientconn.go:1077 [core] Subchannel Connectivity change to SHUTDOWN  (t=+10.005441055s)
        tlogger.go:99: client.go:463 [xds] [xds-client 0xc000148700] Shutdown  (t=+10.005510457s)
        tlogger.go:99: server.go:255 [xds] [xds-server 0xc0000ba640] Watch cancelled on resource name grpc/server?udpa.resource.listening_address=localhost:9999  (t=+10.005841266s)
        xds_server_integration_test.go:183: rpc EmptyCall() failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded
        tlogger.go:99: transport_helper.go:315 [xds] [xds-client 0xc000148700] ADS stream is closed with error: xds: stream.Recv() failed: rpc error: code = Canceled desc = grpc: the client connection is closing  (t=+10.006032572s)
FAIL
FAIL	google.golang.org/grpc/xds/internal/test	10.338s
ok  	google.golang.org/grpc/xds/internal/testutils	0.077s
?   	google.golang.org/grpc/xds/internal/testutils/fakeclient	[no test files]
?   	google.golang.org/grpc/xds/internal/testutils/fakeserver	[no test files]
?   	google.golang.org/grpc/xds/internal/version	[no test files]
FAIL
@easwars easwars self-assigned this Nov 9, 2020
@github-actions github-actions bot locked as resolved and limited conversation to collaborators May 25, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant