Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

No data in skywalking-ui #3589

Closed
DarthRevanXX opened this issue Oct 10, 2019 · 16 comments
Closed

No data in skywalking-ui #3589

DarthRevanXX opened this issue Oct 10, 2019 · 16 comments
Assignees
@hanahmily
Labels
bug Something isn't working and you are sure it's a bug!
Milestone
6.5.0

Comments

@DarthRevanXX
Copy link

DarthRevanXX commented Oct 10, 2019 •
edited

Question

Using 6.1.0 skywalkingand 1.3.4 Istio. Went trough this guide: https://github.com/apache/skywalking/blob/v6.1.0/docs/en/setup/istio/README.md. Deployed book app application. Can see working application and jaeger traces, but skywalking-ui without any data. Do I need configure something more to see data in skywalking-ui or in the guide there missing step where I need to configure istio metrics go to the skywalking backend(assumption)?
@wu-sheng
Copy link
Member

For Istio metrics, you need set the mixer bypass adaptor and target to us. Or try our ALS solution.

@wu-sheng
Copy link
Member

For ALS solution.
https://github.com/apache/skywalking/blob/master/docs/en/setup/envoy/als_setting.md

@wu-sheng wu-sheng added the question End user question and discussion. label Oct 10, 2019
@wu-sheng
Copy link
Member

For jaeger, you need to make sure

  1. Jeager receiver is active, https://github.com/apache/skywalking-docker/tree/master/6/6.4/oap#xxx_enabled, ES connected.
  2. Jeager agent is required to forward spans to skywalking backend.

@DarthRevanXX
Copy link
Author

Tried approach with istio mixer applied 3 yaml files but can't see any data in skywalking-ui, will try ALS solution.

@wu-sheng
Copy link
Member

Check the istio mixer, I remember they say they will set it close by default someday, but am not sure when .

@wu-sheng wu-sheng added this to the 6.5.0 milestone Oct 10, 2019
@DarthRevanXX
Copy link
Author

Mixer logs:
`kubectl -n istio-system logs -l app=telemetry -c mixer

gc 1847 @19617.610s 0%: 0.043+22+0.035 ms clock, 0.17+1.9/28/17+0.14 ms cpu, 16->16->8 MB, 17 MB goal, 6 P
2019-10-11T01:28:44.153821Z warn grpcAdapter unable to connect to:/metric.HandleMetricService/HandleMetric, oap.skywalking.svc.cluster.local:11800
{"level":"info","time":"2019-10-11T01:28:43.143390Z","instance":"accesslog.instance.istio-system","apiClaims":"","apiKey":"","clientTraceId":"","connection_security_policy":"none","destinationApp":"telemetry","destinationIp":"10.1.3.13","destinationName":"istio-telemetry-7c88764b9c-fncph","destinationNamespace":"istio-system","destinationOwner":"kubernetes://apis/apps/v1/namespaces/istio-system/deployments/istio-telemetry","destinationPrincipal":"","destinationServiceHost":"istio-telemetry.istio-system.svc.cluster.local","destinationWorkload":"istio-telemetry","grpcMessage":"3 errors occurred:%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%0A","grpcStatus":"2","httpAuthority":"mixer","latency":"6.5979ms","method":"POST","permissiveResponseCode":"none","permissiveResponsePolicyID":"none","protocol":"http","receivedBytes":1317,"referer":"","reporter":"destination","requestId":"b45592ff-0c49-49fd-af64-3c9229b60466","requestSize":931,"requestedServerName":"","responseCode":200,"responseFlags":"-","responseSize":0,"responseTimestamp":"2019-10-11T01:28:43.149845Z","sentBytes":421,"sourceApp":"elasticsearch","sourceIp":"10.1.3.36","sourceName":"skywalking-elasticsearch-data-1","sourceNamespace":"default","sourceOwner":"kubernetes://apis/apps/v1/namespaces/default/statefulsets/skywalking-elasticsearch-data","sourcePrincipal":"","sourceWorkload":"skywalking-elasticsearch-data","url":"/istio.mixer.v1.Mixer/Report","userAgent":"","xForwardedFor":"10.1.3.36"}
{"level":"info","time":"2019-10-11T01:28:43.913917Z","instance":"accesslog.instance.istio-system","apiClaims":"","apiKey":"","clientTraceId":"","connection_security_policy":"none","destinationApp":"telemetry","destinationIp":"10.1.3.13","destinationName":"istio-telemetry-7c88764b9c-fncph","destinationNamespace":"istio-system","destinationOwner":"kubernetes://apis/apps/v1/namespaces/istio-system/deployments/istio-telemetry","destinationPrincipal":"","destinationServiceHost":"istio-telemetry.istio-system.svc.cluster.local","destinationWorkload":"istio-telemetry","grpcMessage":"1 error occurred:%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%0A","grpcStatus":"2","httpAuthority":"mixer","latency":"13.906ms","method":"POST","permissiveResponseCode":"none","permissiveResponsePolicyID":"none","protocol":"http","receivedBytes":698,"referer":"","reporter":"destination","requestId":"ff7ae8af-f279-46b3-ae86-bde2b61477dd","requestSize":312,"requestedServerName":"","responseCode":200,"responseFlags":"-","responseSize":0,"responseTimestamp":"2019-10-11T01:28:43.927780Z","sentBytes":247,"sourceApp":"elasticsearch","sourceIp":"10.1.3.37","sourceName":"skywalking-elasticsearch-master-2","sourceNamespace":"default","sourceOwner":"kubernetes://apis/apps/v1/namespaces/default/statefulsets/skywalking-elasticsearch-master","sourcePrincipal":"","sourceWorkload":"skywalking-elasticsearch-master","url":"/istio.mixer.v1.Mixer/Report","userAgent":"","xForwardedFor":"10.1.3.37"}
{"level":"info","time":"2019-10-11T01:28:43.913675Z","instance":"accesslog.instance.istio-system","apiClaims":"","apiKey":"","clientTraceId":"","connection_security_policy":"none","destinationApp":"telemetry","destinationIp":"10.1.3.13","destinationName":"istio-telemetry-7c88764b9c-fncph","destinationNamespace":"istio-system","destinationOwner":"kubernetes://apis/apps/v1/namespaces/istio-system/deployments/istio-telemetry","destinationPrincipal":"","destinationServiceHost":"istio-telemetry.istio-system.svc.cluster.local","destinationWorkload":"istio-telemetry","grpcMessage":"8 errors occurred:%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%0A","grpcStatus":"2","httpAuthority":"mixer","latency":"29.8101ms","method":"POST","permissiveResponseCode":"none","permissiveResponsePolicyID":"none","protocol":"http","receivedBytes":2430,"referer":"","reporter":"destination","requestId":"b0eec606-c91e-4193-aba2-39b069b76474","requestSize":2044,"requestedServerName":"","responseCode":200,"responseFlags":"-","responseSize":0,"responseTimestamp":"2019-10-11T01:28:43.943383Z","sentBytes":857,"sourceApp":"elasticsearch","sourceIp":"10.1.3.37","sourceName":"skywalking-elasticsearch-master-2","sourceNamespace":"default","sourceOwner":"kubernetes://apis/apps/v1/namespaces/default/statefulsets/skywalking-elasticsearch-master","sourcePrincipal":"","sourceWorkload":"skywalking-elasticsearch-master","url":"/istio.mixer.v1.Mixer/Report","userAgent":"","xForwardedFor":"10.1.3.37"}
2019-10-11T01:28:44.154193Z error api Report failed: 1 error occurred:
* rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp: lookup oap.skywalking.svc.cluster.local on 10.96.0.10:53: no such host"`

Istio's policy:
kubectl -n istio-system logs -l app=policy -c mixer GC forced gc 181 @20366.930s 0%: 3.9+19+0.030 ms clock, 15+0/30/67+0.12 ms cpu, 13->13->7 MB, 15 MB goal, 6 P scvg135: 0 MB released scvg135: inuse: 15, idle: 43, sys: 58, released: 3, consumed: 55 (MB) 2019-10-11T01:42:28.493381Z info base.baseBalancer: handle SubConn state change: 0xc0011280a0, CONNECTING 2019-10-11T01:42:28.493442Z info roundrobinPicker: newPicker called with readySCs: map[] 2019-10-11T01:42:28.577142Z info grpc: addrConn.createTransport failed to connect to {oap.skywalking.svc.cluster.local:11800 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp: lookup oap.skywalking.svc.cluster.local on 10.96.0.10:53: no such host". Reconnecting... 2019-10-11T01:42:28.577256Z info base.baseBalancer: handle SubConn state change: 0xc0011280a0, TRANSIENT_FAILURE GC forced gc 182 @20486.971s 0%: 0.13+13+0.056 ms clock, 0.55+0/13/26+0.22 ms cpu, 13->13->7 MB, 15 MB goal, 6 P

@wu-sheng
Copy link
Member

Look like a value key changed inside Istio mixer?

@DarthRevanXX
Copy link
Author

DarthRevanXX commented Oct 16, 2019 •
edited

Still not working, before was problem with namespace, logs from mixer policy:

GC forced
gc 58 @5234.232s 0%: 0.036+15+0.027 ms clock, 0.14+0/15/43+0.10 ms cpu, 14->14->8 MB, 16 MB goal, 6 P
scvg34: inuse: 15, idle: 42, sys: 57, released: 36, consumed: 20 (MB)
GC forced
gc 59 @5354.256s 0%: 0.046+12+0.11 ms clock, 0.18+0/11/38+0.45 ms cpu, 14->14->8 MB, 16 MB goal, 6 P
scvg35: 0 MB released
scvg35: inuse: 16, idle: 40, sys: 57, released: 37, consumed: 20 (MB)
GC forced
gc 60 @5474.273s 0%: 0.038+14+0.026 ms clock, 0.15+0/17/20+0.10 ms cpu, 13->13->8 MB, 16 MB goal, 6 P```

Logs from mixer telemetry:
```{"level":"info","time":"2019-10-16T07:26:57.421700Z","instance":"accesslog.instance.istio-system","apiClaims":"","apiKey":"","clientTraceId":"","connection_security_policy":"none","destinationApp":"telemetry","destinationIp":"10.1.3.181","destinationName":"istio-telemetry-79c5f6759-xtjrj","destinationNamespace":"istio-system","destinationOwner":"kubernetes://apis/apps/v1/namespaces/istio-system/deployments/istio-telemetry","destinationPrincipal":"","destinationServiceHost":"istio-telemetry.istio-system.svc.cluster.local","destinationWorkload":"istio-telemetry","grpcMessage":"4 errors occurred:%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%0A","grpcStatus":"2","httpAuthority":"mixer","latency":"10.4424ms","method":"POST","permissiveResponseCode":"none","permissiveResponsePolicyID":"none","protocol":"http","receivedBytes":1390,"referer":"","reporter":"destination","requestId":"adaaa808-8cf4-4c0d-9748-28406ab2fe64","requestSize":1003,"requestedServerName":"","responseCode":200,"responseFlags":"-","responseSize":0,"responseTimestamp":"2019-10-16T07:26:57.431163Z","sentBytes":508,"sourceApp":"elasticsearch","sourceIp":"10.1.3.199","sourceName":"my-release-elasticsearch-master-0","sourceNamespace":"default","sourceOwner":"kubernetes://apis/apps/v1/namespaces/default/statefulsets/my-release-elasticsearch-master","sourcePrincipal":"","sourceWorkload":"my-release-elasticsearch-master","url":"/istio.mixer.v1.Mixer/Report","userAgent":"","xForwardedFor":"10.1.3.199"}
{"level":"info","time":"2019-10-16T07:26:57.472653Z","instance":"accesslog.instance.istio-system","apiClaims":"","apiKey":"","clientTraceId":"","connection_security_policy":"none","destinationApp":"telemetry","destinationIp":"10.1.3.181","destinationName":"istio-telemetry-79c5f6759-xtjrj","destinationNamespace":"istio-system","destinationOwner":"kubernetes://apis/apps/v1/namespaces/istio-system/deployments/istio-telemetry","destinationPrincipal":"","destinationServiceHost":"istio-telemetry.istio-system.svc.cluster.local","destinationWorkload":"istio-telemetry","grpcMessage":"5 errors occurred:%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%09* fieldEncoder: dimensions - fieldEncoder: value - lookup failed: 'response.time'%0A%0A","grpcStatus":"2","httpAuthority":"mixer","latency":"25.2971ms","method":"POST","permissiveResponseCode":"none","permissiveResponsePolicyID":"none","protocol":"http","receivedBytes":1764,"referer":"","reporter":"destination","requestId":"182a89bb-15ca-45a9-8403-607fdef96d9b","requestSize":1377,"requestedServerName":"","responseCode":200,"responseFlags":"-","responseSize":0,"responseTimestamp":"2019-10-16T07:26:57.496962Z","sentBytes":596,"sourceApp":"elasticsearch","sourceIp":"10.1.3.200","sourceName":"my-release-elasticsearch-data-0","sourceNamespace":"default","sourceOwner":"kubernetes://apis/apps/v1/namespaces/default/statefulsets/my-release-elasticsearch-data","sourcePrincipal":"","sourceWorkload":"my-release-elasticsearch-data","url":"/istio.mixer.v1.Mixer/Report","userAgent":"","xForwardedFor":"10.1.3.200"}
2019-10-16T07:26:58.467173Z	warn	grpcAdapter	unable to connect to:/metric.HandleMetricService/HandleMetric, my-release-skywalking-skywalking-oap.default.svc.cluster.local:11800
2019-10-16T07:26:58.467367Z	error	api	Report failed: 1 error occurred:
	* rpc error: code = Unavailable desc = upstream connect error or disconnect/reset before headers. reset reason: connection failure```

Went trough this guide but still getting no data in ui and can't understand why: https://github.com/apache/skywalking/blob/v6.1.0/docs/en/setup/istio/README.md.

HELP PLS

@wu-sheng wu-sheng reopened this Oct 16, 2019
@wu-sheng
Copy link
Member

@hanahmily Please take a look.

@wu-sheng wu-sheng removed this from the 6.5.0 milestone Oct 16, 2019
@DarthRevanXX
Copy link
Author

Logs from skywalking-oap inmy-release-es-init-525dg

2019-10-16 06:18:09,079 - org.elasticsearch.client.RestClient -777880 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/service_relation_server_resp_time_day?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:09,080 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -777881 [main] INFO  [] - table: service_relation_server_resp_time_day does not exist
2019-10-16 06:18:09,080 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -777881 [main] INFO  [] - index service_relation_server_resp_time_day's columnTypeEsMapping builder str: {"type":{"properties":{"entity_id":{"type":"keyword"},"summation":{"type":"long"},"count":{"type":"integer"},"value":{"type":"long"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:12,802 - org.elasticsearch.client.RestClient -781603 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/service_relation_server_resp_time_day?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:12,802 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -781603 [main] INFO  [] - create service_relation_server_resp_time_day index finished, isAcknowledged: true
2019-10-16 06:18:12,830 - org.elasticsearch.client.RestClient -781631 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/service_relation_server_resp_time_month?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:12,830 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -781631 [main] INFO  [] - table: service_relation_server_resp_time_month does not exist
2019-10-16 06:18:12,830 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -781631 [main] INFO  [] - index service_relation_server_resp_time_month's columnTypeEsMapping builder str: {"type":{"properties":{"entity_id":{"type":"keyword"},"summation":{"type":"long"},"count":{"type":"integer"},"value":{"type":"long"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:18,503 - org.elasticsearch.client.RestClient -787304 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/service_relation_server_resp_time_month?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:18,504 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -787305 [main] INFO  [] - create service_relation_server_resp_time_month index finished, isAcknowledged: true
2019-10-16 06:18:18,553 - org.elasticsearch.client.RestClient -787354 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/endpoint_relation_server_side_hour?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:18,553 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -787354 [main] INFO  [] - table: endpoint_relation_server_side_hour does not exist
2019-10-16 06:18:18,554 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -787355 [main] INFO  [] - index endpoint_relation_server_side_hour's columnTypeEsMapping builder str: {"type":{"properties":{"source_endpoint_id":{"type":"integer"},"dest_endpoint_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:21,409 - org.elasticsearch.client.RestClient -790210 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/endpoint_relation_server_side_hour?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:21,411 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -790212 [main] INFO  [] - create endpoint_relation_server_side_hour index finished, isAcknowledged: true
2019-10-16 06:18:21,422 - org.elasticsearch.client.RestClient -790223 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/endpoint_relation_server_side_day?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:21,423 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -790224 [main] INFO  [] - table: endpoint_relation_server_side_day does not exist
2019-10-16 06:18:21,424 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -790225 [main] INFO  [] - index endpoint_relation_server_side_day's columnTypeEsMapping builder str: {"type":{"properties":{"source_endpoint_id":{"type":"integer"},"dest_endpoint_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:24,642 - org.elasticsearch.client.RestClient -793443 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/endpoint_relation_server_side_day?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:24,643 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -793444 [main] INFO  [] - create endpoint_relation_server_side_day index finished, isAcknowledged: true
2019-10-16 06:18:24,667 - org.elasticsearch.client.RestClient -793468 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/endpoint_relation_server_side_month?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:24,673 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -793474 [main] INFO  [] - table: endpoint_relation_server_side_month does not exist
2019-10-16 06:18:24,674 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -793475 [main] INFO  [] - index endpoint_relation_server_side_month's columnTypeEsMapping builder str: {"type":{"properties":{"source_endpoint_id":{"type":"integer"},"dest_endpoint_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:27,223 - org.elasticsearch.client.RestClient -796024 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/endpoint_relation_server_side_month?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:27,223 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -796024 [main] INFO  [] - create endpoint_relation_server_side_month index finished, isAcknowledged: true
2019-10-16 06:18:27,229 - org.elasticsearch.client.RestClient -796030 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/service_relation_client_side_hour?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:27,230 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -796031 [main] INFO  [] - table: service_relation_client_side_hour does not exist
2019-10-16 06:18:27,230 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -796031 [main] INFO  [] - index service_relation_client_side_hour's columnTypeEsMapping builder str: {"type":{"properties":{"source_service_id":{"type":"integer"},"dest_service_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:30,745 - org.elasticsearch.client.RestClient -799546 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/service_relation_client_side_hour?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:30,748 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -799549 [main] INFO  [] - create service_relation_client_side_hour index finished, isAcknowledged: true
2019-10-16 06:18:30,772 - org.elasticsearch.client.RestClient -799573 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/service_relation_client_side_day?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:30,772 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -799573 [main] INFO  [] - table: service_relation_client_side_day does not exist
2019-10-16 06:18:30,773 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -799574 [main] INFO  [] - index service_relation_client_side_day's columnTypeEsMapping builder str: {"type":{"properties":{"source_service_id":{"type":"integer"},"dest_service_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:32,819 - org.elasticsearch.client.RestClient -801620 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/service_relation_client_side_day?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:32,820 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -801621 [main] INFO  [] - create service_relation_client_side_day index finished, isAcknowledged: true
2019-10-16 06:18:32,840 - org.elasticsearch.client.RestClient -801641 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/service_relation_client_side_month?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:32,849 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -801650 [main] INFO  [] - table: service_relation_client_side_month does not exist
2019-10-16 06:18:32,849 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -801650 [main] INFO  [] - index service_relation_client_side_month's columnTypeEsMapping builder str: {"type":{"properties":{"source_service_id":{"type":"integer"},"dest_service_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:35,921 - org.elasticsearch.client.RestClient -804722 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/service_relation_client_side_month?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:35,922 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -804723 [main] INFO  [] - create service_relation_client_side_month index finished, isAcknowledged: true
2019-10-16 06:18:35,949 - org.elasticsearch.client.RestClient -804750 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/service_relation_server_side_hour?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:35,949 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -804750 [main] INFO  [] - table: service_relation_server_side_hour does not exist
2019-10-16 06:18:35,949 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -804750 [main] INFO  [] - index service_relation_server_side_hour's columnTypeEsMapping builder str: {"type":{"properties":{"source_service_id":{"type":"integer"},"dest_service_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:38,867 - org.elasticsearch.client.RestClient -807668 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/service_relation_server_side_hour?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:38,867 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -807668 [main] INFO  [] - create service_relation_server_side_hour index finished, isAcknowledged: true
2019-10-16 06:18:38,880 - org.elasticsearch.client.RestClient -807681 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/service_relation_server_side_day?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:38,880 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -807681 [main] INFO  [] - table: service_relation_server_side_day does not exist
2019-10-16 06:18:38,880 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -807681 [main] INFO  [] - index service_relation_server_side_day's columnTypeEsMapping builder str: {"type":{"properties":{"source_service_id":{"type":"integer"},"dest_service_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:18:54,856 - org.elasticsearch.client.RestClient -823657 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/service_relation_server_side_day?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:18:54,856 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -823657 [main] INFO  [] - create service_relation_server_side_day index finished, isAcknowledged: true
2019-10-16 06:18:54,891 - org.elasticsearch.client.RestClient -823692 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/service_relation_server_side_month?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:18:54,891 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -823692 [main] INFO  [] - table: service_relation_server_side_month does not exist
2019-10-16 06:18:54,891 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -823692 [main] INFO  [] - index service_relation_server_side_month's columnTypeEsMapping builder str: {"type":{"properties":{"source_service_id":{"type":"integer"},"dest_service_id":{"type":"integer"},"component_id":{"type":"integer"},"entity_id":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:19:19,051 - org.elasticsearch.client.RestClient -847852 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/service_relation_server_side_month?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:19:19,053 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -847854 [main] INFO  [] - create service_relation_server_side_month index finished, isAcknowledged: true
2019-10-16 06:19:19,172 - org.elasticsearch.client.RestClient -847973 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/alarm_record?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:19:19,174 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -847975 [main] INFO  [] - table: alarm_record does not exist
2019-10-16 06:19:19,175 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -847976 [main] INFO  [] - index alarm_record's columnTypeEsMapping builder str: {"type":{"properties":{"scope":{"type":"integer"},"name":{"type":"keyword"},"id0":{"type":"integer"},"id1":{"type":"integer"},"start_time":{"type":"long"},"alarm_message":{"type":"keyword","copy_to":"alarm_message_match"},"alarm_message_match":{"type":"text","analyzer":"oap_analyzer"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:19:25,012 - org.elasticsearch.client.RestClient -853813 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/alarm_record?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:19:25,013 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -853814 [main] INFO  [] - create alarm_record index finished, isAcknowledged: true
2019-10-16 06:19:25,022 - org.elasticsearch.client.RestClient -853823 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/all_heatmap?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:19:25,023 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -853824 [main] INFO  [] - table: all_heatmap does not exist
2019-10-16 06:19:25,023 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -853824 [main] INFO  [] - index all_heatmap's columnTypeEsMapping builder str: {"type":{"properties":{"step":{"type":"integer"},"num_of_steps":{"type":"integer"},"detail_group":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:19:30,720 - org.elasticsearch.client.RestClient -859521 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/all_heatmap?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:19:30,742 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -859543 [main] INFO  [] - create all_heatmap index finished, isAcknowledged: true
2019-10-16 06:19:30,786 - org.elasticsearch.client.RestClient -859587 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/all_p50?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:19:30,788 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -859589 [main] INFO  [] - table: all_p50 does not exist
2019-10-16 06:19:30,789 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -859590 [main] INFO  [] - index all_p50's columnTypeEsMapping builder str: {"type":{"properties":{"value":{"type":"integer"},"precision":{"type":"integer"},"detail_group":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:19:36,173 - org.elasticsearch.client.RestClient -864974 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/all_p50?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:19:36,175 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -864976 [main] INFO  [] - create all_p50 index finished, isAcknowledged: true
2019-10-16 06:19:36,182 - org.elasticsearch.client.RestClient -864983 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/all_p75?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:19:36,182 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -864983 [main] INFO  [] - table: all_p75 does not exist
2019-10-16 06:19:36,182 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -864983 [main] INFO  [] - index all_p75's columnTypeEsMapping builder str: {"type":{"properties":{"value":{"type":"integer"},"precision":{"type":"integer"},"detail_group":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:19:41,165 - org.elasticsearch.client.RestClient -869966 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/all_p75?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:19:41,166 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -869967 [main] INFO  [] - create all_p75 index finished, isAcknowledged: true
2019-10-16 06:19:41,176 - org.elasticsearch.client.RestClient -869977 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/all_p90?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:19:41,179 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -869980 [main] INFO  [] - table: all_p90 does not exist
2019-10-16 06:19:41,179 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -869980 [main] INFO  [] - index all_p90's columnTypeEsMapping builder str: {"type":{"properties":{"value":{"type":"integer"},"precision":{"type":"integer"},"detail_group":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:20:04,895 - org.elasticsearch.client.RestClient -893696 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/all_p90?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:20:04,896 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -893697 [main] INFO  [] - create all_p90 index finished, isAcknowledged: true
2019-10-16 06:20:05,094 - org.elasticsearch.client.RestClient -893895 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/all_p95?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:20:05,094 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -893895 [main] INFO  [] - table: all_p95 does not exist
2019-10-16 06:20:05,094 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -893895 [main] INFO  [] - index all_p95's columnTypeEsMapping builder str: {"type":{"properties":{"value":{"type":"integer"},"precision":{"type":"integer"},"detail_group":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:20:31,348 - org.elasticsearch.client.RestClient -920149 [I/O dispatcher 1] WARN  [] - request [PUT http://my-release-elasticsearch-client:9200/all_p95?master_timeout=30s&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]
2019-10-16 06:20:31,348 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -920149 [main] INFO  [] - create all_p95 index finished, isAcknowledged: true
2019-10-16 06:20:32,087 - org.elasticsearch.client.RestClient -920888 [I/O dispatcher 1] WARN  [] - request [HEAD http://my-release-elasticsearch-client:9200/all_p99?ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true] returned 1 warnings: [299 Elasticsearch-6.7.0-8453f77 "[types removal] The parameter include_type_name should be explicitly specified in get indices requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', which means responses will omit the type name in mapping definitions."]
2019-10-16 06:20:32,088 - org.apache.skywalking.oap.server.core.storage.model.ModelInstaller -920889 [main] INFO  [] - table: all_p99 does not exist
2019-10-16 06:20:32,088 - org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller -920889 [main] INFO  [] - index all_p99's columnTypeEsMapping builder str: {"type":{"properties":{"value":{"type":"integer"},"precision":{"type":"integer"},"detail_group":{"type":"keyword"},"time_bucket":{"type":"long"}}}}
2019-10-16 06:21:02,093 - org.apache.skywalking.oap.server.starter.OAPServerStartUp -950894 [main] ERROR [] - listener timeout after waiting for [30000] ms
org.apache.skywalking.oap.server.library.module.ModuleStartException: listener timeout after waiting for [30000] ms
	at org.apache.skywalking.oap.server.storage.plugin.elasticsearch.StorageModuleElasticsearchProvider.start(StorageModuleElasticsearchProvider.java:137) ~[storage-elasticsearch-plugin-6.1.0.jar:6.1.0]
	at org.apache.skywalking.oap.server.library.module.BootstrapFlow.start(BootstrapFlow.java:57) ~[library-module-6.1.0.jar:6.1.0]
	at org.apache.skywalking.oap.server.library.module.ModuleManager.init(ModuleManager.java:65) ~[library-module-6.1.0.jar:6.1.0]
	at org.apache.skywalking.oap.server.starter.OAPServerStartUp.main(OAPServerStartUp.java:43) [server-starter-6.1.0.jar:6.1.0]
Caused by: org.apache.skywalking.oap.server.core.storage.StorageException: listener timeout after waiting for [30000] ms
	at org.apache.skywalking.oap.server.storage.plugin.elasticsearch.base.StorageEsInstaller.createTable(StorageEsInstaller.java:84) ~[storage-elasticsearch-plugin-6.1.0.jar:6.1.0]
	at org.apache.skywalking.oap.server.core.storage.model.ModelInstaller.install(ModelInstaller.java:79) ~[server-core-6.1.0.jar:6.1.0]
	at org.apache.skywalking.oap.server.storage.plugin.elasticsearch.StorageModuleElasticsearchProvider.start(StorageModuleElasticsearchProvider.java:132) ~[storage-elasticsearch-plugin-6.1.0.jar:6.1.0]
	... 3 more

have error in my-release-es-init-525dg
assume problem with mapping in elasticsearch
https://www.elastic.co/guide/en/elasticsearch/reference/7.x/removal-of-types.html

@hanahmily
Copy link
Contributor

I figure it out.
image

What I did:

  1. I selected https://github.com/apache/skywalking-kubernetes/tree/master/helm-chart/helm3/6.4.0 to install skywalking backend.

  2. apply https://github.com/istio/istio/blob/1.3.3/mixer/template/metric/template.yaml to install metric template

  3. apply https://github.com/apache/skywalking-kubernetes/blob/master/archive/6/6.0.0-GA/istio/02-skywalingadapter.yml and https://github.com/apache/skywalking-kubernetes/blob/master/archive/6/6.0.0-GA/istio/03-operator_cfg.yml to install skywalking adapter.

@DarthRevanXX skywalking only supports elasticsearch 6.x.
@wu-sheng istio updated metric template, I will send PR to update docs

@wu-sheng
Copy link
Member

Cool, thanks for helping.

@wu-sheng wu-sheng added bug Something isn't working and you are sure it's a bug! and removed question End user question and discussion. labels Oct 17, 2019
@wu-sheng wu-sheng added this to the 6.5.0 milestone Oct 17, 2019
@hanahmily hanahmily mentioned this issue Oct 17, 2019
Merged
3 tasks
@wu-sheng
Copy link
Member

@DarthRevanXX Read the new doc, #3646. I think it is already very simple there.

@justmine66
Copy link

justmine66 commented Feb 10, 2020 •
edited

tcp: lookup oap.skywalking.svc.cluster.local
apiVersion: config.istio.io/v1alpha2
kind: handler
metadata:
name: swhandler
namespace: istio-system
spec:
adapter: swadapter
connection:
address: "[skywalking deployment name].[k8s namespace].svc.cluster.local:11800"
I have the same problem, and then correct the address.
now solved, use the latest release but also have blow problem:

2020-02-10T08:01:14.432025Z info Publishing 27 events
2020-02-10T08:01:14.448251Z info Built new config.Snapshot: id='6660'
2020-02-10T08:01:14.454051Z info Cleaning up handler table, with config ID:6659
2020-02-10T08:06:13.439379Z error mcp Error receiving MCP resource: rpc error: code = Internal desc = stream terminated by RST_STREAM with error code: NO_ERROR
2020-02-10T08:06:13.439446Z error mcp Error receiving MCP response: rpc error: code = Internal desc = stream terminated by RST_STREAM with error code: NO_ERROR
2020-02-10T08:06:14.439571Z info mcp (re)trying to establish new MCP sink stream
2020-02-10T08:06:14.439716Z info mcp New MCP sink stream created
2020-02-10T08:06:15.459747Z info Publishing 27 events
2020-02-10T08:06:15.474697Z info Built new config.Snapshot: id='6661'
2020-02-10T08:06:15.479202Z info Cleaning up handler table, with config ID:6660

Still no data in skywalking-ui
My istio version is 1.4.3
@wu-sheng @hanahmily

@luckymrwang
Copy link

luckymrwang commented Dec 23, 2020 •
edited

For ALS solution.
https://github.com/apache/skywalking/blob/master/docs/en/setup/envoy/als_setting.md

@wu-sheng 吴老师您好，请问以ALS的方式，istio版本至少是多少，1.5版本兼容吗？

@wu-sheng
Copy link
Member

Read the en blog on website, there is a step by step guide.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hanahmily hanahmily

Labels
bug Something isn't working and you are sure it's a bug!
Projects
None yet
Milestone
6.5.0
Development

No branches or pull requests
5 participants
@hanahmily @wu-sheng @luckymrwang @justmine66 @DarthRevanXX