Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Embedded broker is not able to finish #3878

Closed
sdorokhova opened this issue Feb 19, 2020 · 2 comments
Closed

Embedded broker is not able to finish #3878

sdorokhova opened this issue Feb 19, 2020 · 2 comments
Labels
kind/bug Categorizes an issue or PR as a bug

Comments

@sdorokhova
Copy link
Contributor

Describe the bug
When I run Operate integration test, that starts embedded broker, it is not able to finish correctly and the process hangs forever. + I see exception in Console

To Reproduce
Steps to reproduce the behavior:

  1. Clone Operate repository
  2. Update Zeebe version in pom.xml to be 0.23.0-SNAPSHOT
  3. Run Elasticsearch as a docker container locally
  4. Run any integration test, e.g. https://github.com/camunda/camunda-operate/blob/master/qa/integration-tests/src/test/java/org/camunda/operate/it/WorkflowInstanceReaderIT.java#L54

Expected behavior
Test runs and finishes. (does not matter succeeds or fails)

Log/Stacktrace

Full Log + Stacktrace at the end

15:15:52.696 [] [main] INFO  org.springframework.boot.test.mock.web.SpringBootMockServletContext - Initializing Spring TestDispatcherServlet ''
15:15:52.696 [] [main] INFO  org.springframework.test.web.servlet.TestDispatcherServlet - Initializing Servlet ''
15:15:52.715 [] [main] INFO  org.springframework.test.web.servlet.TestDispatcherServlet - Completed initialization in 19 ms
15:15:52.764 [] [main] DEBUG io.zeebe.broker.system - Initializing configuration with base path C:\Users\SVETLA~1\AppData\Local\Temp\90b27a1a-07f5-4ce2-9c22-1e0312643ccb
15:15:52.858 [] [main] WARN  io.zeebe.util.fs - Version is not found in version file.
15:15:52.859 [] [main] INFO  io.zeebe.broker.system - Version: 0.23.0-SNAPSHOT
15:15:52.865 [] [main] INFO  io.zeebe.broker.system - Starting broker 0 with configuration {
  "network": {
    "host": "0.0.0.0",
    "portOffset": 0,
    "maxMessageSize": "4M",
    "commandApi": {
      "defaultPort": 26501,
      "host": "0.0.0.0",
      "port": 25601,
      "advertisedHost": "0.0.0.0",
      "advertisedPort": 25601
    },
    "internalApi": {
      "defaultPort": 26502,
      "host": "0.0.0.0",
      "port": 25602,
      "advertisedHost": "0.0.0.0",
      "advertisedPort": 25602
    },
    "monitoringApi": {
      "defaultPort": 9600,
      "host": "0.0.0.0",
      "port": 25603,
      "advertisedHost": "0.0.0.0",
      "advertisedPort": 25603
    }
  },
  "cluster": {
    "initialContactPoints": [],
    "partitionIds": [
      1,
      2
    ],
    "nodeId": 0,
    "partitionsCount": 2,
    "replicationFactor": 1,
    "clusterSize": 1,
    "clusterName": "zeebe-cluster",
    "gossipFailureTimeout": 10000,
    "gossipInterval": 250,
    "gossipProbeInterval": 1000
  },
  "threads": {
    "cpuThreadCount": 2,
    "ioThreadCount": 2
  },
  "data": {
    "directories": [
      "C:\\Users\\SVETLA~1\\AppData\\Local\\Temp\\90b27a1a-07f5-4ce2-9c22-1e0312643ccb\\data"
    ],
    "logSegmentSize": "512M",
    "snapshotPeriod": "15m",
    "maxSnapshots": 3
  },
  "exporters": [
    {
      "id": "elasticsearch",
      "className": "io.zeebe.exporter.ElasticsearchExporter",
      "args": {
        "index": {
          "prefix": "9d454d4e-8"
        },
        "bulk": {
          "delay": 1.0,
          "size": 1.0
        }
      }
    },
    {
      "id": "test-recorder",
      "className": "io.zeebe.test.util.record.RecordingExporter"
    }
  ],
  "gateway": {
    "enable": true,
    "network": {
      "host": "0.0.0.0",
      "port": 25600,
      "minKeepAliveInterval": "30s"
    },
    "cluster": {
      "contactPoint": "0.0.0.0:25602",
      "maxMessageSize": "4M",
      "requestTimeout": "15s",
      "clusterName": "zeebe-cluster",
      "memberId": "gateway",
      "host": "0.0.0.0",
      "port": 26502
    },
    "threads": {
      "managementThreads": 1
    },
    "monitoring": {
      "enabled": false,
      "host": "0.0.0.0",
      "port": 9600
    },
    "security": {
      "enabled": false
    }
  },
  "backpressure": {
    "enabled": true,
    "useWindowed": true,
    "algorithm": "vegas"
  },
  "stepTimeout": "5m"
}
15:15:52.872 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [1/11]: actor scheduler
15:15:52.874 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [1/11]: actor scheduler started in 1 ms
15:15:52.875 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [2/11]: membership and replication protocol
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.esotericsoftware.kryo.util.UnsafeUtil (file:/C:/Users/SvetlanaDorokhova/.m2/repository/com/esotericsoftware/kryo/4.0.2/kryo-4.0.2.jar) to constructor java.nio.DirectByteBuffer(long,int,java.lang.Object)
WARNING: Please consider reporting this to the maintainers of com.esotericsoftware.kryo.util.UnsafeUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
15:15:55.119 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [2/11]: membership and replication protocol started in 2244 ms
15:15:55.119 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [3/11]: command api transport
15:15:55.815 [] [main] DEBUG io.zeebe.broker.system - Bound command API to 0.0.0.0:25601 
15:15:55.826 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [3/11]: command api transport started in 707 ms
15:15:55.826 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [4/11]: command api handler
15:15:55.871 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [4/11]: command api handler started in 45 ms
15:15:55.871 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [5/11]: subscription api
15:15:55.895 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [5/11]: subscription api started in 23 ms
15:15:55.895 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [6/11]: embedded gateway
15:15:55.901 [] [main] INFO  io.zeebe.gateway - Version: 0.23.0-SNAPSHOT
15:15:55.902 [] [main] INFO  io.zeebe.gateway - Starting gateway with configuration {
  "enable": true,
  "network": {
    "host": "0.0.0.0",
    "port": 25600,
    "minKeepAliveInterval": "30s"
  },
  "cluster": {
    "contactPoint": "0.0.0.0:25602",
    "maxMessageSize": "4M",
    "requestTimeout": "15s",
    "clusterName": "zeebe-cluster",
    "memberId": "gateway",
    "host": "0.0.0.0",
    "port": 26502
  },
  "threads": {
    "managementThreads": 1
  },
  "monitoring": {
    "enabled": false,
    "host": "0.0.0.0",
    "port": 9600
  },
  "security": {
    "enabled": false
  }
}
15:15:56.058 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [6/11]: embedded gateway started in 163 ms
15:15:56.058 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [7/11]: cluster services
15:15:56.600 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [7/11]: cluster services started in 542 ms
15:15:56.600 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [8/11]: topology manager
15:15:56.601 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [8/11]: topology manager started in 1 ms
15:15:56.601 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [9/11]: metric's server
15:15:56.615 [GatewayTopologyManager] [Broker-0-zb-actors-0] DEBUG io.zeebe.gateway - Received metadata change from Broker 0, partitions {} and terms {}.
15:15:56.622 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [9/11]: metric's server started in 21 ms
15:15:56.622 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [10/11]: leader management request handler
15:15:56.624 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [10/11]: leader management request handler started in 2 ms
15:15:56.624 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 [11/11]: zeebe partitions
15:15:56.626 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 partitions [1/2]: partition 2
15:15:56.640 [] [main] DEBUG io.zeebe.broker.exporter - Exporter configured with ElasticsearchExporterConfiguration{url='http://localhost:9200', index=IndexConfiguration{indexPrefix='9d454d4e-8', createTemplate=true, command=false, event=true, rejection=false, error=true, deployment=true, incident=true, job=true, message=false, messageSubscription=false, variable=true, variableDocument=true, workflowInstance=true, workflowInstanceCreation=false, workflowInstanceSubscription=false}, bulk=BulkConfiguration{delay=1, size=1}, authentication=AuthenticationConfiguration{username='null'}}
15:15:56.695 [Broker-0-ZeebePartition-2] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Removing follower partition service for partition PartitionId{id=2, group=raft-partition}
15:15:56.696 [Broker-0-ZeebePartition-2] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Partition role transitioning from null to LEADER
15:15:56.696 [Broker-0-ZeebePartition-2] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Installing leader partition service for partition PartitionId{id=2, group=raft-partition}
15:15:56.905 [Broker-0-ZeebePartition-2] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams.snapshot - Available snapshots: []
15:15:58.024 [Broker-0-ZeebePartition-2] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams.snapshot - Opened database from 'C:\Users\SVETLA~1\AppData\Local\Temp\90b27a1a-07f5-4ce2-9c22-1e0312643ccb\data\raft-partition\partitions\2\runtime'.
15:15:58.104 [Broker-0-LogStream-2] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams - Configured log appender back pressure at partition 2 as AppenderVegasCfg{initialLimit=1024, maxConcurrency=32768, alphaLimit=0.7, betaLimit=0.95}. Window limiting is disabled
15:15:58.122 [Broker-0-StreamProcessor-2] [Broker-0-zb-actors-1] DEBUG io.zeebe.logstreams - Recovering state of partition 2 from snapshot
15:15:58.242 [Broker-0-StreamProcessor-2] [Broker-0-zb-actors-1] INFO  org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.feel.spi.JavaValueMapper@4bd45f9c)), function-provider: org.camunda.feel.interpreter.FunctionProvider$EmptyFunctionProvider$@19f32b18]
15:15:58.385 [Broker-0-StreamProcessor-2] [Broker-0-zb-actors-1] INFO  io.zeebe.logstreams - Recovered state of partition 2 from snapshot at position -1
15:15:58.423 [Broker-0-StreamProcessor-2] [Broker-0-zb-actors-1] INFO  org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.feel.spi.JavaValueMapper@557d8245)), function-provider: org.camunda.feel.interpreter.FunctionProvider$EmptyFunctionProvider$@19f32b18]
15:15:58.477 [Broker-0-SnapshotDirector-2] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams.snapshot - The position of the last valid snapshot is '-1'. Taking snapshots beyond this position.
15:15:58.490 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] DEBUG io.zeebe.broker.exporter - Recovering exporter from snapshot
15:15:58.493 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 partitions [1/2]: partition 2 started in 1867 ms
15:15:58.493 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 partitions [2/2]: partition 1
15:15:58.494 [] [main] DEBUG io.zeebe.broker.exporter - Exporter configured with ElasticsearchExporterConfiguration{url='http://localhost:9200', index=IndexConfiguration{indexPrefix='9d454d4e-8', createTemplate=true, command=false, event=true, rejection=false, error=true, deployment=true, incident=true, job=true, message=false, messageSubscription=false, variable=true, variableDocument=true, workflowInstance=true, workflowInstanceCreation=false, workflowInstanceSubscription=false}, bulk=BulkConfiguration{delay=1, size=1}, authentication=AuthenticationConfiguration{username='null'}}
15:15:58.563 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] DEBUG io.zeebe.broker.exporter - Recovered exporter 'Broker-0-Exporter-2' from snapshot at lastExportedPosition -1
15:15:58.563 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] DEBUG io.zeebe.broker.exporter - Configure exporter with id 'elasticsearch'
15:15:58.564 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] DEBUG io.zeebe.broker.exporter.elasticsearch - Exporter configured with ElasticsearchExporterConfiguration{url='http://localhost:9200', index=IndexConfiguration{indexPrefix='9d454d4e-8', createTemplate=true, command=false, event=true, rejection=false, error=true, deployment=true, incident=true, job=true, message=false, messageSubscription=false, variable=true, variableDocument=true, workflowInstance=true, workflowInstanceCreation=false, workflowInstanceSubscription=false}, bulk=BulkConfiguration{delay=1, size=1}, authentication=AuthenticationConfiguration{username='null'}}
15:15:58.564 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] DEBUG io.zeebe.broker.exporter - Configure exporter with id 'test-recorder'
15:15:58.568 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Removing follower partition service for partition PartitionId{id=1, group=raft-partition}
15:15:58.568 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] DEBUG io.zeebe.broker.exporter - Set event filter for exporters: ExporterEventFilter{acceptRecordTypes={COMMAND=true, SBE_UNKNOWN=true, COMMAND_REJECTION=true, NULL_VAL=true, EVENT=true}, acceptValueTypes={JOB_BATCH=true, VARIABLE=true, VARIABLE_DOCUMENT=true, INCIDENT=true, ERROR=true, WORKFLOW_INSTANCE=true, MESSAGE=true, SBE_UNKNOWN=true, JOB=true, WORKFLOW_INSTANCE_SUBSCRIPTION=true, WORKFLOW_INSTANCE_RESULT=true, NULL_VAL=true, WORKFLOW_INSTANCE_CREATION=true, MESSAGE_SUBSCRIPTION=true, MESSAGE_START_EVENT_SUBSCRIPTION=true, TIMER=true, DEPLOYMENT=true}}
15:15:58.568 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Partition role transitioning from null to LEADER
15:15:58.568 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Installing leader partition service for partition PartitionId{id=1, group=raft-partition}
15:15:58.570 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] DEBUG io.zeebe.broker.exporter - Open exporter with id 'elasticsearch'
15:15:58.574 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams.snapshot - Available snapshots: []
15:15:58.581 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] INFO  io.zeebe.broker.exporter.elasticsearch - Exporter opened
15:15:58.583 [Broker-0-Exporter-2] [Broker-0-zb-fs-workers-1] DEBUG io.zeebe.broker.exporter - Open exporter with id 'test-recorder'
15:15:58.607 [GatewayTopologyManager] [Broker-0-zb-actors-1] DEBUG io.zeebe.gateway - Received metadata change from Broker 0, partitions {2=LEADER} and terms {2=1}.
15:15:59.693 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams.snapshot - Opened database from 'C:\Users\SVETLA~1\AppData\Local\Temp\90b27a1a-07f5-4ce2-9c22-1e0312643ccb\data\raft-partition\partitions\1\runtime'.
15:15:59.735 [Broker-0-LogStream-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams - Configured log appender back pressure at partition 1 as AppenderVegasCfg{initialLimit=1024, maxConcurrency=32768, alphaLimit=0.7, betaLimit=0.95}. Window limiting is disabled
15:15:59.740 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams - Recovering state of partition 1 from snapshot
15:15:59.741 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-0] INFO  org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.feel.spi.JavaValueMapper@77c720c3)), function-provider: org.camunda.feel.interpreter.FunctionProvider$EmptyFunctionProvider$@19f32b18]
15:15:59.750 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-0] INFO  io.zeebe.logstreams - Recovered state of partition 1 from snapshot at position -1
15:15:59.753 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-0] INFO  org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.feel.spi.JavaValueMapper@7e72689f)), function-provider: org.camunda.feel.interpreter.FunctionProvider$EmptyFunctionProvider$@19f32b18]
15:15:59.790 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-0] INFO  org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.feel.spi.JavaValueMapper@2a84fa0f)), function-provider: org.camunda.feel.interpreter.FunctionProvider$EmptyFunctionProvider$@19f32b18]
15:15:59.792 [Broker-0-SnapshotDirector-1] [Broker-0-zb-actors-1] DEBUG io.zeebe.logstreams.snapshot - The position of the last valid snapshot is '-1'. Taking snapshots beyond this position.
15:15:59.800 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter - Recovering exporter from snapshot
15:15:59.801 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 partitions [2/2]: partition 1 started in 1308 ms
15:15:59.801 [Broker-0-HealthCheckService] [Broker-0-zb-actors-1] DEBUG io.zeebe.broker.system - All partitions are installed. Broker is ready!
15:15:59.801 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 partitions succeeded. Started 2 steps in 3175 ms.
15:15:59.802 [] [main] DEBUG io.zeebe.broker.system - Bootstrap Broker-0 [11/11]: zeebe partitions started in 3178 ms
15:15:59.802 [] [main] INFO  io.zeebe.broker.system - Bootstrap Broker-0 succeeded. Started 11 steps in 6930 ms.
15:15:59.819 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter - Recovered exporter 'Broker-0-Exporter-1' from snapshot at lastExportedPosition -1
15:15:59.819 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter - Configure exporter with id 'elasticsearch'
15:15:59.819 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter.elasticsearch - Exporter configured with ElasticsearchExporterConfiguration{url='http://localhost:9200', index=IndexConfiguration{indexPrefix='9d454d4e-8', createTemplate=true, command=false, event=true, rejection=false, error=true, deployment=true, incident=true, job=true, message=false, messageSubscription=false, variable=true, variableDocument=true, workflowInstance=true, workflowInstanceCreation=false, workflowInstanceSubscription=false}, bulk=BulkConfiguration{delay=1, size=1}, authentication=AuthenticationConfiguration{username='null'}}
15:15:59.819 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter - Configure exporter with id 'test-recorder'
15:15:59.820 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter - Set event filter for exporters: ExporterEventFilter{acceptRecordTypes={COMMAND=true, SBE_UNKNOWN=true, COMMAND_REJECTION=true, NULL_VAL=true, EVENT=true}, acceptValueTypes={JOB_BATCH=true, VARIABLE=true, VARIABLE_DOCUMENT=true, INCIDENT=true, ERROR=true, WORKFLOW_INSTANCE=true, MESSAGE=true, SBE_UNKNOWN=true, JOB=true, WORKFLOW_INSTANCE_SUBSCRIPTION=true, WORKFLOW_INSTANCE_RESULT=true, NULL_VAL=true, WORKFLOW_INSTANCE_CREATION=true, MESSAGE_SUBSCRIPTION=true, MESSAGE_START_EVENT_SUBSCRIPTION=true, TIMER=true, DEPLOYMENT=true}}
15:15:59.820 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter - Open exporter with id 'elasticsearch'
15:15:59.824 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] INFO  io.zeebe.broker.exporter.elasticsearch - Exporter opened
15:15:59.824 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter - Open exporter with id 'test-recorder'
15:15:59.854 [GatewayTopologyManager] [Broker-0-zb-actors-1] DEBUG io.zeebe.gateway - Received metadata change from Broker 0, partitions {1=LEADER, 2=LEADER} and terms {1=1, 2=1}.
15:15:59.976 [] [main] INFO  org.camunda.operate.util.OperateZeebeRule - 
====
Broker startup time: 7257
====

15:16:00.134 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Template [e030e941-a-operate-activity-instance-0.23.0-snapshot_template] was successfully created
15:16:00.280 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-activity-instance-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:00.281 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-activity-instance-0.23.0-snapshot_] was successfully created
15:16:00.299 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Template [e030e941-a-operate-batch-operation-0.23.0-snapshot_template] was successfully created
15:16:00.423 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-batch-operation-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:00.424 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-batch-operation-0.23.0-snapshot_] was successfully created
15:16:00.444 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Template [e030e941-a-operate-event-0.23.0-snapshot_template] was successfully created
15:16:00.584 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-event-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:00.585 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-event-0.23.0-snapshot_] was successfully created
15:16:00.654 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Template [e030e941-a-operate-incident-0.23.0-snapshot_template] was successfully created
15:16:00.788 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-incident-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:00.788 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-incident-0.23.0-snapshot_] was successfully created
15:16:00.811 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Template [e030e941-a-operate-list-view-0.23.0-snapshot_template] was successfully created
15:16:00.940 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-list-view-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:00.940 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-list-view-0.23.0-snapshot_] was successfully created
15:16:00.959 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Template [e030e941-a-operate-operation-0.23.0-snapshot_template] was successfully created
15:16:01.110 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-operation-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:01.110 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-operation-0.23.0-snapshot_] was successfully created
15:16:01.129 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Template [e030e941-a-operate-sequence-flow-0.23.0-snapshot_template] was successfully created
15:16:01.248 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-sequence-flow-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:01.248 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-sequence-flow-0.23.0-snapshot_] was successfully created
15:16:01.266 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Template [e030e941-a-operate-variable-0.23.0-snapshot_template] was successfully created
15:16:01.420 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-variable-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:01.421 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-variable-0.23.0-snapshot_] was successfully created
15:16:01.545 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-import-position-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:01.546 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-import-position-0.23.0-snapshot_] was successfully created
15:16:01.690 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-user-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:01.691 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-user-0.23.0-snapshot_] was successfully created
15:16:01.829 [] [I/O dispatcher 1] WARN  org.elasticsearch.client.RestClient - request [PUT http://localhost:9200/e030e941-a-operate-workflow-0.23.0-snapshot_?master_timeout=30s&include_type_name=false&timeout=30s] returned 1 warnings: [299 Elasticsearch-6.8.6-3d9f765 "the default number of shards will change from [5] to [1] in 7.0.0; if you wish to continue using the default of [5] shards, you must manage this on the create index request or with an index template"]
15:16:01.830 [] [main] DEBUG org.camunda.operate.es.ElasticsearchSchemaManager - Index [e030e941-a-operate-workflow-0.23.0-snapshot_] was successfully created
15:16:01.871 [] [main] DEBUG org.camunda.operate.util.ElasticsearchTestRule - Elasticsearch indices are created after 1 checks
15:16:02.763 [] [main] DEBUG org.camunda.operate.util.ZeebeTestUtil - Deployment of resource [demoProcess_v_1.bpmn] was performed
15:16:02.764 [] [main] DEBUG org.camunda.operate.zeebe.PartitionHolder - Requesting partition ids from Zeebe client
15:16:02.767 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.workflow.repository - Pushed deployment 2251799813685250 to all partitions.
15:16:02.767 [Broker-0-ManagementRequestHandler] [Broker-0-zb-actors-1] DEBUG io.zeebe.broker.workflow.repository - Deployment CREATE command for deployment 2251799813685250 was written on partition 2
15:16:02.794 [] [main] INFO  org.camunda.operate.zeebeimport.RecordsReaderHolder - Starting import for partitions: [1, 2]
15:16:02.796 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.workflow.repository - Deployment 2251799813685250 distributed to all partitions successfully.
15:16:02.878 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [workflow-instance] and partitionId [1]: ImportPositionEntity{aliasName='workflow-instance', partitionId=1, position=0, indexName='null'}
15:16:03.080 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.084 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [job] and partitionId [1]: ImportPositionEntity{aliasName='job', partitionId=1, position=0, indexName='null'}
15:16:03.089 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.094 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [deployment] and partitionId [2]: ImportPositionEntity{aliasName='deployment', partitionId=2, position=0, indexName='null'}
15:16:03.099 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-deployment
15:16:03.104 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [workflow-instance] and partitionId [2]: ImportPositionEntity{aliasName='workflow-instance', partitionId=2, position=0, indexName='null'}
15:16:03.108 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.113 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [variable-document] and partitionId [2]: ImportPositionEntity{aliasName='variable-document', partitionId=2, position=0, indexName='null'}
15:16:03.117 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:03.130 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [variable] and partitionId [2]: ImportPositionEntity{aliasName='variable', partitionId=2, position=0, indexName='null'}
15:16:03.134 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:03.140 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [incident] and partitionId [2]: ImportPositionEntity{aliasName='incident', partitionId=2, position=0, indexName='null'}
15:16:03.145 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:03.150 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [incident] and partitionId [1]: ImportPositionEntity{aliasName='incident', partitionId=1, position=0, indexName='null'}
15:16:03.154 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:03.159 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [variable-document] and partitionId [1]: ImportPositionEntity{aliasName='variable-document', partitionId=1, position=0, indexName='null'}
15:16:03.162 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:03.167 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [job] and partitionId [2]: ImportPositionEntity{aliasName='job', partitionId=2, position=0, indexName='null'}
15:16:03.171 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.175 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [deployment] and partitionId [1]: ImportPositionEntity{aliasName='deployment', partitionId=1, position=0, indexName='null'}
15:16:03.178 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-deployment
15:16:03.183 [] [main] DEBUG org.camunda.operate.zeebeimport.ImportPositionHolder - Latest loaded position for alias [variable] and partitionId [1]: ImportPositionEntity{aliasName='variable', partitionId=1, position=0, indexName='null'}
15:16:03.187 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:03.203 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.207 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.211 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-deployment
15:16:03.216 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.220 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:03.223 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:03.227 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:03.231 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:03.234 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:03.238 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.242 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-deployment
15:16:03.246 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:03.261 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.264 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.272 [] [main] ERROR org.camunda.operate.zeebeimport.RecordsReader - Exception occurred, while obtaining next Zeebe records batch: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]
org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]
	at org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:177) ~[elasticsearch-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2053) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:2030) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1777) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1734) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1696) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.search(RestHighLevelClient.java:1092) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.camunda.operate.zeebeimport.RecordsReader.lambda$readNextBatch$0(RecordsReader.java:153) ~[classes/:?]
	at io.micrometer.core.instrument.AbstractTimer.recordCallable(AbstractTimer.java:138) ~[micrometer-core-1.3.1.jar:1.3.1]
	at org.camunda.operate.zeebeimport.RecordsReader.withTimer(RecordsReader.java:207) ~[classes/:?]
	at org.camunda.operate.zeebeimport.RecordsReader.readNextBatch(RecordsReader.java:153) [classes/:?]
	at org.camunda.operate.zeebeimport.RecordsReader.readAndScheduleNextBatch(RecordsReader.java:125) [classes/:?]
	at org.camunda.operate.zeebeimport.ZeebeImporter.importOneBatch(ZeebeImporter.java:90) [classes/:?]
	at org.camunda.operate.zeebeimport.ZeebeImporter.performOneRoundOfImportFor(ZeebeImporter.java:80) [classes/:?]
	at org.camunda.operate.util.ElasticsearchTestRule.processRecordsAndWaitFor(ElasticsearchTestRule.java:194) [test-classes/:?]
	at org.camunda.operate.util.ElasticsearchTestRule.processAllRecordsAndWait(ElasticsearchTestRule.java:170) [test-classes/:?]
	at org.camunda.operate.it.OperateTester.workflowIsDeployed(OperateTester.java:157) [test-classes/:?]
	at org.camunda.operate.it.WorkflowInstanceReaderIT.setUp(WorkflowInstanceReaderIT.java:39) [test-classes/:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12]
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12]
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12]
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.statements.RunBeforeTestMethodCallbacks.evaluate(RunBeforeTestMethodCallbacks.java:75) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.statements.RunAfterTestMethodCallbacks.evaluate(RunAfterTestMethodCallbacks.java:86) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12]
	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.statements.SpringRepeat.evaluate(SpringRepeat.java:84) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:251) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:97) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12]
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12]
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12]
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12]
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.statements.RunBeforeTestClassCallbacks.evaluate(RunBeforeTestClassCallbacks.java:61) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.springframework.test.context.junit4.statements.RunAfterTestClassCallbacks.evaluate(RunAfterTestClassCallbacks.java:70) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.run(SpringJUnit4ClassRunner.java:190) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137) [junit-4.12.jar:4.12]
	at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) [junit-rt.jar:?]
	at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47) [junit-rt.jar:?]
	at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242) [junit-rt.jar:?]
	at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70) [junit-rt.jar:?]
	Suppressed: org.elasticsearch.client.ResponseException: method [POST], host [http://localhost:9200], URI [/9d454d4e-8-deployment/_search?routing=2&rest_total_hits_as_int=true&typed_keys=true&ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true&ignore_throttled=true&request_cache=false&search_type=query_then_fetch&batched_reduce_size=512], status line [HTTP/1.1 503 Service Unavailable]
{"error":{"root_cause":[],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","grouped":true,"failed_shards":[]},"status":503}
		at org.elasticsearch.client.RestClient$SyncResponseListener.get(RestClient.java:936) ~[elasticsearch-rest-client-6.8.5.jar:6.8.6]
		at org.elasticsearch.client.RestClient.performRequest(RestClient.java:233) ~[elasticsearch-rest-client-6.8.5.jar:6.8.6]
		at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1764) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
		at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1734) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
		at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1696) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
		at org.elasticsearch.client.RestHighLevelClient.search(RestHighLevelClient.java:1092) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
		at org.camunda.operate.zeebeimport.RecordsReader.lambda$readNextBatch$0(RecordsReader.java:153) ~[classes/:?]
		at io.micrometer.core.instrument.AbstractTimer.recordCallable(AbstractTimer.java:138) ~[micrometer-core-1.3.1.jar:1.3.1]
		at org.camunda.operate.zeebeimport.RecordsReader.withTimer(RecordsReader.java:207) ~[classes/:?]
		at org.camunda.operate.zeebeimport.RecordsReader.readNextBatch(RecordsReader.java:153) [classes/:?]
		at org.camunda.operate.zeebeimport.RecordsReader.readAndScheduleNextBatch(RecordsReader.java:125) [classes/:?]
		at org.camunda.operate.zeebeimport.ZeebeImporter.importOneBatch(ZeebeImporter.java:90) [classes/:?]
		at org.camunda.operate.zeebeimport.ZeebeImporter.performOneRoundOfImportFor(ZeebeImporter.java:80) [classes/:?]
		at org.camunda.operate.util.ElasticsearchTestRule.processRecordsAndWaitFor(ElasticsearchTestRule.java:194) [test-classes/:?]
		at org.camunda.operate.util.ElasticsearchTestRule.processAllRecordsAndWait(ElasticsearchTestRule.java:170) [test-classes/:?]
		at org.camunda.operate.it.OperateTester.workflowIsDeployed(OperateTester.java:157) [test-classes/:?]
		at org.camunda.operate.it.WorkflowInstanceReaderIT.setUp(WorkflowInstanceReaderIT.java:39) [test-classes/:?]
		at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
		at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
		at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
		at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
		at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12]
		at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12]
		at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12]
		at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.statements.RunBeforeTestMethodCallbacks.evaluate(RunBeforeTestMethodCallbacks.java:75) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.statements.RunAfterTestMethodCallbacks.evaluate(RunAfterTestMethodCallbacks.java:86) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
		at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
		at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
		at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12]
		at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.statements.SpringRepeat.evaluate(SpringRepeat.java:84) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:251) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:97) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12]
		at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12]
		at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12]
		at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12]
		at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.statements.RunBeforeTestClassCallbacks.evaluate(RunBeforeTestClassCallbacks.java:61) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.springframework.test.context.junit4.statements.RunAfterTestClassCallbacks.evaluate(RunAfterTestClassCallbacks.java:70) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.run(SpringJUnit4ClassRunner.java:190) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.runner.JUnitCore.run(JUnitCore.java:137) [junit-4.12.jar:4.12]
		at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) [junit-rt.jar:?]
		at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47) [junit-rt.jar:?]
		at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242) [junit-rt.jar:?]
		at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70) [junit-rt.jar:?]
	Caused by: org.elasticsearch.client.ResponseException: method [POST], host [http://localhost:9200], URI [/9d454d4e-8-deployment/_search?routing=2&rest_total_hits_as_int=true&typed_keys=true&ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true&ignore_throttled=true&request_cache=false&search_type=query_then_fetch&batched_reduce_size=512], status line [HTTP/1.1 503 Service Unavailable]
{"error":{"root_cause":[],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","grouped":true,"failed_shards":[]},"status":503}
		at org.elasticsearch.client.RestClient$1.completed(RestClient.java:552) ~[elasticsearch-rest-client-6.8.5.jar:6.8.6]
		at org.elasticsearch.client.RestClient$1.completed(RestClient.java:537) ~[elasticsearch-rest-client-6.8.5.jar:6.8.6]
		at org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122) ~[httpcore-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:181) ~[httpasyncclient-4.1.4.jar:4.1.4]
		at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:448) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:338) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81) ~[httpasyncclient-4.1.4.jar:4.1.4]
		at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39) ~[httpasyncclient-4.1.4.jar:4.1.4]
		at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at java.lang.Thread.run(Thread.java:834) ~[?:?]
15:16:03.275 [] [main] ERROR org.camunda.operate.util.ElasticsearchTestRule - Exception occurred, while obtaining next Zeebe records batch: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]
org.camunda.operate.exceptions.OperateRuntimeException: Exception occurred, while obtaining next Zeebe records batch: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]
	at org.camunda.operate.zeebeimport.RecordsReader.readNextBatch(RecordsReader.java:164) ~[classes/:?]
	at org.camunda.operate.zeebeimport.RecordsReader.readAndScheduleNextBatch(RecordsReader.java:125) ~[classes/:?]
	at org.camunda.operate.zeebeimport.ZeebeImporter.importOneBatch(ZeebeImporter.java:90) ~[classes/:?]
	at org.camunda.operate.zeebeimport.ZeebeImporter.performOneRoundOfImportFor(ZeebeImporter.java:80) ~[classes/:?]
	at org.camunda.operate.util.ElasticsearchTestRule.processRecordsAndWaitFor(ElasticsearchTestRule.java:194) [test-classes/:?]
	at org.camunda.operate.util.ElasticsearchTestRule.processAllRecordsAndWait(ElasticsearchTestRule.java:170) [test-classes/:?]
	at org.camunda.operate.it.OperateTester.workflowIsDeployed(OperateTester.java:157) [test-classes/:?]
	at org.camunda.operate.it.WorkflowInstanceReaderIT.setUp(WorkflowInstanceReaderIT.java:39) [test-classes/:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12]
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12]
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12]
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.statements.RunBeforeTestMethodCallbacks.evaluate(RunBeforeTestMethodCallbacks.java:75) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.statements.RunAfterTestMethodCallbacks.evaluate(RunAfterTestMethodCallbacks.java:86) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12]
	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.statements.SpringRepeat.evaluate(SpringRepeat.java:84) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:251) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:97) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12]
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12]
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12]
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12]
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.statements.RunBeforeTestClassCallbacks.evaluate(RunBeforeTestClassCallbacks.java:61) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.springframework.test.context.junit4.statements.RunAfterTestClassCallbacks.evaluate(RunAfterTestClassCallbacks.java:70) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12]
	at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.run(SpringJUnit4ClassRunner.java:190) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137) [junit-4.12.jar:4.12]
	at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) [junit-rt.jar:?]
	at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47) [junit-rt.jar:?]
	at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242) [junit-rt.jar:?]
	at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70) [junit-rt.jar:?]
Caused by: org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]
	at org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:177) ~[elasticsearch-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2053) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:2030) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1777) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1734) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1696) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.elasticsearch.client.RestHighLevelClient.search(RestHighLevelClient.java:1092) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
	at org.camunda.operate.zeebeimport.RecordsReader.lambda$readNextBatch$0(RecordsReader.java:153) ~[classes/:?]
	at io.micrometer.core.instrument.AbstractTimer.recordCallable(AbstractTimer.java:138) ~[micrometer-core-1.3.1.jar:1.3.1]
	at org.camunda.operate.zeebeimport.RecordsReader.withTimer(RecordsReader.java:207) ~[classes/:?]
	at org.camunda.operate.zeebeimport.RecordsReader.readNextBatch(RecordsReader.java:153) ~[classes/:?]
	... 41 more
	Suppressed: org.elasticsearch.client.ResponseException: method [POST], host [http://localhost:9200], URI [/9d454d4e-8-deployment/_search?routing=2&rest_total_hits_as_int=true&typed_keys=true&ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true&ignore_throttled=true&request_cache=false&search_type=query_then_fetch&batched_reduce_size=512], status line [HTTP/1.1 503 Service Unavailable]
{"error":{"root_cause":[],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","grouped":true,"failed_shards":[]},"status":503}
		at org.elasticsearch.client.RestClient$SyncResponseListener.get(RestClient.java:936) ~[elasticsearch-rest-client-6.8.5.jar:6.8.6]
		at org.elasticsearch.client.RestClient.performRequest(RestClient.java:233) ~[elasticsearch-rest-client-6.8.5.jar:6.8.6]
		at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1764) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
		at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1734) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
		at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1696) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
		at org.elasticsearch.client.RestHighLevelClient.search(RestHighLevelClient.java:1092) ~[elasticsearch-rest-high-level-client-6.8.6.jar:6.8.6]
		at org.camunda.operate.zeebeimport.RecordsReader.lambda$readNextBatch$0(RecordsReader.java:153) ~[classes/:?]
		at io.micrometer.core.instrument.AbstractTimer.recordCallable(AbstractTimer.java:138) ~[micrometer-core-1.3.1.jar:1.3.1]
		at org.camunda.operate.zeebeimport.RecordsReader.withTimer(RecordsReader.java:207) ~[classes/:?]
		at org.camunda.operate.zeebeimport.RecordsReader.readNextBatch(RecordsReader.java:153) ~[classes/:?]
		at org.camunda.operate.zeebeimport.RecordsReader.readAndScheduleNextBatch(RecordsReader.java:125) ~[classes/:?]
		at org.camunda.operate.zeebeimport.ZeebeImporter.importOneBatch(ZeebeImporter.java:90) ~[classes/:?]
		at org.camunda.operate.zeebeimport.ZeebeImporter.performOneRoundOfImportFor(ZeebeImporter.java:80) ~[classes/:?]
		at org.camunda.operate.util.ElasticsearchTestRule.processRecordsAndWaitFor(ElasticsearchTestRule.java:194) [test-classes/:?]
		at org.camunda.operate.util.ElasticsearchTestRule.processAllRecordsAndWait(ElasticsearchTestRule.java:170) [test-classes/:?]
		at org.camunda.operate.it.OperateTester.workflowIsDeployed(OperateTester.java:157) [test-classes/:?]
		at org.camunda.operate.it.WorkflowInstanceReaderIT.setUp(WorkflowInstanceReaderIT.java:39) [test-classes/:?]
		at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
		at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
		at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
		at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
		at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12]
		at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12]
		at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12]
		at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.statements.RunBeforeTestMethodCallbacks.evaluate(RunBeforeTestMethodCallbacks.java:75) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.statements.RunAfterTestMethodCallbacks.evaluate(RunAfterTestMethodCallbacks.java:86) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
		at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
		at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12]
		at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12]
		at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.statements.SpringRepeat.evaluate(SpringRepeat.java:84) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:251) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:97) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12]
		at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12]
		at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12]
		at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12]
		at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.statements.RunBeforeTestClassCallbacks.evaluate(RunBeforeTestClassCallbacks.java:61) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.springframework.test.context.junit4.statements.RunAfterTestClassCallbacks.evaluate(RunAfterTestClassCallbacks.java:70) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12]
		at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.run(SpringJUnit4ClassRunner.java:190) [spring-test-5.2.2.RELEASE.jar:5.2.2.RELEASE]
		at org.junit.runner.JUnitCore.run(JUnitCore.java:137) [junit-4.12.jar:4.12]
		at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) [junit-rt.jar:?]
		at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47) [junit-rt.jar:?]
		at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242) [junit-rt.jar:?]
		at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70) [junit-rt.jar:?]
	Caused by: org.elasticsearch.client.ResponseException: method [POST], host [http://localhost:9200], URI [/9d454d4e-8-deployment/_search?routing=2&rest_total_hits_as_int=true&typed_keys=true&ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true&ignore_throttled=true&request_cache=false&search_type=query_then_fetch&batched_reduce_size=512], status line [HTTP/1.1 503 Service Unavailable]
{"error":{"root_cause":[],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","grouped":true,"failed_shards":[]},"status":503}
		at org.elasticsearch.client.RestClient$1.completed(RestClient.java:552) ~[elasticsearch-rest-client-6.8.5.jar:6.8.6]
		at org.elasticsearch.client.RestClient$1.completed(RestClient.java:537) ~[elasticsearch-rest-client-6.8.5.jar:6.8.6]
		at org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:122) ~[httpcore-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:181) ~[httpasyncclient-4.1.4.jar:4.1.4]
		at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:448) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:338) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81) ~[httpasyncclient-4.1.4.jar:4.1.4]
		at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39) ~[httpasyncclient-4.1.4.jar:4.1.4]
		at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) ~[httpcore-nio-4.4.12.jar:4.4.12]
		at java.lang.Thread.run(Thread.java:834) ~[?:?]
15:16:03.322 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.327 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.341 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.346 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:03.352 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:03.358 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:03.362 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:03.367 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:03.371 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.380 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:03.409 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.412 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.510 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - Submitted next job
15:16:03.510 [] [import_1] DEBUG org.camunda.operate.zeebeimport.ElasticsearchBulkProcessor - Writing [1] Zeebe records to Elasticsearch
15:16:03.514 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:03.518 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:03.518 [] [import_1] DEBUG org.camunda.operate.zeebeimport.processors.WorkflowZeebeRecordProcessor - Workflow: key 2251799813685249, bpmnProcessId demoProcess
15:16:03.521 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:03.525 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:03.529 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:03.530 [] [import_1] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK START *************
15:16:03.533 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:03.537 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:03.541 [] [import_1] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK FINISH *************
15:16:03.547 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - Submitted next job
15:16:03.547 [] [import_2] DEBUG org.camunda.operate.zeebeimport.ElasticsearchBulkProcessor - Writing [2] Zeebe records to Elasticsearch
15:16:03.550 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.WorkflowZeebeRecordProcessor - Workflow: key 2251799813685249, bpmnProcessId demoProcess
15:16:03.551 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:03.560 [] [import_2] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK START *************
15:16:03.570 [] [import_2] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK FINISH *************
15:16:04.056 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:04.063 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:04.069 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-workflow-instance
15:16:04.072 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:04.075 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:04.078 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:04.081 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:04.085 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:04.088 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:04.094 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable
15:16:04.094 [] [main] DEBUG org.camunda.operate.util.ElasticsearchTestRule -  3 of 3 imports processed
15:16:04.105 [] [main] DEBUG org.camunda.operate.util.ElasticsearchTestRule - Conditions met in round 6 (1245 ms).
15:16:04.185 [] [main] DEBUG org.camunda.operate.util.ZeebeTestUtil - Workflow instance created for workflow [demoProcess]
15:16:04.522 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:04.534 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - Submitted next job
15:16:04.534 [] [import_3] DEBUG org.camunda.operate.zeebeimport.ElasticsearchBulkProcessor - Writing [1] Zeebe records to Elasticsearch
15:16:04.537 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:04.542 [] [import_3] DEBUG org.camunda.operate.zeebeimport.cache.WorkflowCache - Found workflow after 1 attempts. Waited 0 ms.
15:16:04.543 [] [import_3] DEBUG org.camunda.operate.zeebeimport.processors.ListViewZeebeRecordProcessor - Workflow instance for list view: id 4503599627370497
15:16:04.544 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - Submitted next job
15:16:04.544 [] [import_1] DEBUG org.camunda.operate.zeebeimport.ElasticsearchBulkProcessor - Writing [1] Zeebe records to Elasticsearch
15:16:04.544 [] [import_1] DEBUG org.camunda.operate.zeebeimport.processors.ListViewZeebeRecordProcessor - Variable for list view: id 4503599627370497-a
15:16:04.547 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:04.549 [] [import_1] DEBUG org.camunda.operate.zeebeimport.processors.VariableZeebeRecordProcessor - Variable instance for list view: id 4503599627370497-a
15:16:04.551 [] [import_1] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK START *************
15:16:04.551 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-incident
15:16:04.555 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:04.559 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-job
15:16:04.560 [] [import_3] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK START *************
15:16:04.573 [] [import_1] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK FINISH *************
15:16:04.577 [] [import_3] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK FINISH *************
15:16:05.095 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:05.110 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:05.120 [] [main] DEBUG org.camunda.operate.util.ElasticsearchTestRule -  2 of 2 imports processed
15:16:05.191 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - Submitted next job
15:16:05.191 [] [import_2] DEBUG org.camunda.operate.zeebeimport.ElasticsearchBulkProcessor - Writing [8] Zeebe records to Elasticsearch
15:16:05.193 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.ListViewZeebeRecordProcessor - Workflow instance for list view: id 4503599627370497
15:16:05.193 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.ListViewZeebeRecordProcessor - Activity instance for list view: id 4503599627370500
15:16:05.194 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:05.195 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.ListViewZeebeRecordProcessor - Activity instance for list view: id 4503599627370503
15:16:05.195 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.ActivityInstanceZeebeRecordProcessor - Activity instance for list view: id 4503599627370500
15:16:05.197 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.ActivityInstanceZeebeRecordProcessor - Activity instance for list view: id 4503599627370503
15:16:05.198 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - Submitted next job
15:16:05.198 [] [import_1] DEBUG org.camunda.operate.zeebeimport.ElasticsearchBulkProcessor - Writing [1] Zeebe records to Elasticsearch
15:16:05.198 [] [import_1] DEBUG org.camunda.operate.zeebeimport.processors.ListViewZeebeRecordProcessor - Variable for list view: id 4503599627370503-foo
15:16:05.198 [] [import_1] DEBUG org.camunda.operate.zeebeimport.processors.VariableZeebeRecordProcessor - Variable instance for list view: id 4503599627370503-foo
15:16:05.198 [] [import_1] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK START *************
15:16:05.199 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.EventZeebeRecordProcessor - Event: id 4503599627370497_4503599627370500, eventSourceType WORKFLOW_INSTANCE, eventType ELEMENT_COMPLETED, workflowInstanceKey 4503599627370497
15:16:05.203 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.EventZeebeRecordProcessor - Event: id 4503599627370497_4503599627370503, eventSourceType WORKFLOW_INSTANCE, eventType ELEMENT_ACTIVATED, workflowInstanceKey 4503599627370497
15:16:05.203 [] [import_2] DEBUG org.camunda.operate.zeebeimport.processors.SequenceFlowZeebeRecordProcessor - Index sequence flow: id 4503599627370502
15:16:05.204 [] [import_2] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK START *************
15:16:05.205 [] [import_3] DEBUG org.camunda.operate.zeebeimport.ElasticsearchBulkProcessor - Writing [1] Zeebe records to Elasticsearch
15:16:05.205 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - Submitted next job
15:16:05.206 [] [import_3] DEBUG org.camunda.operate.zeebeimport.processors.ListViewZeebeRecordProcessor - Activity instance for list view: id 4503599627370503
15:16:05.207 [] [import_3] DEBUG org.camunda.operate.zeebeimport.processors.ActivityInstanceZeebeRecordProcessor - Activity instance for list view: id 4503599627370503
15:16:05.208 [] [import_3] DEBUG org.camunda.operate.zeebeimport.processors.IncidentZeebeRecordProcessor - Index incident: id 4503599627370509
15:16:05.211 [] [import_3] DEBUG org.camunda.operate.zeebeimport.processors.EventZeebeRecordProcessor - Event: id 4503599627370497_4503599627370503, eventSourceType INCIDENT, eventType CREATED, workflowInstanceKey 4503599627370497
15:16:05.212 [] [import_3] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK START *************
15:16:05.212 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:05.227 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - Submitted next job
15:16:05.250 [] [import_1] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK FINISH *************
15:16:05.276 [] [import_2] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK FINISH *************
15:16:05.303 [] [import_3] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK FINISH *************
15:16:05.310 [] [import_1] DEBUG org.camunda.operate.zeebeimport.ElasticsearchBulkProcessor - Writing [7] Zeebe records to Elasticsearch
15:16:05.311 [] [import_1] DEBUG org.camunda.operate.zeebeimport.processors.EventZeebeRecordProcessor - Event: id 4503599627370497_4503599627370503, eventSourceType JOB, eventType FAILED, workflowInstanceKey 4503599627370497
15:16:05.312 [] [import_1] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK START *************
15:16:05.342 [] [import_1] DEBUG org.camunda.operate.util.ElasticsearchUtil - ************* FLUSH BULK FINISH *************
15:16:05.754 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:05.768 [] [main] DEBUG org.camunda.operate.zeebeimport.RecordsReader - No index found for alias 9d454d4e-8-variable-document
15:16:05.779 [] [main] DEBUG org.camunda.operate.util.ElasticsearchTestRule -  17 of 17 imports processed
15:16:05.843 [] [main] DEBUG org.camunda.operate.util.ElasticsearchTestRule - Conditions met in round 3 (1357 ms).
15:16:05.884 [] [main] INFO  org.camunda.operate.util.TestUtil - Removing indices
15:16:06.078 [] [main] INFO  io.zeebe.broker.system - Closing Broker-0 [1/11]: zeebe partitions
15:16:06.078 [] [main] INFO  io.zeebe.broker.system - Closing Broker-0 partitions [1/2]: partition 1
15:16:06.079 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Closing Broker-0-Exporter-1
15:16:06.081 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] INFO  io.zeebe.broker.exporter.elasticsearch - Exporter closed
15:16:06.082 [Broker-0-Exporter-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.exporter - Closed exporter director 'Broker-0-Exporter-1'.
15:16:06.083 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-1] DEBUG io.zeebe.broker.system - Closed Broker-0-Exporter-1 successfully
15:16:06.083 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-1] DEBUG io.zeebe.broker.system - Closing Broker-0-SnapshotDirector-1
15:16:06.084 [Broker-0-SnapshotDirector-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.logstreams.snapshot - Enforce snapshot creation. Last successful processed position is 4294989536.
15:16:06.093 [Broker-0-SnapshotDirector-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.logstreams.snapshot - Take temporary snapshot and write into C:\Users\SVETLA~1\AppData\Local\Temp\90b27a1a-07f5-4ce2-9c22-1e0312643ccb\data\raft-partition\partitions\1\pending\11-1-1582121766090-4294989536.
15:16:06.190 [Broker-0-SnapshotDirector-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.broker.clustering.atomix.storage.snapshot.DbSnapshotStore - Committed new snapshot DbSnapshot{directory=C:\Users\SVETLA~1\AppData\Local\Temp\90b27a1a-07f5-4ce2-9c22-1e0312643ccb\data\raft-partition\partitions\1\snapshots\11-1-1582121766090-4294989536, metadata=DbSnapshotMetadata{index=11, term=1, timestamp=2020-02-19 03:16:06,090, position=4294989536}}
15:16:06.196 [Broker-0-SnapshotDirector-1] [Broker-0-zb-fs-workers-0] DEBUG io.zeebe.logstreams.snapshot - Created snapshot for Broker-0-StreamProcessor-1
15:16:06.196 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Closed Broker-0-SnapshotDirector-1 successfully
15:16:06.196 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Closing Broker-0-StreamProcessor-1
15:16:06.197 [Broker-0-StreamProcessor-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.logstreams - Closed stream processor controller Broker-0-StreamProcessor-1.
15:16:06.197 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Closed Broker-0-StreamProcessor-1 successfully
15:16:06.197 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Closing Broker-0-DeletionService-1
15:16:06.197 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.broker.system - Closed Broker-0-DeletionService-1 successfully
15:16:06.207 [Broker-0-ZeebePartition-1] [Broker-0-zb-actors-0] DEBUG io.zeebe.util.actor - Continuing on future completion failed
java.lang.UnsatisfiedLinkError: org.rocksdb.OptimisticTransactionDB.closeDatabase(J)V
	at org.rocksdb.OptimisticTransactionDB.closeDatabase(Native Method) ~[rocksdbjni-6.6.4.jar:?]
	at org.rocksdb.OptimisticTransactionDB.close(OptimisticTransactionDB.java:136) ~[rocksdbjni-6.6.4.jar:?]
	at io.zeebe.db.impl.rocksdb.transaction.ZeebeTransactionDb.lambda$close$13(ZeebeTransactionDb.java:418) ~[zeebe-db-0.23.0-20200219.100122-58.jar:0.23.0-SNAPSHOT]
	at java.util.ArrayList.forEach(ArrayList.java:1540) ~[?:?]
	at io.zeebe.db.impl.rocksdb.transaction.ZeebeTransactionDb.close(ZeebeTransactionDb.java:415) ~[zeebe-db-0.23.0-20200219.100122-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.logstreams.state.StateSnapshotController.close(StateSnapshotController.java:174) ~[zeebe-logstreams-0.23.0-20200219.100134-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.broker.system.partitions.ZeebePartition.closeSnapshotController(ZeebePartition.java:454) ~[zeebe-broker-0.23.0-20200219.100113-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.broker.system.partitions.ZeebePartition.tearDownBaseInstallation(ZeebePartition.java:426) ~[zeebe-broker-0.23.0-20200219.100113-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.broker.system.partitions.ZeebePartition.lambda$closePartition$13(ZeebePartition.java:411) ~[zeebe-broker-0.23.0-20200219.100113-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.util.sched.future.FutureContinuationRunnable.run(FutureContinuationRunnable.java:28) [zeebe-util-0.23.0-20200219.100115-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.util.sched.ActorJob.invoke(ActorJob.java:76) [zeebe-util-0.23.0-20200219.100115-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.util.sched.ActorJob.execute(ActorJob.java:39) [zeebe-util-0.23.0-20200219.100115-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.util.sched.ActorTask.execute(ActorTask.java:115) [zeebe-util-0.23.0-20200219.100115-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.util.sched.ActorThread.executeCurrentTask(ActorThread.java:107) [zeebe-util-0.23.0-20200219.100115-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:91) [zeebe-util-0.23.0-20200219.100115-58.jar:0.23.0-SNAPSHOT]
	at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195) [zeebe-util-0.23.0-20200219.100115-58.jar:0.23.0-SNAPSHOT]

Thread dump (in case it helps)

Full thread dump

"main" #1 prio=5 os_prio=0 cpu=11000.00ms elapsed=406.92s tid=0x0000029f27082000 nid=0xad4 waiting on condition [0x000000be4c8fd000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000076b269c80> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at io.zeebe.util.sched.future.CompletableActorFuture.get(CompletableActorFuture.java:133)
at io.zeebe.util.sched.future.CompletableActorFuture.get(CompletableActorFuture.java:108)
at io.zeebe.util.sched.FutureUtil.join(FutureUtil.java:21)
at io.zeebe.util.sched.future.CompletableActorFuture.join(CompletableActorFuture.java:196)
at io.zeebe.broker.system.partitions.ZeebePartition.close(ZeebePartition.java:567)
at io.zeebe.broker.bootstrap.CloseProcess.lambda$closingStepByStep$0(CloseProcess.java:56)
at io.zeebe.broker.bootstrap.CloseProcess$$Lambda$2293/0x0000000800f79840.run(Unknown Source)
at io.zeebe.broker.bootstrap.StartProcess.takeDuration(StartProcess.java:88)
at io.zeebe.broker.bootstrap.CloseProcess.closingStepByStep(CloseProcess.java:56)
at io.zeebe.broker.bootstrap.CloseProcess$$Lambda$2292/0x0000000800f79440.run(Unknown Source)
at io.zeebe.broker.bootstrap.StartProcess.takeDuration(StartProcess.java:88)
at io.zeebe.broker.bootstrap.CloseProcess.closeReverse(CloseProcess.java:37)
at io.zeebe.broker.bootstrap.CloseProcess.close(CloseProcess.java:80)
at io.zeebe.broker.bootstrap.CloseProcess.lambda$closingStepByStep$0(CloseProcess.java:56)
at io.zeebe.broker.bootstrap.CloseProcess$$Lambda$2293/0x0000000800f79840.run(Unknown Source)
at io.zeebe.broker.bootstrap.StartProcess.takeDuration(StartProcess.java:88)
at io.zeebe.broker.bootstrap.CloseProcess.closingStepByStep(CloseProcess.java:56)
at io.zeebe.broker.bootstrap.CloseProcess$$Lambda$2292/0x0000000800f79440.run(Unknown Source)
at io.zeebe.broker.bootstrap.StartProcess.takeDuration(StartProcess.java:88)
at io.zeebe.broker.bootstrap.CloseProcess.closeReverse(CloseProcess.java:37)
at io.zeebe.broker.Broker.lambda$close$17(Broker.java:369)
at io.zeebe.broker.Broker$$Lambda$2291/0x0000000800f79040.accept(Unknown Source)
at java.util.concurrent.CompletableFuture.uniAcceptNow(java.base@11.0.4/CompletableFuture.java:753)
at java.util.concurrent.CompletableFuture.uniAcceptStage(java.base@11.0.4/CompletableFuture.java:731)
at java.util.concurrent.CompletableFuture.thenAccept(java.base@11.0.4/CompletableFuture.java:2108)
at io.zeebe.broker.Broker.lambda$close$18(Broker.java:367)
at io.zeebe.broker.Broker$$Lambda$2290/0x0000000800f78c40.run(Unknown Source)
at io.zeebe.util.LogUtil.doWithMDC(LogUtil.java:21)
at io.zeebe.broker.Broker.close(Broker.java:362)
at io.zeebe.test.EmbeddedBrokerRule.stopBroker(EmbeddedBrokerRule.java:181)
at org.camunda.operate.util.OperateZeebeRule.stop(OperateZeebeRule.java:145)
at org.camunda.operate.util.OperateZeebeRule.finished(OperateZeebeRule.java:111)
at org.junit.rules.TestWatcher.finishedQuietly(TestWatcher.java:117)
at org.junit.rules.TestWatcher.access$400(TestWatcher.java:46)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:64)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.springframework.test.context.junit4.statements.SpringRepeat.evaluate(SpringRepeat.java:84)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:251)
at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:97)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.springframework.test.context.junit4.statements.RunBeforeTestClassCallbacks.evaluate(RunBeforeTestClassCallbacks.java:61)
at org.springframework.test.context.junit4.statements.RunAfterTestClassCallbacks.evaluate(RunAfterTestClassCallbacks.java:70)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.run(SpringJUnit4ClassRunner.java:190)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47)
at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242)
at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)

"grpc-nio-boss-ELG-2-1" #68 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=394.38s tid=0x0000029f558e2800 nid=0x5a18 runnable [0x000000be505ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071db03298> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071db03210> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"nioEventLoopGroup-4-1" #109 prio=10 os_prio=2 cpu=0.00ms elapsed=393.81s tid=0x0000029f4d58f800 nid=0x2c4c runnable [0x000000be531fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071db8a878> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071db8a7f0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"grpc-nio-worker-ELG-3-1" #114 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=388.46s tid=0x0000029f4d595800 nid=0x42e4 runnable [0x000000be53cfe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071cf2f578> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071cf305a0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"grpc-nio-worker-ELG-3-2" #116 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=388.45s tid=0x0000029f4d592000 nid=0x3dd0 runnable [0x000000be53efe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071cf286a0> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071cf296c8> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"grpc-nio-worker-ELG-3-3" #117 daemon prio=5 os_prio=0 cpu=46.88ms elapsed=388.32s tid=0x0000029f4d596000 nid=0x3a34 runnable [0x000000be53ffe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071cf217c8> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071cf227f0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"grpc-nio-worker-ELG-3-4" #118 daemon prio=5 os_prio=0 cpu=78.13ms elapsed=388.31s tid=0x0000029f4d598000 nid=0x3d80 runnable [0x000000be540fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071cf1a8f0> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071cf1b918> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"grpc-nio-worker-ELG-3-5" #122 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=387.67s tid=0x0000029f52615000 nid=0x4aa0 runnable [0x000000be545ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071cf13a18> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071cf14a40> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"grpc-nio-worker-ELG-3-6" #126 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=386.31s tid=0x0000029f52617800 nid=0x3a98 runnable [0x000000be53bff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071cf0cb40> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071cf0db68> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"grpc-nio-worker-ELG-3-7" #129 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=386.24s tid=0x0000029f5261c800 nid=0x1090 runnable [0x000000be54aff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071cf05c68> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071cf06c90> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"grpc-nio-worker-ELG-3-8" #130 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=386.07s tid=0x0000029f5261f000 nid=0x48d8 runnable [0x000000be54bfe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071d37ed70> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071d37fd98> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-event-nio-server-0" #67 prio=5 os_prio=0 cpu=15.63ms elapsed=394.63s tid=0x0000029f558e1800 nid=0x351c runnable [0x000000be4e1ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071d803270> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071d8031e8> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-event-nio-server-0" #69 prio=5 os_prio=0 cpu=0.00ms elapsed=394.36s tid=0x0000029f558e0000 nid=0x52bc runnable [0x000000be506fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071d9834d8> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071d983450> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-unicast-event-nio-client-0" #70 prio=5 os_prio=0 cpu=0.00ms elapsed=394.34s tid=0x0000029f558e3000 nid=0x4c24 runnable [0x000000be507ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071d903568> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071d9034e0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-event-nio-client-0" #119 prio=5 os_prio=0 cpu=15.63ms elapsed=388.20s tid=0x0000029f4d594800 nid=0x20ac runnable [0x000000be541fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071d5ae098> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071d5af0c0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-event-nio-client-0" #120 prio=5 os_prio=0 cpu=15.63ms elapsed=388.19s tid=0x0000029f4d593000 nid=0x499c runnable [0x000000be542fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071d7ef218> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071d7f0240> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-event-nio-client-1" #127 prio=5 os_prio=0 cpu=0.00ms elapsed=386.30s tid=0x0000029f52618800 nid=0x5154 runnable [0x000000be543fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071d5a71c0> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071d5a81e8> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-event-nio-client-1" #128 prio=5 os_prio=0 cpu=15.63ms elapsed=386.29s tid=0x0000029f52614800 nid=0x45c0 runnable [0x000000be549fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000071d7e8340> (a io.netty.channel.nio.SelectedSelectionKeySet)
- locked <0x000000071d7e9368> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62)
at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"pool-2-thread-1" #17 prio=5 os_prio=0 cpu=15.63ms elapsed=400.78s tid=0x0000029f4de47000 nid=0x4470 runnable [0x000000be4e2ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x00000007044517a8> (a sun.nio.ch.Util$2)
- locked <0x0000000704451720> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:343)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:221)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 1" #18 prio=5 os_prio=0 cpu=78.13ms elapsed=400.76s tid=0x0000029f517c2800 nid=0x5740 runnable [0x000000be4e3fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070446df18> (a sun.nio.ch.Util$2)
- locked <0x000000070446de90> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 2" #19 prio=5 os_prio=0 cpu=15.63ms elapsed=400.76s tid=0x0000029f53f2d800 nid=0x100 runnable [0x000000be4e4fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070448a608> (a sun.nio.ch.Util$2)
- locked <0x000000070448a580> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 3" #20 prio=5 os_prio=0 cpu=0.00ms elapsed=400.76s tid=0x0000029f5004f800 nid=0x12c runnable [0x000000be4e5ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704418890> (a sun.nio.ch.Util$2)
- locked <0x0000000704418808> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 4" #21 prio=5 os_prio=0 cpu=0.00ms elapsed=400.76s tid=0x0000029f50052800 nid=0x5150 runnable [0x000000be4e6ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070448da40> (a sun.nio.ch.Util$2)
- locked <0x000000070448d9b8> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 5" #22 prio=5 os_prio=0 cpu=0.00ms elapsed=400.76s tid=0x0000029f50051000 nid=0x521c runnable [0x000000be4e7fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070441bb70> (a sun.nio.ch.Util$2)
- locked <0x000000070441bae8> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 6" #23 prio=5 os_prio=0 cpu=0.00ms elapsed=400.76s tid=0x0000029f50052000 nid=0x36ec runnable [0x000000be4e8ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704471268> (a sun.nio.ch.Util$2)
- locked <0x00000007044711e0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 7" #24 prio=5 os_prio=0 cpu=0.00ms elapsed=400.76s tid=0x0000029f5004d000 nid=0x988 runnable [0x000000be4e9fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704454c20> (a sun.nio.ch.Util$2)
- locked <0x0000000704454b98> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 8" #25 prio=5 os_prio=0 cpu=0.00ms elapsed=400.76s tid=0x0000029f5004e000 nid=0x77c runnable [0x000000be4eafe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704490d20> (a sun.nio.ch.Util$2)
- locked <0x0000000704490c98> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"pool-3-thread-1" #28 prio=5 os_prio=0 cpu=0.00ms elapsed=399.08s tid=0x0000029f50053800 nid=0x9f0 runnable [0x000000be4eeff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070441ee50> (a sun.nio.ch.Util$2)
- locked <0x000000070441edc8> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:343)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:221)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 9" #29 prio=5 os_prio=0 cpu=62.50ms elapsed=399.07s tid=0x0000029f5004e800 nid=0x4a10 runnable [0x000000be4effe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704457f00> (a sun.nio.ch.Util$2)
- locked <0x0000000704457e78> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 10" #30 prio=5 os_prio=0 cpu=0.00ms elapsed=399.07s tid=0x0000029f50050800 nid=0x624 runnable [0x000000be4f0fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704474548> (a sun.nio.ch.Util$2)
- locked <0x00000007044744c0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 11" #31 prio=5 os_prio=0 cpu=0.00ms elapsed=399.07s tid=0x0000029f522d8800 nid=0x1ae8 runnable [0x000000be4f1fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x00000007044911a0> (a sun.nio.ch.Util$2)
- locked <0x0000000704491010> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 12" #32 prio=5 os_prio=0 cpu=0.00ms elapsed=399.07s tid=0x0000029f522d9800 nid=0x21a0 runnable [0x000000be4f2fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704474980> (a sun.nio.ch.Util$2)
- locked <0x00000007044747f0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 13" #33 prio=5 os_prio=0 cpu=0.00ms elapsed=399.07s tid=0x0000029f522d8000 nid=0x3c68 runnable [0x000000be4f3ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x00000007044359c8> (a sun.nio.ch.Util$2)
- locked <0x0000000704435940> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 14" #34 prio=5 os_prio=0 cpu=0.00ms elapsed=399.07s tid=0x0000029f522dc000 nid=0x4c14 runnable [0x000000be4f4fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070447c100> (a sun.nio.ch.Util$2)
- locked <0x000000070447c078> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 15" #35 prio=5 os_prio=0 cpu=0.00ms elapsed=399.07s tid=0x0000029f522db000 nid=0x461c runnable [0x000000be4f5ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704498920> (a sun.nio.ch.Util$2)
- locked <0x0000000704498898> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 16" #36 prio=5 os_prio=0 cpu=0.00ms elapsed=399.07s tid=0x0000029f522dd000 nid=0x3c70 runnable [0x000000be4f6ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070447f4e8> (a sun.nio.ch.Util$2)
- locked <0x000000070447f358> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"pool-4-thread-1" #37 prio=5 os_prio=0 cpu=0.00ms elapsed=398.33s tid=0x0000029f522dd800 nid=0x2290 runnable [0x000000be4f7fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070449bd08> (a sun.nio.ch.Util$2)
- locked <0x000000070449bb78> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:343)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:221)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 17" #38 prio=5 os_prio=0 cpu=0.00ms elapsed=398.32s tid=0x0000029f522da800 nid=0x874 runnable [0x000000be4f8fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704483a10> (a sun.nio.ch.Util$2)
- locked <0x0000000704483988> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 18" #39 prio=5 os_prio=0 cpu=0.00ms elapsed=398.32s tid=0x0000029f522e2800 nid=0x5b08 runnable [0x000000be4f9ff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704486e10> (a sun.nio.ch.Util$2)
- locked <0x0000000704486c80> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 19" #40 prio=5 os_prio=0 cpu=0.00ms elapsed=398.32s tid=0x0000029f522e0000 nid=0x40c runnable [0x000000be4fafe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070461d808> (a sun.nio.ch.Util$2)
- locked <0x000000070461d780> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 20" #41 prio=5 os_prio=0 cpu=0.00ms elapsed=398.32s tid=0x0000029f522e3800 nid=0x4264 runnable [0x000000be4fbff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704607650> (a sun.nio.ch.Util$2)
- locked <0x00000007046074c0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 21" #42 prio=5 os_prio=0 cpu=0.00ms elapsed=398.32s tid=0x0000029f522e1800 nid=0x2720 runnable [0x000000be4fcfe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704603bf0> (a sun.nio.ch.Util$2)
- locked <0x0000000704603a60> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 22" #43 prio=5 os_prio=0 cpu=0.00ms elapsed=398.32s tid=0x0000029f522e1000 nid=0x2f2c runnable [0x000000be4fdff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000704600190> (a sun.nio.ch.Util$2)
- locked <0x0000000704600000> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 23" #44 prio=5 os_prio=0 cpu=0.00ms elapsed=398.32s tid=0x0000029f522e4000 nid=0x53fc runnable [0x000000be4feff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x00000007044a0208> (a sun.nio.ch.Util$2)
- locked <0x00000007044a0078> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 24" #45 prio=5 os_prio=0 cpu=0.00ms elapsed=398.32s tid=0x0000029f522de800 nid=0x391c runnable [0x000000be4ffff000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x000000070449c7a8> (a sun.nio.ch.Util$2)
- locked <0x000000070449c618> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"pool-6-thread-1" #110 prio=5 os_prio=0 cpu=0.00ms elapsed=391.86s tid=0x0000029f4d590800 nid=0x5310 runnable [0x000000be535fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x00000007761e4770> (a sun.nio.ch.Util$2)
- locked <0x00000007761e45f0> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:343)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:221)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"I/O dispatcher 25" #111 prio=5 os_prio=0 cpu=15.63ms elapsed=391.86s tid=0x0000029f4d58a800 nid=0x3644 runnable [0x000000be537fe000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(java.base@11.0.4/Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(java.base@11.0.4/WindowsSelectorImpl.java:339)
at sun.nio.ch.WindowsSelectorImpl.doSelect(java.base@11.0.4/WindowsSelectorImpl.java:167)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@11.0.4/SelectorImpl.java:124)
- locked <0x0000000776080ae0> (a sun.nio.ch.Util$2)
- locked <0x0000000776080960> (a sun.nio.ch.WindowsSelectorImpl)
at sun.nio.ch.SelectorImpl.select(java.base@11.0.4/SelectorImpl.java:136)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"Common-Cleaner" #11 daemon prio=8 os_prio=1 cpu=31.25ms elapsed=406.69s tid=0x0000029f4b4d5800 nid=0x1370 in Object.wait() [0x000000be4d6fe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@11.0.4/Native Method)
- waiting on <0x0000000702d44a48> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(java.base@11.0.4/ReferenceQueue.java:155)
- waiting to re-lock in wait() <0x0000000702d44a48> (a java.lang.ref.ReferenceQueue$Lock)
at jdk.internal.ref.CleanerImpl.run(java.base@11.0.4/CleanerImpl.java:148)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)
at jdk.internal.misc.InnocuousThread.run(java.base@11.0.4/InnocuousThread.java:134)

"Broker-0-zb-actors-0" #47 prio=5 os_prio=0 cpu=2640.63ms elapsed=397.56s tid=0x0000029f522e5000 nid=0x45d0 runnable [0x000000be500fe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:357)
at org.agrona.concurrent.BackoffIdleStrategy.idle(BackoffIdleStrategy.java:144)
at io.zeebe.util.sched.ActorThread$ActorTaskRunnerIdleStrategy.onIdle(ActorThread.java:273)
at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:96)
at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195)

"Broker-0-zb-actors-1" #48 prio=5 os_prio=0 cpu=625.00ms elapsed=397.56s tid=0x0000029f522df800 nid=0x1658 runnable [0x000000be501fe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:357)
at org.agrona.concurrent.BackoffIdleStrategy.idle(BackoffIdleStrategy.java:144)
at io.zeebe.util.sched.ActorThread$ActorTaskRunnerIdleStrategy.onIdle(ActorThread.java:273)
at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:96)
at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195)

"Broker-0-zb-fs-workers-0" #49 prio=5 os_prio=0 cpu=234.38ms elapsed=397.56s tid=0x0000029f522e6000 nid=0x5290 runnable [0x000000be502ff000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:357)
at org.agrona.concurrent.BackoffIdleStrategy.idle(BackoffIdleStrategy.java:144)
at io.zeebe.util.sched.ActorThread$ActorTaskRunnerIdleStrategy.onIdle(ActorThread.java:273)
at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:96)
at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195)

"Broker-0-zb-fs-workers-1" #50 prio=5 os_prio=0 cpu=312.50ms elapsed=397.56s tid=0x0000029f522e6800 nid=0x3c6c runnable [0x000000be503fe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:357)
at org.agrona.concurrent.BackoffIdleStrategy.idle(BackoffIdleStrategy.java:144)
at io.zeebe.util.sched.ActorThread$ActorTaskRunnerIdleStrategy.onIdle(ActorThread.java:273)
at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:96)
at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195)

"ForkJoinPool.commonPool-worker-3" #124 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=386.89s tid=0x0000029f5261a000 nid=0x3164 waiting on condition [0x000000be547fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000070489c5f8> (a java.util.concurrent.ForkJoinPool)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.ForkJoinPool.runWorker(java.base@11.0.4/ForkJoinPool.java:1628)
at java.util.concurrent.ForkJoinWorkerThread.run(java.base@11.0.4/ForkJoinWorkerThread.java:177)

"Monitor Ctrl-Break" #12 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=406.64s tid=0x0000029f4b4ef000 nid=0x124 runnable [0x000000be4d7fe000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(java.base@11.0.4/Native Method)
at java.net.SocketInputStream.socketRead(java.base@11.0.4/SocketInputStream.java:115)
at java.net.SocketInputStream.read(java.base@11.0.4/SocketInputStream.java:168)
at java.net.SocketInputStream.read(java.base@11.0.4/SocketInputStream.java:140)
at sun.nio.cs.StreamDecoder.readBytes(java.base@11.0.4/StreamDecoder.java:284)
at sun.nio.cs.StreamDecoder.implRead(java.base@11.0.4/StreamDecoder.java:326)
at sun.nio.cs.StreamDecoder.read(java.base@11.0.4/StreamDecoder.java:178)
- locked <0x0000000702d43098> (a java.io.InputStreamReader)
at java.io.InputStreamReader.read(java.base@11.0.4/InputStreamReader.java:185)
at java.io.BufferedReader.fill(java.base@11.0.4/BufferedReader.java:161)
at java.io.BufferedReader.readLine(java.base@11.0.4/BufferedReader.java:326)
- locked <0x0000000702d43098> (a java.io.InputStreamReader)
at java.io.BufferedReader.readLine(java.base@11.0.4/BufferedReader.java:392)
at com.intellij.rt.execution.application.AppMainV2$1.run(AppMainV2.java:64)

"atomix-cluster-0" #65 prio=5 os_prio=0 cpu=31.25ms elapsed=395.62s tid=0x0000029f558e4000 nid=0xef0 waiting on condition [0x000000be504ff000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d980180> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"atomix-0" #66 prio=5 os_prio=0 cpu=156.25ms elapsed=395.35s tid=0x0000029f558df000 nid=0x4f98 waiting on condition [0x000000be4dafe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d600180> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"atomix-cluster-events" #71 prio=5 os_prio=0 cpu=0.00ms elapsed=394.33s tid=0x0000029f558e5000 nid=0x3f54 waiting on condition [0x000000be508fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db80640> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.4/LinkedBlockingQueue.java:433)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"atomix-cluster-heartbeat-sender" #72 prio=5 os_prio=0 cpu=15.63ms elapsed=394.33s tid=0x0000029f558e1000 nid=0x13f4 waiting on condition [0x000000be509fe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db808c0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"atomix-cluster-event-executor-0" #73 prio=5 os_prio=0 cpu=0.00ms elapsed=394.33s tid=0x0000029f558ea000 nid=0x4be0 waiting on condition [0x000000be50afe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071da83670> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"atomix-partition-group-membership-service-0" #74 prio=5 os_prio=0 cpu=0.00ms elapsed=394.33s tid=0x0000029f558e7800 nid=0x5a74 waiting on condition [0x000000be50bfe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d8035c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-system-partition-1" #75 prio=5 os_prio=0 cpu=78.13ms elapsed=394.24s tid=0x0000029f558e6800 nid=0x2d50 waiting on condition [0x000000be50cff000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d983750> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-system-partition-1-heartbeat" #76 prio=5 os_prio=0 cpu=0.00ms elapsed=394.24s tid=0x0000029f558e8000 nid=0x3f08 waiting on condition [0x000000be50dfe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803830> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-system-partition-1-load" #77 prio=5 os_prio=0 cpu=15.63ms elapsed=394.24s tid=0x0000029f558e5800 nid=0x3b4 waiting on condition [0x000000be50eff000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db03688> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-system-partition-1-state" #78 prio=5 os_prio=0 cpu=93.75ms elapsed=394.24s tid=0x0000029f558ed000 nid=0x684 waiting on condition [0x000000be50ffe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db80cc8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-0" #79 prio=5 os_prio=0 cpu=15.63ms elapsed=394.14s tid=0x0000029f558ec000 nid=0x4f2c waiting on condition [0x000000be510ff000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-1" #80 prio=5 os_prio=0 cpu=15.63ms elapsed=394.13s tid=0x0000029f558ee000 nid=0x32d8 waiting on condition [0x000000be511fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-timeout-0" #81 prio=5 os_prio=0 cpu=0.00ms elapsed=394.12s tid=0x0000029f558ea800 nid=0x65c waiting on condition [0x000000be514fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db03ac0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-2" #82 prio=5 os_prio=0 cpu=0.00ms elapsed=394.08s tid=0x0000029f558eb800 nid=0x2b1c waiting on condition [0x000000be515fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1177)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-3" #83 prio=5 os_prio=0 cpu=0.00ms elapsed=394.08s tid=0x0000029f558e9000 nid=0x4764 waiting on condition [0x000000be516fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-4" #84 prio=5 os_prio=0 cpu=93.75ms elapsed=394.08s tid=0x0000029f4fbb7000 nid=0x4eb0 waiting on condition [0x000000be517fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1177)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-timeout-1" #85 prio=5 os_prio=0 cpu=15.63ms elapsed=394.08s tid=0x0000029f4fbbb000 nid=0x30cc waiting on condition [0x000000be518ff000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db03ac0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-5" #86 prio=5 os_prio=0 cpu=0.00ms elapsed=394.06s tid=0x0000029f4fbb7800 nid=0x10ac waiting on condition [0x000000be519fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-6" #87 prio=5 os_prio=0 cpu=0.00ms elapsed=394.06s tid=0x0000029f4fbb5000 nid=0x3780 waiting on condition [0x000000be51afe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-7" #88 prio=5 os_prio=0 cpu=0.00ms elapsed=394.06s tid=0x0000029f4fbb8800 nid=0x3558 waiting on condition [0x000000be51bfe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1177)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-timeout-2" #89 prio=5 os_prio=0 cpu=0.00ms elapsed=394.06s tid=0x0000029f4fbb9800 nid=0x14c4 waiting on condition [0x000000be51cfe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db03ac0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-8" #90 prio=5 os_prio=0 cpu=31.25ms elapsed=394.05s tid=0x0000029f4fbba000 nid=0x59ec waiting on condition [0x000000be51dfe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-9" #91 prio=5 os_prio=0 cpu=0.00ms elapsed=394.05s tid=0x0000029f4fbbb800 nid=0x33b8 waiting on condition [0x000000be51efe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-10" #92 prio=5 os_prio=0 cpu=0.00ms elapsed=394.04s tid=0x0000029f4fbb6000 nid=0x3da0 waiting on condition [0x000000be51ffe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-11" #93 prio=5 os_prio=0 cpu=0.00ms elapsed=394.04s tid=0x0000029f4fbc0000 nid=0x58b0 waiting on condition [0x000000be520fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-12" #94 prio=5 os_prio=0 cpu=0.00ms elapsed=394.04s tid=0x0000029f4fbc0800 nid=0x2390 waiting on condition [0x000000be521fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1177)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"netty-messaging-timeout-3" #95 prio=5 os_prio=0 cpu=0.00ms elapsed=394.04s tid=0x0000029f4fbbd800 nid=0x4244 waiting on condition [0x000000be522fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db03ac0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-13" #96 prio=5 os_prio=0 cpu=0.00ms elapsed=394.04s tid=0x0000029f4fbc1800 nid=0x4f54 waiting on condition [0x000000be523fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-14" #97 prio=5 os_prio=0 cpu=0.00ms elapsed=394.04s tid=0x0000029f4fbbe000 nid=0x3540 waiting on condition [0x000000be524fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-system-15" #98 prio=5 os_prio=0 cpu=31.25ms elapsed=394.04s tid=0x0000029f4fbc2000 nid=0x54a8 waiting on condition [0x000000be525fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d803a98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-raft-partition-partition-2" #99 prio=5 os_prio=0 cpu=15.63ms elapsed=394.03s tid=0x0000029f4fbbf000 nid=0x49b4 waiting on condition [0x000000be526ff000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071da83b18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-raft-partition-partition-2-heartbeat" #100 prio=5 os_prio=0 cpu=0.00ms elapsed=394.03s tid=0x0000029f4fbbc800 nid=0x321c waiting on condition [0x000000be527fe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d9839f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-raft-partition-partition-2-load" #101 prio=5 os_prio=0 cpu=0.00ms elapsed=394.03s tid=0x0000029f4fbc3000 nid=0x3170 waiting on condition [0x000000be528fe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db82d90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-raft-partition-partition-2-state" #102 prio=5 os_prio=0 cpu=156.25ms elapsed=394.03s tid=0x0000029f4fbc4000 nid=0x1e9c waiting on condition [0x000000be529ff000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d983e08> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-raft-partition-partition-1" #103 prio=5 os_prio=0 cpu=15.63ms elapsed=394.00s tid=0x0000029f4d58d000 nid=0x4528 waiting on condition [0x000000be52aff000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071d9039b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-raft-partition-partition-1-heartbeat" #104 prio=5 os_prio=0 cpu=0.00ms elapsed=394.00s tid=0x0000029f4d58e000 nid=0x2db0 waiting on condition [0x000000be52bfe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db82ff8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-raft-partition-partition-1-load" #105 prio=5 os_prio=0 cpu=0.00ms elapsed=394.00s tid=0x0000029f4d58a000 nid=0x335c waiting on condition [0x000000be52cff000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db84d80> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.4/LockSupport.java:234)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.4/AbstractQueuedSynchronizer.java:2123)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1182)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-server-0-raft-partition-partition-1-state" #106 prio=5 os_prio=0 cpu=31.25ms elapsed=394.00s tid=0x0000029f4d58c800 nid=0x858 waiting on condition [0x000000be52dfe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db85a78> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-raft-partition-0" #107 prio=5 os_prio=0 cpu=0.00ms elapsed=393.99s tid=0x0000029f4d58f000 nid=0x3700 waiting on condition [0x000000be52eff000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db861c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"raft-partition-group-raft-partition-1" #108 prio=5 os_prio=0 cpu=0.00ms elapsed=393.96s tid=0x0000029f4d589000 nid=0x4ed0 waiting on condition [0x000000be52ffe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x000000071db861c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:1170)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.4/ScheduledThreadPoolExecutor.java:899)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"import_1" #123 prio=5 os_prio=0 cpu=15.63ms elapsed=386.93s tid=0x0000029f52616000 nid=0x46b0 waiting on condition [0x000000be546ff000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x0000000705866668> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.4/LinkedBlockingQueue.java:433)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"import_2" #125 prio=5 os_prio=0 cpu=15.63ms elapsed=386.89s tid=0x0000029f52616800 nid=0x2f84 waiting on condition [0x000000be548fe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x0000000705866668> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.4/LinkedBlockingQueue.java:433)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"import_3" #131 prio=5 os_prio=0 cpu=46.88ms elapsed=385.90s tid=0x0000029f52619000 nid=0x30dc waiting on condition [0x000000be54cfe000]
java.lang.Thread.State: WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@11.0.4/Native Method)
- parking to wait for <0x0000000705866668> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(java.base@11.0.4/LockSupport.java:194)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.4/AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.4/LinkedBlockingQueue.java:433)
at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.4/ThreadPoolExecutor.java:1054)
at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.4/ThreadPoolExecutor.java:1114)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.4/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(java.base@11.0.4/Thread.java:834)

"Reference Handler" #2 daemon prio=10 os_prio=2 cpu=15.63ms elapsed=406.89s tid=0x0000029f4b1d0000 nid=0x3cc waiting on condition [0x000000be4cffe000]
java.lang.Thread.State: RUNNABLE
at java.lang.ref.Reference.waitForReferencePendingList(java.base@11.0.4/Native Method)
at java.lang.ref.Reference.processPendingReferences(java.base@11.0.4/Reference.java:241)
at java.lang.ref.Reference$ReferenceHandler.run(java.base@11.0.4/Reference.java:213)

"Finalizer" #3 daemon prio=8 os_prio=1 cpu=15.63ms elapsed=406.89s tid=0x0000029f4b1dc000 nid=0x36bc in Object.wait() [0x000000be4d0fe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@11.0.4/Native Method)
- waiting on <0x0000000702d403b0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(java.base@11.0.4/ReferenceQueue.java:155)
- waiting to re-lock in wait() <0x0000000702d403b0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(java.base@11.0.4/ReferenceQueue.java:176)
at java.lang.ref.Finalizer$FinalizerThread.run(java.base@11.0.4/Finalizer.java:170)

"Signal Dispatcher" #4 daemon prio=9 os_prio=2 cpu=0.00ms elapsed=406.88s tid=0x0000029f4b231800 nid=0x4820 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"Attach Listener" #5 daemon prio=5 os_prio=2 cpu=31.25ms elapsed=406.88s tid=0x0000029f4b232800 nid=0x515c waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=2 cpu=11796.88ms elapsed=406.88s tid=0x0000029f4b234800 nid=0x3a30 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
No compile task

"C1 CompilerThread0" #9 daemon prio=9 os_prio=2 cpu=3859.38ms elapsed=406.88s tid=0x0000029f4b23b000 nid=0x1bd8 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
No compile task

"Sweeper thread" #10 daemon prio=9 os_prio=2 cpu=125.00ms elapsed=406.88s tid=0x0000029f4b240800 nid=0x427c runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"Service Thread" #13 daemon prio=9 os_prio=0 cpu=93.75ms elapsed=406.64s tid=0x0000029f4b37b800 nid=0x4e88 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"VM Thread" os_prio=2 cpu=125.00ms elapsed=406.90s tid=0x0000029f4b1ac800 nid=0x48e4 runnable

"GC Thread#0" os_prio=2 cpu=218.75ms elapsed=406.92s tid=0x0000029f27099800 nid=0x48bc runnable

"GC Thread#1" os_prio=2 cpu=218.75ms elapsed=406.41s tid=0x0000029f4bc32800 nid=0x43b4 runnable

"GC Thread#2" os_prio=2 cpu=218.75ms elapsed=406.41s tid=0x0000029f4be07800 nid=0x1a0 runnable

"GC Thread#3" os_prio=2 cpu=218.75ms elapsed=406.41s tid=0x0000029f4c237000 nid=0x155c runnable

"GC Thread#4" os_prio=2 cpu=171.88ms elapsed=406.41s tid=0x0000029f4c237800 nid=0x53b0 runnable

"GC Thread#5" os_prio=2 cpu=187.50ms elapsed=406.41s tid=0x0000029f4c238000 nid=0x1ee0 runnable

"GC Thread#6" os_prio=2 cpu=171.88ms elapsed=399.45s tid=0x0000029f53013800 nid=0x2538 runnable

"GC Thread#7" os_prio=2 cpu=140.63ms elapsed=399.45s tid=0x0000029f5560d000 nid=0x532c runnable

"G1 Main Marker" os_prio=2 cpu=0.00ms elapsed=406.92s tid=0x0000029f270f7800 nid=0x45cc runnable

"G1 Conc#0" os_prio=2 cpu=187.50ms elapsed=406.92s tid=0x0000029f270f8800 nid=0x3814 runnable

"G1 Conc#1" os_prio=2 cpu=187.50ms elapsed=404.58s tid=0x0000029f4cd39800 nid=0xf6c runnable

"G1 Refine#0" os_prio=2 cpu=46.88ms elapsed=406.92s tid=0x0000029f4a805000 nid=0x5930 runnable

"G1 Refine#1" os_prio=2 cpu=0.00ms elapsed=397.04s tid=0x0000029f50cff000 nid=0x2404 runnable

"G1 Refine#2" os_prio=2 cpu=0.00ms elapsed=396.74s tid=0x0000029f52c30000 nid=0x58d0 runnable

"G1 Young RemSet Sampling" os_prio=2 cpu=0.00ms elapsed=406.92s tid=0x0000029f4a806000 nid=0x35fc runnable

"VM Periodic Task Thread" os_prio=2 cpu=31.25ms elapsed=406.64s tid=0x0000029f4b8bb000 nid=0x438c waiting on condition
JNI global refs: 29, weak refs: 0

Environment:

  • OS: Windows 10
  • Zeebe Version: 0.23.0-SNAPSHOT
  • Configuration: can be seen in attached log
@sdorokhova sdorokhova added the kind/bug Categorizes an issue or PR as a bug label Feb 19, 2020
@Zelldon
Copy link
Member

Zelldon commented Feb 19, 2020

Might be related facebook/rocksdb#5064

menski added a commit that referenced this issue Feb 20, 2020
We experience problems with Broker shutdowns on Windows with the latest
RocksDB version. Until we resolved these issues we should not upgrade.

related to #3878
@npepinpe
Copy link
Member

Closed by 4160666

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Categorizes an issue or PR as a bug
Projects
None yet
Development

No branches or pull requests

5 participants