Make simulator Great Again!

[HuSharp]

Development Task

• Currently, we have many components to simulate the interaction with pd, pd-api-bench, pd-tso-bench, pd-heartbeat-bench, pd-simulator. We can integrate them step by step, with lower learning costs and easier interaction testing of various pd's.
  • Enhance simulator to support 1000w regions and 300 stores
    • simulator: make store,region,replica configurable in cases #8215
    • simulator: scale-in and scale out test for store-limit-version=v2 #8220
    • tools: support triggering an event through HTTP API #5677
    • tools/simulator: add store api and replace simulator http with SDK #8245
    • tools/simulator: support deleting a specified store #8246
    • tools/simulator: avoid redundant schedule #8257
    • tools/simulator: Make simulator work with large scale cluster #8269
    • tools/simulator: support simulator with multiple pds #8304
    • TODO:
      • add rules case
  • Enhance heartbeat bench for daily regression testing
    • tools/heartbeat: support to collect metrics #8235
• After that we can provide pd the same specification machine to deploy the real pd under the big cluster, simulate the request number of TiDB/TiKV + TiKV heartbeat heartbeat report + all kinds of scheduling for the region and so on.
  • tools: support pd dev #8140

mock TiKV data to archive the following goals:

• can balance region...
• can support three forms node: meta-node/simulator(simple raft)/real-tikv
• support unified interface to interact with real-tikv

mock TiDB&TiKV API

existed tool usages like

./bin/pd-api-bench -http-cases GetRegionStatus-1+1,GetMinResolvedTS-1+1 -client 1 -debug true

mock TiKV heartbeat/TSO

existed tool usages like
./bin/pd-heartbeat-bench --config=./tools/pd-heartbeat-bench/config-template.toml --pd-endpoints http://127.0.0.1:2379

Others

• support front operator

Related

• integration simulator tools tools: support pd dev #8140

#5468 extend simulator
#6922 extend API bench