markuze/experiment vanila 100 no buffers

[Markuze]

• [forge] fix grafana namespace ([forge] fix grafana namespace #4602)
• [HApropxy] new haproxy config and resources
• [Docker] Adding HAProxy to docker compose
• [tokio-console] Configuring tokio-console default port
• [aptos-cli] Bump to version 0.3.6
• [storage] larger default state prune window
• refactor: add "strict" to SDK tsconfig
• [helm][aptos-node] override NodeConfig with deep merge ([helm][aptos-node] override NodeConfig with deep merge #4546)
• add indexer to cli ([Indexer] Add indexer to aptos cli #4586)
• Node docs (Node docs #4572)
• [SDK][API] Remove event key endpoint / client code ([SDK][API] Remove event key endpoint / client code #4338)
• [backup] tf: add back backup intervals
• [consensus] support a recovery mode if consensusdb is gone
• [forge][telemetry] enable node telemetry in forge ([forge][telemetry] Enable node telemetry service in forge #4490)
• [storage] rename target_snapshot_size ([storage] rename target_snapshot_size #4615)
• [txn-emitter] Fix computation for needed coin balance ([txn-emitter] Fix computation for needed coin balance #4614)
• [executor] fix integration test helper
• enable backup-cli unit tests in ci
• [gha] Make forge namespace optional
• [network] limit the max fragments in stream message
• [consensus] limit the payload size and remove unused quorum store variant
• [doc] update doc to remove test mode ([doc] update doc to remove test mode #4626)
• [gha] Enable release on PR, enable HAProxy on release test
• [Aptos Stdlib] Make scaling factor actually useful in pool_u64
• [API Client] Fix wait_for_transaction to wait for expiry and return better messages ([API Client] Fix wait_for_transaction to wait for expiry and return better messages #4456)
• [Lint only] Fix docs lint
• [Vesting][Audit] Fix several minor issues in the vesting contract ([Vesting][Audit] Fix several minor issues in the vesting contract #4560)
• [Audit][Aptos Framework][Staking contract] Zero out distribution pool when settling dust ([Audit][Aptos Framework][Staking contract] Zero out distribution pool when settling dust #4585)
• [Token] Enfore no zero balance token
• [move] Do not include vector native implementations ([move] Do not include vector native implementations #4621)
• [Stake] Validate lockup ([Stake] Validate lockup #4632)
• [forge] fix max_block_txns rename ([forge] fix max_block_txns rename #4643)
• [move-examples] nft move example ([move-examples] NFT minting example  #4512)
• [Staking] Move validator to pending_inactive instead of directly removing ([Staking] Move validator to pending_inactive instead of directly removing #4633)
• [consensus] Remove skip_serializing_if from BlockRetreivalRequest ([consensus] Remove skip_serializing_if from BlockRetreivalRequest #4644)
• [telemetry] Send build info periodically
• [telemetry] Retry sending telemetry on transient errors
• [telemetry] Reset RUST_LOG_TELEMETRY to original value on unset
• [telemetry] send node config as event periodically
• Update connect-to-aptos-network.md
• [Config] Update disk size to 1000Gi. ([Config] Update disk size to 1000Gi. #4622)
• Update API changelog
• [audit] timestamp.move ([audit] timestamp.move #4619)
• [cli] Increase REST endpoint timeout to 30s ([cli] Increase REST endpoint timeout to 30s #4628)
• [Token] reorgnize code
• [mempool] more/better metrics ([mempool] more/better metrics #4616)
• [Prover spec only] Fix a typo in the bit_vector.move's prover specs ([Prover spec only] Fix a typo in the bit_vector.move's prover specs #4654)
• Fixed the spec in the stake module ([Stake] Fixed the spec in the stake module #4656)
• [forge] Add tests for validation set changes ([forge] Add a test for validation set changes #4279)
• [Audit] Fix minor issues from audit
• Add complex token table indexing ([Indexer] Add token activity and token claim support #4324)
• added gas-estimation benchmarks for BLS12-381, Ed25519, secp256k1, Ristretto255 and cryptographic hash functions (Gas costs for BLS12-381, Ed25519, secp256k1, Ristretto255 and cryptographic hash functions #4630)
• [gas] initial gas parameters for table operations ([gas] initial gas parameters for table operations #4659)
• [Token] Relax time constraint
• [Token] deprecate the token_coin_swap
• [Voting] Ensure proposal execution cannot happen in the same transaction as the last vote ([Voting] Ensure proposal execution cannot happen in the same transaction as the last vote #4612)
• [aggregator] Fix delta merging with history
• fixed a typo
• fixed ordering of delta merging
• fixed ordering of delta merging 2
• fixed a typo
• fixed naming
• changed names, used unwrap_or
• refactored code to remove duplication between match arms
• changed old names in macros
• [aptos-node] fixing the VM natives by excluding move-deps from the dependency tree ([aptos-node] fixing the VM natives by excluding move-deps from the dependency tree #4660)
• no memory increase for TCP buffers
• 2HR vanila haproxy run - 100 nodes

Description

Test Plan

---

This change is 

[github-actions]

❌ Forge suite compat failure on 843b204dce971d98449b82624f4f684c7a18b991 ==> 0bc2fc946b5a4b938ebec58c48684f04ef54c1ec

Compatibility test results for 843b204dce971d98449b82624f4f684c7a18b991 ==> 0bc2fc946b5a4b938ebec58c48684f04ef54c1ec (PR)
1. Check liveness of validators at old version: 843b204dce971d98449b82624f4f684c7a18b991
compatibility::simple-validator-upgrade::liveness-check : 6742 TPS, 5953 ms latency, 9000 ms p99 latency,(!) expired 40 out of 202320 txns
2. Upgrading first Validator to new version: 0bc2fc946b5a4b938ebec58c48684f04ef54c1ec
Test Failed: Failed to wait for transactions: Unknown(Transaction expired, it is guaranteed it will not be committed on chain.)
Trailing Log Lines:
::error::Failed to wait for transactions: Unknown(Transaction expired, it is guaranteed it will not be committed on chain.)
test compatibility::simple-validator-upgrade ... FAILED
Error: Failed to wait for transactions: Unknown(Transaction expired, it is guaranteed it will not be committed on chain.)
Test Statistics: 
Compatibility test results for 843b204dce971d98449b82624f4f684c7a18b991 ==> 0bc2fc946b5a4b938ebec58c48684f04ef54c1ec (PR)
1. Check liveness of validators at old version: 843b204dce971d98449b82624f4f684c7a18b991
compatibility::simple-validator-upgrade::liveness-check : 6742 TPS, 5953 ms latency, 9000 ms p99 latency,(!) expired 40 out of 202320 txns
2. Upgrading first Validator to new version: 0bc2fc946b5a4b938ebec58c48684f04ef54c1ec
Test Failed: Failed to wait for transactions: Unknown(Transaction expired, it is guaranteed it will not be committed on chain.)


Swarm logs can be found here: See fgi output for more information.
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:280"},"thread_name":"main","hostname":"forge-compat-pr-4677-1665073359-843b204dce971d98449b82624f4f684","timestamp":"2022-10-06T16:32:50.588711Z","message":"Deleting namespace forge-compat-pr-4677: Some(NamespaceStatus { phase: Some(\"Terminating\") })"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:388"},"thread_name":"main","hostname":"forge-compat-pr-4677-1665073359-843b204dce971d98449b82624f4f684","timestamp":"2022-10-06T16:32:50.588735Z","message":"aptos-node resources for Forge removed in namespace: forge-compat-pr-4677"}

failures:
    compatibility::simple-validator-upgrade

test result: FAILED. 0 passed; 1 failed; 0 filtered out

Failed to run tests:
Tests Failed
Error: Tests Failed
Debugging output:
NAME                                     READY   STATUS      RESTARTS   AGE
aptos-node-0-haproxy-7d69d75c48-c4d5w    1/1     Running     0          7m47s
aptos-node-0-validator-0                 1/1     Running     0          7m47s
aptos-node-1-haproxy-8bdb58c45-pphnl     1/1     Running     0          7m47s
aptos-node-1-validator-0                 1/1     Running     0          7m47s
aptos-node-10-haproxy-77f7c89b4d-6q7nl   1/1     Running     0          7m47s
aptos-node-10-validator-0                1/1     Running     0          7m47s
aptos-node-11-haproxy-85b9797475-j9nx5   1/1     Running     0          7m47s
aptos-node-11-validator-0                1/1     Running     0          7m47s
aptos-node-12-haproxy-5bf4444bc9-d5b2b   1/1     Running     0          7m47s
aptos-node-12-validator-0                1/1     Running     0          7m47s
aptos-node-13-haproxy-584545bff7-mhlgk   1/1     Running     0          7m47s
aptos-node-13-validator-0                1/1     Running     0          7m47s
aptos-node-14-haproxy-79d6984ddc-9vh9d   1/1     Running     0          7m47s
aptos-node-14-validator-0                1/1     Running     0          7m47s
aptos-node-15-haproxy-55d4fcd74-mhs7j    1/1     Running     0          7m47s
aptos-node-15-validator-0                1/1     Running     0          7m47s
aptos-node-16-haproxy-86c85b4d9b-jsg4l   1/1     Running     0          7m47s
aptos-node-16-validator-0                1/1     Running     0          7m47s
aptos-node-17-haproxy-6d9d55d44b-b7dj4   1/1     Running     0          7m47s
aptos-node-17-validator-0                1/1     Running     0          7m47s
aptos-node-18-haproxy-599dc5fd85-h5j8m   1/1     Running     0          7m45s
aptos-node-18-validator-0                1/1     Running     0          7m47s
aptos-node-19-haproxy-b859c6c87-wbkv7    1/1     Running     0          7m45s
aptos-node-19-validator-0                1/1     Running     0          7m47s
aptos-node-2-haproxy-8f5cc45b9-wq6dt     1/1     Running     0          7m47s
aptos-node-2-validator-0                 1/1     Running     0          7m47s
aptos-node-20-haproxy-566db7894d-wdllt   1/1     Running     0          7m46s
aptos-node-20-validator-0                1/1     Running     0          7m46s
aptos-node-21-haproxy-dc49d455b-k4jf4    1/1     Running     0          7m47s
aptos-node-21-validator-0                1/1     Running     0          7m46s
aptos-node-22-haproxy-6bcb5c79d4-jhn58   1/1     Running     0          7m47s
aptos-node-22-validator-0                1/1     Running     0          7m46s
aptos-node-23-haproxy-796b6d7fcd-rnb2j   1/1     Running     0          7m46s
aptos-node-23-validator-0                1/1     Running     0          7m46s
aptos-node-24-haproxy-85b84d5946-9pd8m   1/1     Running     0          7m45s
aptos-node-24-validator-0                1/1     Running     0          7m47s
aptos-node-25-haproxy-6b6855c6cf-w2hfx   1/1     Running     0          7m47s
aptos-node-25-validator-0                1/1     Running     0          7m46s
aptos-node-26-haproxy-787bc647cf-75d9w   1/1     Running     0          7m45s
aptos-node-26-validator-0                1/1     Running     0          7m46s
aptos-node-27-haproxy-77dc765b45-kgkw5   1/1     Running     0          7m47s
aptos-node-27-validator-0                1/1     Running     0          7m46s
aptos-node-28-haproxy-64bf8cf977-nncvt   1/1     Running     0          7m45s
aptos-node-28-validator-0                1/1     Running     0          7m44s
aptos-node-29-haproxy-7cd57cc958-qlpc6   1/1     Running     0          7m47s
aptos-node-29-validator-0                1/1     Running     0          7m44s
aptos-node-3-haproxy-7d7f67677b-9xnsf    1/1     Running     0          7m47s
aptos-node-3-validator-0                 1/1     Running     0          7m47s
aptos-node-30-haproxy-6bbfc59bbf-5t7dn   1/1     Running     0          7m46s
aptos-node-30-validator-0                1/1     Running     0          7m46s
aptos-node-31-haproxy-f5cc698b8-hh6bk    1/1     Running     0          7m45s
aptos-node-31-validator-0                1/1     Running     0          7m44s
aptos-node-32-haproxy-647cd695b6-mq6hz   1/1     Running     0          7m46s
aptos-node-32-validator-0                1/1     Running     0          7m44s
aptos-node-33-haproxy-bdd55fd69-tlrrw    1/1     Running     0          7m47s
aptos-node-33-validator-0                1/1     Running     0          7m44s
aptos-node-34-haproxy-6fd4fc969-n4f5f    1/1     Running     0          7m47s
aptos-node-34-validator-0                1/1     Running     0          7m47s
aptos-node-35-haproxy-664dd4f7fc-2z2cj   1/1     Running     0          7m46s
aptos-node-35-validator-0                1/1     Running     0          7m46s
aptos-node-36-haproxy-567b65bbf6-5f42g   1/1     Running     0          7m47s
aptos-node-36-validator-0                1/1     Running     0          7m45s
aptos-node-37-haproxy-6bd475cff7-5q7dk   1/1     Running     0          7m47s
aptos-node-37-validator-0                1/1     Running     0          7m45s
aptos-node-38-haproxy-7b9567cd9c-n8pwx   1/1     Running     0          7m46s
aptos-node-38-validator-0                1/1     Running     0          7m44s
aptos-node-39-haproxy-57595b5fb6-dvrs2   1/1     Running     0          7m46s
aptos-node-39-validator-0                1/1     Running     0          7m47s
aptos-node-4-haproxy-77cf88649b-xzljq    1/1     Running     0          7m46s
aptos-node-4-validator-0                 1/1     Running     0          7m47s
aptos-node-40-haproxy-75fbd5bbd5-j5c8n   1/1     Running     0          7m46s
aptos-node-40-validator-0                1/1     Running     0          7m45s
aptos-node-41-haproxy-789b5f67f4-ztv2d   1/1     Running     0          7m47s
aptos-node-41-validator-0                1/1     Running     0          7m44s
aptos-node-42-haproxy-796986798c-ls2tr   1/1     Running     0          7m46s
aptos-node-42-validator-0                1/1     Running     0          7m46s
aptos-node-43-haproxy-dc6d74c56-kpdb8    1/1     Running     0          7m47s
aptos-node-43-validator-0                1/1     Running     0          7m46s
aptos-node-44-haproxy-64bd74ff69-vkxp6   1/1     Running     0          7m47s
aptos-node-44-validator-0                1/1     Running     0          7m45s
aptos-node-45-haproxy-6576d8f4d4-tdqnm   1/1     Running     0          7m47s
aptos-node-45-validator-0                1/1     Running     0          7m45s
aptos-node-46-haproxy-655f8f655d-nj2s4   1/1     Running     0          7m45s
aptos-node-46-validator-0                1/1     Running     0          7m44s
aptos-node-47-haproxy-5fbd5547f8-mgjmm   1/1     Running     0          7m44s
aptos-node-47-validator-0                1/1     Running     0          7m44s
aptos-node-48-haproxy-547bd46756-5h87m   1/1     Running     0          7m44s
aptos-node-48-validator-0                1/1     Running     0          7m46s
aptos-node-49-haproxy-88f7b64bc-kj6jc    1/1     Running     0          7m46s
aptos-node-49-validator-0                1/1     Running     0          2m8s
aptos-node-5-haproxy-8558fb55-5vw8v      1/1     Running     0          7m46s
aptos-node-5-validator-0                 1/1     Running     0          7m46s
aptos-node-50-haproxy-976c575bc-9q8bv    1/1     Running     0          7m44s
aptos-node-50-validator-0                1/1     Running     0          7m46s
aptos-node-51-haproxy-5874968d5d-phnb7   1/1     Running     0          7m44s
aptos-node-51-validator-0                1/1     Running     0          7m44s
aptos-node-52-haproxy-5d97cc7895-hn58z   1/1     Running     0          7m45s
aptos-node-52-validator-0                1/1     Running     0          7m44s
aptos-node-53-haproxy-66956b47-x52rz     1/1     Running     0          7m44s
aptos-node-53-validator-0                1/1     Running     0          7m46s
aptos-node-54-haproxy-6b898cb88-rtl2h    1/1     Running     0          7m44s
aptos-node-54-validator-0                1/1     Running     0          7m45s
aptos-node-55-haproxy-64d8d585df-rcqcb   1/1     Running     0          7m44s
aptos-node-55-validator-0                1/1     Running     0          7m45s
aptos-node-56-haproxy-7457c66545-45g2r   1/1     Running     0          7m44s
aptos-node-56-validator-0                1/1     Running     0          7m44s
aptos-node-57-haproxy-5485bc6667-4rjgm   1/1     Running     0          7m46s
aptos-node-57-validator-0                1/1     Running     0          7m47s
aptos-node-58-haproxy-5458957fb6-96kjt   1/1     Running     0          7m45s
aptos-node-58-validator-0                1/1     Running     0          7m46s
aptos-node-59-haproxy-577498d9b9-wklmp   1/1     Running     0          7m47s
aptos-node-59-validator-0                1/1     Running     0          7m44s
aptos-node-6-haproxy-564448486f-vbrr6    1/1     Running     0          7m47s
aptos-node-6-validator-0                 1/1     Running     0          7m47s
aptos-node-60-haproxy-7bd764b85c-sd4t5   1/1     Running     0          7m44s
aptos-node-60-validator-0                1/1     Running     0          7m47s
aptos-node-61-haproxy-c985978b9-vwqqb    1/1     Running     0          7m47s
aptos-node-61-validator-0                1/1     Running     0          7m44s
aptos-node-62-haproxy-58bd4c975b-6qrl4   1/1     Running     0          7m45s
aptos-node-62-validator-0                1/1     Running     0          7m47s
aptos-node-63-haproxy-7bc5fdd86d-7pcrq   1/1     Running     0          7m45s
aptos-node-63-validator-0                1/1     Running     0          7m47s
aptos-node-64-haproxy-85d9f469f-8g978    1/1     Running     0          7m45s
aptos-node-64-validator-0                1/1     Running     0          7m47s
aptos-node-65-haproxy-5dcccc8d-sd45d     1/1     Running     0          7m45s
aptos-node-65-validator-0                1/1     Running     0          7m44s
aptos-node-66-haproxy-6dbf755547-9x5mq   1/1     Running     0          7m44s
aptos-node-66-validator-0                1/1     Running     0          7m46s
aptos-node-67-haproxy-66db786fb4-cn6q7   1/1     Running     0          7m46s
aptos-node-67-validator-0                1/1     Running     0          7m44s
aptos-node-68-haproxy-674675bd56-kqc2t   1/1     Running     0          7m45s
aptos-node-68-validator-0                1/1     Running     0          7m45s
aptos-node-69-haproxy-6c7657957b-msmmk   1/1     Running     0          7m45s
aptos-node-69-validator-0                1/1     Running     0          7m47s
aptos-node-7-haproxy-64c8f9cb75-nrblc    1/1     Running     0          7m45s
aptos-node-7-validator-0                 1/1     Running     0          7m47s
aptos-node-70-haproxy-664449bdd8-pcqgd   1/1     Running     0          7m46s
aptos-node-70-validator-0                1/1     Running     0          7m45s
aptos-node-71-haproxy-5645b54769-9nd6k   1/1     Running     0          7m47s
aptos-node-71-validator-0                1/1     Running     0          7m46s
aptos-node-72-haproxy-7dbcfd58c5-stzj8   1/1     Running     0          7m46s
aptos-node-72-validator-0                1/1     Running     0          7m47s
aptos-node-73-haproxy-6f95d69856-bpjzd   1/1     Running     0          7m46s
aptos-node-73-validator-0                1/1     Running     0          7m46s
aptos-node-74-haproxy-69697f6cdc-kctx8   1/1     Running     0          7m44s
aptos-node-74-validator-0                1/1     Running     0          7m45s
aptos-node-75-haproxy-7c8f7f7447-pxgp5   1/1     Running     0          7m44s
aptos-node-75-validator-0                1/1     Running     0          7m46s
aptos-node-76-haproxy-85bdb85cb9-nq79n   1/1     Running     0          7m47s
aptos-node-76-validator-0                1/1     Running     0          7m46s
aptos-node-77-haproxy-7666765979-45s4m   1/1     Running     0          7m45s
aptos-node-77-validator-0                1/1     Running     0          7m46s
aptos-node-78-haproxy-6448b48d9-ck6jh    1/1     Running     0          7m47s
aptos-node-78-validator-0                1/1     Running     0          7m44s
aptos-node-79-haproxy-69d9488dff-b5pfq   1/1     Running     0          7m45s
aptos-node-79-validator-0                1/1     Running     0          7m44s
aptos-node-8-haproxy-d68c4d9c6-zlctr     1/1     Running     0          7m47s
aptos-node-8-validator-0                 1/1     Running     0          7m46s
aptos-node-80-haproxy-56c5877dfc-r94lh   1/1     Running     0          7m45s
aptos-node-80-validator-0                1/1     Running     0          7m44s
aptos-node-81-haproxy-7746bcd7d7-tpkjr   1/1     Running     0          7m47s
aptos-node-81-validator-0                1/1     Running     0          7m47s
aptos-node-82-haproxy-5cbdb96c6c-kczft   1/1     Running     0          7m44s
aptos-node-82-validator-0                1/1     Running     0          7m45s
aptos-node-83-haproxy-55f7fd7fc4-bczpf   1/1     Running     0          7m47s
aptos-node-83-validator-0                1/1     Running     0          7m45s
aptos-node-84-haproxy-847d4754d6-6k8j6   1/1     Running     0          7m46s
aptos-node-84-validator-0                1/1     Running     0          7m45s
aptos-node-85-haproxy-8bdd4c6b9-qql2r    1/1     Running     0          7m44s
aptos-node-85-validator-0                1/1     Running     0          7m45s
aptos-node-86-haproxy-76c9cc7ddd-44jzr   1/1     Running     0          7m47s
aptos-node-86-validator-0                1/1     Running     0          7m45s
aptos-node-87-haproxy-64959959d5-v2x8g   1/1     Running     0          7m44s
aptos-node-87-validator-0                1/1     Running     0          7m47s
aptos-node-88-haproxy-64cd5f99cc-g55p6   1/1     Running     0          7m45s
aptos-node-88-validator-0                1/1     Running     0          7m45s
aptos-node-89-haproxy-5dc784cc9f-v68rf   1/1     Running     0          7m45s
aptos-node-89-validator-0                1/1     Running     0          7m45s
aptos-node-9-haproxy-5bf9dcd47-55f6j     1/1     Running     0          7m47s
aptos-node-9-validator-0                 1/1     Running     0          7m47s
aptos-node-90-haproxy-65596669bc-6ng9v   1/1     Running     0          7m46s
aptos-node-90-validator-0                1/1     Running     0          7m47s
aptos-node-91-haproxy-67589d8867-qfbdc   1/1     Running     0          7m44s
aptos-node-91-validator-0                1/1     Running     0          7m46s
aptos-node-92-haproxy-645ddb5cbf-kmmjd   1/1     Running     0          7m46s
aptos-node-92-validator-0                1/1     Running     0          7m44s
aptos-node-93-haproxy-7679568474-9ckxf   1/1     Running     0          7m44s
aptos-node-93-validator-0                1/1     Running     0          7m44s
aptos-node-94-haproxy-585c4c77d6-jgmvr   1/1     Running     0          7m46s
aptos-node-94-validator-0                1/1     Running     0          7m47s
aptos-node-95-haproxy-588857dd7-m8xh4    1/1     Running     0          7m46s
aptos-node-95-validator-0                1/1     Running     0          7m47s
aptos-node-96-haproxy-9d7d57b55-vrkvk    1/1     Running     0          7m45s
aptos-node-96-validator-0                1/1     Running     0          7m45s
aptos-node-97-haproxy-55df66c5c9-4sppk   1/1     Running     0          7m45s
aptos-node-97-validator-0                1/1     Running     0          7m45s
aptos-node-98-haproxy-777cb8886f-h94gv   1/1     Running     0          7m44s
aptos-node-98-validator-0                1/1     Running     0          7m45s
aptos-node-99-haproxy-75d6d5775c-psqmj   1/1     Running     0          7m47s
aptos-node-99-validator-0                1/1     Running     0          7m47s
genesis-aptos-genesis-eforge75-lnwm8     0/1     Completed   0          9m24s

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions]

✅ Forge suite land_blocking success on 0bc2fc946b5a4b938ebec58c48684f04ef54c1ec

performance benchmark with full nodes : 6554 TPS, 6021 ms latency, 14700 ms p99 latency,(!) expired 2980 out of 2801940 txns
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking