Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[forge] Add state sync catching up stress tests #4036

Merged
merged 1 commit into from Sep 30, 2022

Conversation

igor-aptos
Copy link
Contributor

@igor-aptos igor-aptos commented Sep 9, 2022

Description

Adds two tests, where we send constant TPS, and have nodes get stale, and see that they catchup.

(will separately send a PR to add a check that they participate in the consensus)

  • test 1 - cut network on a node for some period of time
  • test 2 - make subset of nodes execute blocks slower (by adding sleep in aptos_vm block metadata processing)

Test Plan

run both on forge to confirm they pass


This change is Reviewable

@igor-aptos igor-aptos added the CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR label Sep 9, 2022
@igor-aptos igor-aptos marked this pull request as draft September 9, 2022 18:03
@igor-aptos igor-aptos removed request for a team, davidiw, wrwg and zekun000 September 9, 2022 18:03
@igor-aptos igor-aptos force-pushed the igor/add_state_sync_tests branch 7 times, most recently from 5cea34a to 0334c68 Compare September 15, 2022 20:17
@github-actions

This comment was marked as outdated.

@igor-aptos igor-aptos force-pushed the igor/add_state_sync_tests branch 2 times, most recently from ecc351a to 31e9f38 Compare September 19, 2022 17:22
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@igor-aptos igor-aptos changed the title [test on forge] Add state sync catching up stress tests [forge] Add state sync catching up stress tests Sep 19, 2022
@igor-aptos igor-aptos marked this pull request as ready for review September 19, 2022 22:48
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@igor-aptos igor-aptos enabled auto-merge (squash) September 29, 2022 22:09
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions
Copy link
Contributor

✅ Forge suite compat success on 843b204dce971d98449b82624f4f684c7a18b991 ==> 0c920aa87db89f3ffd7976d5d6cefae9f1116fba

Compatibility test results for 843b204dce971d98449b82624f4f684c7a18b991 ==> 0c920aa87db89f3ffd7976d5d6cefae9f1116fba (PR)
1. Check liveness of validators at old version: 843b204dce971d98449b82624f4f684c7a18b991
compatibility::simple-validator-upgrade::liveness-check : 7365 TPS, 5003 ms latency, 7700 ms p99 latency,no expired txns
2. Upgrading first Validator to new version: 0c920aa87db89f3ffd7976d5d6cefae9f1116fba
compatibility::simple-validator-upgrade::single-validator-upgrade : 5522 TPS, 6941 ms latency, 9200 ms p99 latency,no expired txns
3. Upgrading rest of first batch to new version: 0c920aa87db89f3ffd7976d5d6cefae9f1116fba
compatibility::simple-validator-upgrade::half-validator-upgrade : 4656 TPS, 7878 ms latency, 12400 ms p99 latency,no expired txns
4. upgrading second batch to new version: 0c920aa87db89f3ffd7976d5d6cefae9f1116fba
compatibility::simple-validator-upgrade::rest-validator-upgrade : 7989 TPS, 4622 ms latency, 8600 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for 843b204dce971d98449b82624f4f684c7a18b991 ==> 0c920aa87db89f3ffd7976d5d6cefae9f1116fba passed
Test Ok

@github-actions
Copy link
Contributor

✅ Forge suite land_blocking success on 0c920aa87db89f3ffd7976d5d6cefae9f1116fba

performance benchmark with full nodes : 7631 TPS, 5157 ms latency, 13200 ms p99 latency,(!) expired 1740 out of 3260400 txns
Test Ok

@github-actions
Copy link
Contributor

✅ Forge suite land_blocking success on 0c920aa87db89f3ffd7976d5d6cefae9f1116fba

performance benchmark with full nodes : 7631 TPS, 5157 ms latency, 13200 ms p99 latency,(!) expired 1740 out of 3260400 txns
Test Ok

@igor-aptos igor-aptos merged commit 9e14a63 into main Sep 30, 2022
@igor-aptos igor-aptos deleted the igor/add_state_sync_tests branch September 30, 2022 18:49
This was referenced Sep 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants