Pyrmont scenario testing

[djrtwo]

Now that the Altair fork is complete and stable on Pyrmont, we are inducing a number of behaviors on the soon-to-be-deprecated Pyrmont.

The following list are the low hanging fruit. Feel free to do additional tests.

• Operations (many of each)
  • Validator deposit
  • Validator exit
  • Proposer slashing [1000 completed]
  • Attester slashing (double)
  • Attester slashing (surround)
• Sync committees
  • Produce (valid) block with empty sync committee
• Sync (for each client)
  • Block sync from genesis [all clients completed]
  • Block sync from after Altair fork
  • Checkpoint sync from before Altair [clients with functionality completed]
  • Checkpoint sync from after Altair [clients with functionality completed]
• Stress
  • Turn off 50% of nodes, observe non-finality, turn them back on, observe finality [completed]
• Bad network data
  • Gossip invalid blocks
  • Gossip invalid attestations

Original doc

[parithosh]

Status update on some of the tasks:

• Block sync from genesis has been started for all major clients
• Checkpoint sync will be tested tomorrow on Teku and Lodestar
• The non-finality test on pyrmont has started with all clients turning off ~50% of their nodes on the 23rd. The test is planned to go on till the ~26th - ideally we see finality in the chain afterwards

[djrtwo]

1000 proposer slashings on the EF mnemonic were initiated by @dapplion on 2021/8/20.

These have all been included on chain with no adverse/unexpected effects

[parithosh]

Block sync from genesis works as expected for all clients - some are not done yet but are close (I see no reason it would fail now).

Checkpoint Sync works as expected on Teku and Lodestar, both pre and post altair.

The relevant issues have been marked as done.

[parithosh]

Stress test with a period of non-finality was successful. > 66% of validators are back online now and the chain has started to finalize again as expected.

[parithosh]

• Move system time +- 2 slots, then +-24h and see the effect on the node

[parithosh]

Validator deposit performed using the standard tools available to the public (via launchpad website). Validator deposit was successful and the activation process can be seen here: https://pyrmont.beaconcha.in/validator/0xb27b062330beea9679d2b87aa21e3de17604c76b99da43912aab32c233c0162c9914c03af4df436ab61db9ee227ac810#deposits

[parithosh]

Successfully validated and published voluntary exit for validator 0x800bdd6914ff67ee008931dfe6eefa0f50a780a3d9aa805896b2f18468ada69d4105e1699cf880ce4bbab72cd5465aeb

Current epoch: 67240, Exit epoch: 67245, Withdrawable epoch: 67501
(Internal note, the validator that was exited lies on vm pyrmont-704)

[parithosh]

Validator exit was successful.

[parithosh]

Prymont NTP related test results can be found here: https://hackmd.io/@cyWB-JD1SlKJ7C6tELEC6Q/HkyKNa2MK

[parithosh]

Attestor slashing (double) was performed for this validator with the data:

{
  "attestation_1": {
    "attesting_indices": [
      1000
    ],
    "data": {
      "slot": 2173894,
      "index": 0,
      "beacon_block_root": "0x4242424242424242424242424242424242424242424242424242424242424242",
      "source": {
        "epoch": 67932,
        "root": "0x1010101010101010101010101010101010101010101010101010101010101010"
      },
      "target": {
        "epoch": 67932,
        "root": "0xaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
      }
    },
    "signature": "0xb1d55c56160dddf0e3fbe5664edb6e7a9049703e7a779a14031e43900bb56d86cc868d2fa7cf3386053ece33d2906fae043cb7a0f19f714b44b6ac54093113e3c78cefa92919e42413a60e4fc4b27fe502ced54fa15638cc3972fbb431528af8"
  },
  "attestation_2": {
    "attesting_indices": [
      1000
    ],
    "data": {
      "slot": 2173894,
      "index": 0,
      "beacon_block_root": "0x4242424242424242424242424242424242424242424242424242424242424242",
      "source": {
        "epoch": 67932,
        "root": "0x1010101010101010101010101010101010101010101010101010101010101010"
      },
      "target": {
        "epoch": 67932,
        "root": "0xbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
      }
    },
    "signature": "0xa5d15c1b7b1b46fe065990b7fefad10f6f4fd58fea46890321e39c08d9c24cfa57b44739ba9325d6d28320df7cdd98630f1a01b26d435a3f5a84ed17fd32865b095f747ce0fa41a916469f216d13bbfe1160cf782d8409d12455f0f7b986b966"
  }
}

Attestor slashing (surround) was performed for this validator with the data:

{
  "attestation_1": {
    "attesting_indices": [
      1002
    ],
    "data": {
      "slot": 2175330,
      "index": 0,
      "beacon_block_root": "0x4242424242424242424242424242424242424242424242424242424242424242",
      "source": {
        "epoch": 67976,
        "root": "0x1010101010101010101010101010101010101010101010101010101010101010"
      },
      "target": {
        "epoch": 67979,
        "root": "0xaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
      }
    },
    "signature": "0xa508b735f4247a7ac387244cd40b9e9206ffcf65b41157680aaaffe2d684f48f3804bcc92f744e333487afb2b1b6158319811f939d9e20fb2b32d3818b0da7624170e55de51fd867cd87d17300478900e1bf58f1b4bc6e980cbad354c2155f1c"
  },
  "attestation_2": {
    "attesting_indices": [
      1002
    ],
    "data": {
      "slot": 2175295,
      "index": 0,
      "beacon_block_root": "0x4242424242424242424242424242424242424242424242424242424242424242",
      "source": {
        "epoch": 67977,
        "root": "0x1010101010101010101010101010101010101010101010101010101010101010"
      },
      "target": {
        "epoch": 67977,
        "root": "0xbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
      }
    },
    "signature": "0xaf9d52568df36aa54ae9bdef1553a0218b6aa06d421ab0bd773a504aade669b727cb8bed140d01a5043fb58ed773dd5f1461ab7f4e4869e19742c1bdfca00607ef6c2ef562a1551c1e670aaff0a8fd1c222dd2ab495ab44d5b6e93ab6e34772b"
  }
}

Slashing for both validators was successful and the behaviour seen so far has been expected.