Running holesky-shadowfork fails to start

[zskamljic]

I am trying to run a local shadowfork by using the following command:

kurtosis run --enclave holesky-shadowfork github.com/kurtosis-tech/ethereum-package --args-file holesky-shadowfork-config.yaml

Where holesky-shadowfork-config.yaml contains the following (taking this as the template:

participants:
  - el_type: besu
    el_image: hyperledger/besu:24.5.2
    cl_type: teku
    cl_image: consensys/teku:24.4
network_params:
  dencun_fork_epoch: 0
  network: holesky-shadowfork
additional_services:
  - dora
snooper_enabled: true
persistent: true

While running it seems to break in "Getting devnet enodes" with the following error:

There was an error executing Starlark code 
An error occurred executing instruction (number 24) at github.com/kurtosis-tech/ethereum-package/src/shared_utils/shared_utils.star[92:33]:
  run_python(run="\nwith open(\"/network-configs/bootnode.txt\") as bootnode_file:\n    bootnodes = []\n    for line in bootnode_file:\n        line = line.strip()\n        bootnodes.append(line)\nprint(\",\".join(bootnodes), end=\"\")\n            ", files={"/network-configs": "el_cl_genesis_data"}, wait=None, description="Getting devnet enodes")
  Caused by: Python command: "python -c \"\nwith open(\\\"/network-configs/bootnode.txt\\\") as bootnode_file:\n    bootnodes = []\n    for line in bootnode_file:\n        line = line.strip()\n        bootnodes.append(line)\nprint(\\\",\\\".join(bootnodes), end=\\\"\\\")\n            \"" exited with code 1 and output
    Traceback (most recent call last):
      File "<string>", line 2, in <module>
    FileNotFoundError: [Errno 2] No such file or directory: '/network-configs/bootnode.txt'
    

Error encountered running Starlark code.

but continues with some more output, implying that it's running:

⭐ us on GitHub - https://github.com/kurtosis-tech/kurtosis
INFO[2024-06-04T13:14:44+02:00] =========================================================== 
INFO[2024-06-04T13:14:44+02:00] ||          Created enclave: holesky-shadowfork          || 
INFO[2024-06-04T13:14:44+02:00] =========================================================== 
Name:            holesky-shadowfork
UUID:            d99be99ecd8e
Status:          RUNNING
Creation Time:   Tue, 04 Jun 2024 11:55:42 CEST
Flags:           

========================================= Files Artifacts =========================================
UUID           Name
6dd0d0d8baac   1-teku-besu-0-63-0
0e56c0bba085   el_cl_genesis_data
8d70dc8d740e   final-genesis-timestamp
6db33eecf284   genesis-el-cl-env-file
4685e1967b1b   genesis_validators_root
e61e669fefec   jwt_file
d47ab7258bdb   keymanager_file
a987c227438e   latest_blocks
a4e58051d851   prysm-password

========================================== User Services ==========================================
UUID           Name                                             Ports    Status
8dbe6c4f1f6a   shadowfork-el-1-besu-teku                        <none>   RUNNING
aa09eb6f442e   task-1a3f1941-ac0d-4287-bcd1-d0b6746116f2        <none>   RUNNING
2e52e8ba8faf   validator-key-generation-cl-validator-keystore   <none>   RUNNING

However in contrast to running without any config files it does not report services running with specific ports. I assume network-configs/bootnode.txt is not being generated for some reason and so rest of the setup fails.

[barnabasbusa]

Can you try to run again with kurtosis run --enclave holesky-shadowfork github.com/kurtosis-tech/ethereum-package@bbusa/fix-sf --args-file holesky-shadowfork-config.yaml

[zskamljic]

Still seeing the same issue, tried removing the enclave entirely before re-running with same failure result.

[parithosh]

I'll look into it this week and try and get a fix in

[parithosh]

Note: Nethermind should now be fixed, geth has been checked and it works too. We're talking with the besu team to check what's up with the besu shadowfork. We hope to close the topic this week.