feat: investigate ethereum/tests for Kakarot

[Eikix]

Exploration issue: we want to understand how to run ethereum/tests for Kakarot

• is it at rpc level?
• is it at the vm level?
• how to handle state?
• how do others do it? geth besu reth

[jobez]

Big picture flow of how projects consume the test against the vm level:

Some concrete examples across two projects:

• inclusion of the ethereum tests as a submodule
  • nethermind: https://github.com/NethermindEth/nethermind/blob/master/.gitmodules#L3
  • mana: https://github.com/mana-ethereum/mana/blob/master/.gitmodules#L1
• loading a particular ethereum test json
  • here we have one class per json file https://github.com/NethermindEth/nethermind/blob/master/src/Nethermind/Ethereum.VM.Test/PerformanceTests.cs#L24
  • this json file is loaded as a GeneralStateTest object
    • first loaded: https://github.com/NethermindEth/nethermind/blob/master/src/Nethermind/Ethereum.Test.Base/LoadGeneralStateTestsStrategy.cs#L37
    • then converted to an ethereum test: https://github.com/NethermindEth/nethermind/blob/master/src/Nethermind/Ethereum.Test.Base/JsonToEthereumTest.cs#L22
    • after loaded and coverted to the expected types, it is then ran as follows: https://github.com/NethermindEth/nethermind/blob/master/src/Nethermind/Ethereum.Test.Base/GeneralTestBase.cs#L50
• in mana, they use the json as follows: https://github.com/mana-ethereum/mana/blob/master/apps/evm/test/support/evm_test_runner.ex#L10

We would want to do something like Mana, where we have a top level entrypoint that describes the categories of ethereum tests we want to use and be able to express which tests we expect to pass: https://github.com/mana-ethereum/mana/blob/master/apps/evm/test/evm_test.exs#L10

[Eikix]

Alright! Great
About running these tests from the RPC node, what is the status?
I guess it'd not be so easy to load all of these JSON into Cairo,
It might be easier to trigger the tests using JSON-RPC?

In any case our next actionables are:

• assess whether to run these tests directly on top of the VM (within kakarot repo) XOR run these tests at the RPC level (you mentioned retest? or smth)
• create an epic issue that tracks all the steps in order to put in place those tests (basically the steps of your diagram)

[jobez]

KK, clarified my initial comment that this flow was for the VM case, now digging into how projects use https://ethereum-tests.readthedocs.io/en/latest/retesteth-ref.html

[Eikix]

Are all the contents of this issue's comments encapsulated in https://www.notion.so/kakarotlabs/Ethereum-Tests-Research-680d13186ad94da397cdf19acffe7955 ?

If yes, I can close this and let you focus on Scroll