You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
> retesteth/retesteth -t GeneralStateTests -- --clients alethIPCDebug
Running tests using path: /home/andrei/dev/aleth/test/jsontests/
Running 51 test cases...
Active client configurations: 'alethIPCDebug '
unknown location(0): fatal error: in "GeneralStateTests/stCallCodes": dataobject::DataObjectException: expected ']' closing the array! around: stantinopleFix",
"Istanbul"
}
/home/andrei/dev/retesteth/retesteth/testSuites/StateTestsBoost.cpp(81): last checkpoint: "stCallCodes" fixture ctor
Error message is confusing and should better mention that the error happened in the config file (now it looks like it's something about test file)
Missing fork name in client config
> retesteth/retesteth -t GeneralStateTests -- --clients alethIPCDebug
Running tests using path: /home/andrei/dev/aleth/test/jsontests/
Running 51 test cases...
Active client configurations: 'alethIPCDebug '
Running tests for config 'Ethereum aleth on IPC Debug' 2
Test Case "stCallCodes":
24%...
48%...
72%...
96%...
100%
Error: Specified network not found: 'Istanbul' (callcallcall_000_OOGMAfter)
Error: Specified network not found: 'Istanbul' (callcodecallcodecallcode_111_SuicideMiddle)
Error: Specified network not found: 'Istanbul' (callcallcallcode_001_SuicideMiddle)
Error: Specified network not found: 'Istanbul' (callcallcall_000_SuicideEnd)
Specified network not found - it's not clear where it is not found, config file is not mentioned
Missing config for the fork
> retesteth/retesteth -t GeneralStateTests -- --clients alethIPCDebug
Running tests using path: /home/andrei/dev/aleth/test/jsontests/
Running 51 test cases...
Active client configurations: 'alethIPCDebug '
Finishing retesteth run
unknown location(0): fatal error: in "GeneralStateTests/stCallCodes": std::runtime_error: template .json config for network 'Istanbul' in alethIPCDebug
It's not clear at all that it looked for the config file and hasn't found it.
Misssing additonalForks field in the client config file
> retesteth/retesteth -t GeneralStateTests/stRevertTest -- --clients alethIPCDebug
Running 1 test case...
Running tests using path: /home/andrei/dev/aleth/test/jsontests/
Active client configurations: 'alethIPCDebug '
Finishing retesteth run
unknown location(0): fatal error: in "GeneralStateTests/stRevertTest": std::runtime_error: additonalForks not found in ClientConfig section!
/home/andrei/dev/retesteth/retesteth/testSuites/StateTestsBoost.cpp(119): last checkpoint: "stRevertTest" fixture ctor
*** 1 failure is detected in the test module "Master Test Suite"
It's not really clear to the user, what is ClientConfig section and where they should fix it.
General tip: always include the path to the relevant file in error messages.
-d/-v/-g filters out everything
> retesteth/retesteth -t GeneralStateTests/stPreCompiledContracts2 -- --clients alethIPCDebug --singletest CallRipemd160_1 -d 1
...
Error: Specified filter did not run a single transaction! (stPreCompiledContracts2/CallRipemd160_1, fork: Istanbul, TrInfo: d: 0, g: 0, v: 0)
Maybe better There are no cases in the test for the given data/value/gas filter.
Should also say what did I requested (-d 1)
Invalid test name
> retesteth/retesteth -t GeneralStateTests/stPreCompiledContracts2 -- --clients alethIPCDebug --singletest non-existing
Running 1 test case...
Running tests using path: /home/andrei/dev/aleth/test/jsontests/
Active client configurations: 'alethIPCDebug '
Filter: 'non-existing'
unknown location(0): fatal error: in "GeneralStateTests/stPreCompiledContracts2": test::BaseEthException: Could not find a filler for provided --singletest filter: 'non-existing', or no tests were found in the test suite folder!
/home/andrei/dev/retesteth/retesteth/testSuites/StateTestsBoost.cpp(88): last checkpoint: "stPreCompiledContracts2" fixture ctor
*** 1 failure is detected in the test module "Master Test Suite"
Don't confuse the user, please, and say exactly what's missing - a filler or a test.
The text was updated successfully, but these errors were encountered:
Error message is confusing and should better mention that the error happened in the config file (now it looks like it's something about test file)
Specified network not found
- it's not clear where it is not found, config file is not mentionedIt's not clear at all that it looked for the config file and hasn't found it.
additonalForks
field in the client config fileIt's not really clear to the user, what is
ClientConfig section
and where they should fix it.General tip: always include the path to the relevant file in error messages.
-d
/-v
/-g
filters out everythingMaybe better
There are no cases in the test for the given data/value/gas filter
.Should also say what did I requested (
-d 1
)Don't confuse the user, please, and say exactly what's missing - a filler or a test.
The text was updated successfully, but these errors were encountered: