Skip to content
This repository has been archived by the owner on Nov 6, 2020. It is now read-only.

[json-tests] stTransactionTest blockchain test failures #11077

Closed
dvdplm opened this issue Sep 20, 2019 · 1 comment
Closed

[json-tests] stTransactionTest blockchain test failures #11077

dvdplm opened this issue Sep 20, 2019 · 1 comment
Labels
F4-tests 💻 Tests need fixing, improving or augmenting. P2-asap 🌊 No need to stop dead in your tracks, however issue should be addressed as soon as possible.

Comments

@dvdplm
Copy link
Collaborator

dvdplm commented Sep 20, 2019

After #11054 the following JSON tests fail in stTransactionTest and are added to the list of skipped tests in ethcore/res/ethereum/tests-issues/currents.json.

"Opcodes_TransactionInit_d0g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d100g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d101g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d102g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d103g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d104g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d105g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d106g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d107g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d108g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d109g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d10g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d110g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d111g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d112g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d113g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d114g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d115g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d116g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d117g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d118g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d119g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d11g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d120g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d121g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d122g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d123g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d124g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d125g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d126g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d127g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d12g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d13g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d14g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d15g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d16g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d17g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d18g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d19g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d1g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d20g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d21g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d22g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d23g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d24g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d25g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d26g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d27g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d28g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d29g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d2g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d30g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d31g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d32g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d33g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d34g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d35g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d36g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d37g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d38g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d39g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d3g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d40g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d41g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d42g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d43g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d44g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d45g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d46g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d47g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d48g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d49g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d4g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d50g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d51g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d52g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d53g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d54g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d55g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d56g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d57g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d58g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d59g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d5g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d60g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d61g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d62g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d63g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d64g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d65g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d66g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d67g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d68g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d69g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d6g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d70g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d71g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d72g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d73g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d74g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d75g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d76g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d77g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d78g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d79g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d7g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d80g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d81g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d82g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d83g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d84g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d85g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d86g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d87g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d88g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d89g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d8g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d90g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d91g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d92g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d93g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d94g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d95g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d96g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d97g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d98g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d99g0v0_ConstantinopleFix", "Opcodes_TransactionInit_d9g0v0_ConstantinopleFix"

Fix the tests and "un-skip" them.

@dvdplm dvdplm added F4-tests 💻 Tests need fixing, improving or augmenting. P2-asap 🌊 No need to stop dead in your tracks, however issue should be addressed as soon as possible. labels Sep 20, 2019
ordian added a commit that referenced this issue Sep 23, 2019
dvdplm pushed a commit that referenced this issue Sep 23, 2019
* [json-tests] populate state from genesis pod state

* [json-tests] #11075 is resolved as well

* [json-tests] #11076 hopefully too

* [json-tests] #11077 🎉

* [json-tests] fix trailing comma
@ordian
Copy link
Collaborator

ordian commented Sep 23, 2019

Closed by #11083.

@ordian ordian closed this as completed Sep 23, 2019
dvdplm added a commit that referenced this issue Sep 25, 2019
* new ethereum consensus tests, #10908

* Update JSON tests to 725dbc73a

This PR reverts the controversial changes of the previous PR and skips the failing tests.

Maybe I misunderstand the suggested workaround of putting the fix under `#[cfg(test)]` but it seems odd to run different code in production than we run in tests. Instead here I suggest we skip the failing tests with the argument that we do not wish to fix this issue (at least not at this time) because it does not affect us. If I am wrong, and I likely am, I look forward to hearing why and what a better approach to updating the state tests is.

Branched off #10923

ref #10908

* Update json test commit to 1dc9d20e97165708f7db0bbf2d1a87a6b4285827

* Fail with error message

* Handle missing r, s, v params in json tests
Light cleanup of json test runner

* Include the path to the test file

* Handle new `postState` format: string or map
Sort out tests
Missing docs

* WIP

* Include test-helpers from ethjson

* Sort out new paths

* Remove dead code

* Fix warnings stemming from code called only from macros
Skip failing tests in stRevert/ and stTransactionTest/ (too course a filter!)
Docs and light touch refactorings for readability

* Skip all failing tests

* Document the single-test-skipping madness

* Update tests to latest commit on the `develop` branch

* Rename test skipping types to reflect actual purpose

* Switch to skipping individual tests in currents.json
Add some logging to help debug skipping

* Fix rpc test by curve fitting to new json test source file

* Add refs to all issues for fixing failing&skipped json tests

* Sort out the need for Clone for tests

* [json-tests] populate state from genesis pod state (#11083)

* [json-tests] populate state from genesis pod state

* [json-tests] #11075 is resolved as well

* [json-tests] #11076 hopefully too

* [json-tests] #11077 🎉

* [json-tests] fix trailing comma

* Update ethcore/src/json_tests/chain.rs

Co-Authored-By: Andronik Ordian <write@reusable.software>

* Add issue numbers to TODOs

* Apply @ordians fix for wrong state_root

* Warn on invalid RLP

* Remove the `ci-skip-tests` feature
dvdplm added a commit that referenced this issue Sep 25, 2019
* new ethereum consensus tests, #10908

* Update JSON tests to 725dbc73a

This PR reverts the controversial changes of the previous PR and skips the failing tests.

Maybe I misunderstand the suggested workaround of putting the fix under `#[cfg(test)]` but it seems odd to run different code in production than we run in tests. Instead here I suggest we skip the failing tests with the argument that we do not wish to fix this issue (at least not at this time) because it does not affect us. If I am wrong, and I likely am, I look forward to hearing why and what a better approach to updating the state tests is.

Branched off #10923

ref #10908

* Update json test commit to 1dc9d20e97165708f7db0bbf2d1a87a6b4285827

* Fail with error message

* Handle missing r, s, v params in json tests
Light cleanup of json test runner

* Include the path to the test file

* Handle new `postState` format: string or map
Sort out tests
Missing docs

* WIP

* Include test-helpers from ethjson

* Sort out new paths

* Remove dead code

* Fix warnings stemming from code called only from macros
Skip failing tests in stRevert/ and stTransactionTest/ (too course a filter!)
Docs and light touch refactorings for readability

* Skip all failing tests

* Document the single-test-skipping madness

* Update tests to latest commit on the `develop` branch

* Rename test skipping types to reflect actual purpose

* Switch to skipping individual tests in currents.json
Add some logging to help debug skipping

* Fix rpc test by curve fitting to new json test source file

* Add refs to all issues for fixing failing&skipped json tests

* Sort out the need for Clone for tests

* [json-tests] populate state from genesis pod state (#11083)

* [json-tests] populate state from genesis pod state

* [json-tests] #11075 is resolved as well

* [json-tests] #11076 hopefully too

* [json-tests] #11077 🎉

* [json-tests] fix trailing comma

* Update ethcore/src/json_tests/chain.rs

Co-Authored-By: Andronik Ordian <write@reusable.software>

* Add issue numbers to TODOs

* Apply @ordians fix for wrong state_root

* Warn on invalid RLP

* Remove the `ci-skip-tests` feature
s3krit added a commit that referenced this issue Sep 26, 2019
* ethcore/res: activate Istanbul on Ropsten, Görli, Rinkeby, Kovan (#11068)

* ethcore/res: activate Istanbul on Ropsten block 6485846

* ethcore/res: activate Istanbul on Goerli block 1561651

* ethcore/res: use hex values for Istanbul specs

* ethcore/res: fix trailing comma

* ethcore/res: be pedantic about EIP-1283 in Petersburg and Istanbul test specs

* ethcore/res: activate Istanbul on Rinkeby block 5435345

* ethcore/res: activate Istanbul on Kovan block 14111141

* ethcore/res: fix kovan istanbul number to 0xd751a5

* cleanup json crate (#11027)

* [json]: cleanup

write something here....

* nit: commit new/moved files

* nit: remove needless features

* nits

* fix(grumbles): use explicit import `DifficultyTest`

* fix(grumbles): remove needless type hints

* fix(grumble): docs `from -> used by`

Co-Authored-By: David <dvdplm@gmail.com>

* fix(grumbles): use explicit `imports`

* fix(grumble): merge `tx` and `tx_with_signing_info`

* fix(grumbles): resolve introduced `TODO's`

* [json-spec] make blake2 pricing spec more readable (#11034)

* [json-spec] make blake2 pricing spec more readable

* [ethcore] fix compilation

* Update JSON tests to d4f86ecf4aa7c (#11054)

* new ethereum consensus tests, #10908

* Update JSON tests to 725dbc73a

This PR reverts the controversial changes of the previous PR and skips the failing tests.

Maybe I misunderstand the suggested workaround of putting the fix under `#[cfg(test)]` but it seems odd to run different code in production than we run in tests. Instead here I suggest we skip the failing tests with the argument that we do not wish to fix this issue (at least not at this time) because it does not affect us. If I am wrong, and I likely am, I look forward to hearing why and what a better approach to updating the state tests is.

Branched off #10923

ref #10908

* Update json test commit to 1dc9d20e97165708f7db0bbf2d1a87a6b4285827

* Fail with error message

* Handle missing r, s, v params in json tests
Light cleanup of json test runner

* Include the path to the test file

* Handle new `postState` format: string or map
Sort out tests
Missing docs

* WIP

* Include test-helpers from ethjson

* Sort out new paths

* Remove dead code

* Fix warnings stemming from code called only from macros
Skip failing tests in stRevert/ and stTransactionTest/ (too course a filter!)
Docs and light touch refactorings for readability

* Skip all failing tests

* Document the single-test-skipping madness

* Update tests to latest commit on the `develop` branch

* Rename test skipping types to reflect actual purpose

* Switch to skipping individual tests in currents.json
Add some logging to help debug skipping

* Fix rpc test by curve fitting to new json test source file

* Add refs to all issues for fixing failing&skipped json tests

* Sort out the need for Clone for tests

* [json-tests] populate state from genesis pod state (#11083)

* [json-tests] populate state from genesis pod state

* [json-tests] #11075 is resolved as well

* [json-tests] #11076 hopefully too

* [json-tests] #11077 🎉

* [json-tests] fix trailing comma

* Update ethcore/src/json_tests/chain.rs

Co-Authored-By: Andronik Ordian <write@reusable.software>

* Add issue numbers to TODOs

* Apply @ordians fix for wrong state_root

* Warn on invalid RLP

* Remove the `ci-skip-tests` feature
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
F4-tests 💻 Tests need fixing, improving or augmenting. P2-asap 🌊 No need to stop dead in your tracks, however issue should be addressed as soon as possible.
Projects
None yet
Development

No branches or pull requests

2 participants