Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Flakey DKG Tests #1432

Merged
merged 6 commits into from Oct 5, 2021
Merged

Fix Flakey DKG Tests #1432

merged 6 commits into from Oct 5, 2021

Conversation

jordanschalm
Copy link
Member

@jordanschalm jordanschalm commented Oct 4, 2021

  • Changes the error message for artificially disabled DKG contract client errors, to make it clearer where these errors are coming from
  • Ensures the DKGEngine<->Emulator connection is enabled at the end of the test
    • This was the ultimate source of the flakiness -- because of the number of blocks and the interval of introducing artificial failures to the dkg client, it was left in a disabled state at the end of the test. This caused a race where the DKG Engine must call SubmitResult prior to the test thread building the final blocks.

@codecov-commenter
Copy link

codecov-commenter commented Oct 4, 2021

Codecov Report

Merging #1432 (1d4f442) into master (9d0c789) will increase coverage by 0.05%.
The diff coverage is 67.07%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #1432      +/-   ##
==========================================
+ Coverage   55.41%   55.47%   +0.05%     
==========================================
  Files         512      513       +1     
  Lines       31942    32086     +144     
==========================================
+ Hits        17700    17799      +99     
- Misses      11862    11898      +36     
- Partials     2380     2389       +9     
Flag Coverage Δ
unittests 55.47% <67.07%> (+0.05%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
cmd/bootstrap/cmd/final_list.go 8.40% <0.00%> (ø)
cmd/bootstrap/utils/file.go 0.00% <0.00%> (ø)
engine/consensus/ingestion/engine.go 45.63% <ø> (+0.12%) ⬆️
module/dkg/controller_factory.go 0.00% <0.00%> (ø)
module/dkg/broker.go 58.55% <46.80%> (-7.31%) ⬇️
module/epochs/qc_voter.go 59.67% <52.17%> (+1.34%) ⬆️
cmd/bootstrap/cmd/qc.go 50.00% <60.00%> (+7.14%) ⬆️
cmd/bootstrap/run/qc.go 46.05% <71.42%> (+2.57%) ⬆️
cmd/bootstrap/cmd/finalize.go 65.43% <76.08%> (+0.12%) ⬆️
cmd/bootstrap/cmd/rootblock.go 94.82% <94.82%> (ø)
... and 8 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a4d6955...1d4f442. Read the comment docs.

@jordanschalm
Copy link
Member Author

the test assume a particular ordering of Cadence maps, which no longer
can be guaranteed by the implementation
@jordanschalm
Copy link
Member Author

bors merge

@bors
Copy link
Contributor

bors bot commented Oct 5, 2021

Build succeeded:

@bors bors bot merged commit 662885b into master Oct 5, 2021
@bors bors bot deleted the jordan/5871-flakey-dkg-test branch October 5, 2021 00:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants