fix:paychan:deflake integration test

[ZenGround0]

Related Issues

Proposed Changes

1. Improve MineBlocksMustPost, a testing helper I first made to remove flakes from cc upgrade itest
2. Use in paych api test

Additional Info

@TheDivic brought my attention to flaky behavior in a few tests. Looking at the logs here I saw the same error message from the cc upgrade itest:

2022-02-13T16:16:46.332Z	WARN	vm	vm/runtime.go:350	Abortf: invalid deadline 0 at epoch 718, expected 1
2022-02-13T16:16:46.332Z	WARN	vm	vm/runtime.go:161	VM.Call failure in call from: f0102 to f01000: invalid deadline 0 at epoch 718, expected 1 (RetCode=16):   

I had previously debugged this and tracked it down to the behavior of post. The post scheduler returns no errors so post failures are totally left out of testing logic. However when mining blocks in integration tests post failures will take down the whole miner and fail the test.

The idea behind MineBlocksMustPost is to force block mining to wait on any expected post messages being included before moving past a deadline.

Checklist

Before you mark the PR ready for review, please make sure that:

• All commits have a clear commit message.
• The PR title is in the form of of <PR type>: <area>: <change being made>
  • example: fix: mempool: Introduce a cache for valid signatures
  • PR type: fix, feat, INTERFACE BREAKING CHANGE, CONSENSUS BREAKING, build, chore, ci, docs,perf, refactor, revert, style, test
  • area: api, chain, state, vm, data transfer, market, mempool, message, block production, multisig, networking, paychan, proving, sealing, wallet, deps
• This PR has tests for new functionality or change in behaviour
• If new user-facing features are introduced, clear usage guidelines and / or documentation updates should be included in https://lotus.filecoin.io or Discussion Tutorials.
• CI is green

[codecov]

Codecov Report

Merging #8088 (2c06eb7) into master (3b5b55d) will increase coverage by 0.00%.
The diff coverage is 30.30%.

❗ Current head 2c06eb7 differs from pull request most recent head 977351f. Consider uploading reports for the commit 977351f to get more accurate results

@@           Coverage Diff           @@
##           master    #8088   +/-   ##
=======================================
  Coverage   39.23%   39.23%           
=======================================
  Files         664      664           
  Lines       72227    72228    +1     
=======================================
+ Hits        28339    28341    +2     
+ Misses      39001    38989   -12     
- Partials     4887     4898   +11     

Impacted Files	Coverage Δ
itests/kit/blockminer.go	74.26% <30.30%> (+0.15%)	⬆️
chain/events/message_cache.go	87.50% <0.00%> (-12.50%)	⬇️
chain/events/observer.go	71.64% <0.00%> (-6.72%)	⬇️
node/hello/hello.go	63.63% <0.00%> (-3.41%)	⬇️
chain/events/events_called.go	83.90% <0.00%> (-1.96%)	⬇️
blockstore/autobatch.go	56.30% <0.00%> (-1.69%)	⬇️
chain/stmgr/searchwait.go	68.58% <0.00%> (-1.29%)	⬇️
chain/gen/gen.go	68.19% <0.00%> (-1.23%)	⬇️
chain/vm/vm.go	61.63% <0.00%> (-1.07%)	⬇️
chain/messagepool/selection.go	83.52% <0.00%> (-0.78%)	⬇️
... and 17 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3b5b55d...977351f. Read the comment docs.

[ZenGround0]

Investigating a hang that keeps showing up locally. On the bright side this change makes the problem obvious.