Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add verification timeout to SuccessfulDeploymentTest.shouldSendResponse #10573

Merged
merged 1 commit into from
Sep 30, 2022

Conversation

Zelldon
Copy link
Member

@Zelldon Zelldon commented Sep 29, 2022

Description

The test was not reliable since the ordering of the command response writer mock was not the same as in the code, this means it could happen that the writer was not yet called on all methods. It was easy to reproduce and also to fix. I rerun the test after the fix 1000+ times.

Related issues

closes #10492

Definition of Done

Not all items need to be done depending on the issue and the pull request.

Code changes:

  • The changes are backwards compatibility with previous versions
  • If it fixes a bug then PRs are created to backport the fix to the last two minor versions. You can trigger a backport by assigning labels (e.g. backport stable/1.3) to the PR, in case that fails you need to create backports manually.

Testing:

  • There are unit/integration tests that verify all acceptance criterias of the issue
  • New tests are written to ensure backwards compatibility with further versions
  • The behavior is tested manually
  • The change has been verified by a QA run
  • The impact of the changes is verified by a benchmark

Documentation:

  • The documentation is updated (e.g. BPMN reference, configuration, examples, get-started guides, etc.)
  • New content is added to the release announcement
  • If the PR changes how BPMN processes are validated (e.g. support new BPMN element) then the Camunda modeling team should be informed to adjust the BPMN linting.

Please refer to our review guidelines.

@Zelldon Zelldon requested review from saig0 and a team and removed request for megglos, lenaschoenburg and saig0 September 29, 2022 18:46
@github-actions
Copy link
Contributor

github-actions bot commented Sep 29, 2022

Test Results

   934 files  ±  0     934 suites  ±0   2h 10m 31s ⏱️ - 3m 23s
7 496 tests +57  7 490 ✔️ +57  6 💤 ±0  0 ±0 
7 686 runs  +57  7 678 ✔️ +57  8 💤 ±0  0 ±0 

Results for commit 20fa4cb. ± Comparison against base commit fc2d27c.

♻️ This comment has been updated with latest results.

The test was not reliable since the ordering of the command response writer wock was not the same as in the code, this means it could happen that the writer was not yet called on all methods. It was easier to reproduce and also to fix.
@Zelldon Zelldon force-pushed the zell-fix-successful-deployment branch from 38a2350 to 20fa4cb Compare September 29, 2022 19:05
Copy link
Member

@saig0 saig0 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Zelldon 👍

@Zelldon
Copy link
Member Author

Zelldon commented Sep 30, 2022

Bors r+

@zeebe-bors-camunda
Copy link
Contributor

Build succeeded:

@backport-action
Copy link
Collaborator

Successfully created backport PR #10576 for stable/8.0.

@backport-action
Copy link
Collaborator

Successfully created backport PR #10577 for release-8.1.0.

zeebe-bors-camunda bot added a commit that referenced this pull request Sep 30, 2022
10576: [Backport stable/8.0] Add verification timeout to SuccessfulDeploymentTest.shouldSendResponse r=saig0 a=backport-action

# Description
Backport of #10573 to `stable/8.0`.

relates to #10492

Co-authored-by: Christopher Zell <zelldon91@googlemail.com>
zeebe-bors-camunda bot added a commit that referenced this pull request Sep 30, 2022
10577: [Backport release-8.1.0] Add verification timeout to SuccessfulDeploymentTest.shouldSendResponse r=saig0 a=backport-action

# Description
Backport of #10573 to `release-8.1.0`.

relates to #10492

Co-authored-by: Christopher Zell <zelldon91@googlemail.com>
zeebe-bors-camunda bot added a commit that referenced this pull request Sep 30, 2022
10494: [Backport stable/8.0] Do not fail consistency check if log is empty r=deepthidevaki a=backport-action

# Description
Backport of #10463 to `stable/8.0`.

relates to #10451

10576: [Backport stable/8.0] Add verification timeout to SuccessfulDeploymentTest.shouldSendResponse r=saig0 a=backport-action

# Description
Backport of #10573 to `stable/8.0`.

relates to #10492

Co-authored-by: Deepthi Devaki Akkoorath <deepthidevaki@gmail.com>
Co-authored-by: Christopher Zell <zelldon91@googlemail.com>
zeebe-bors-camunda bot added a commit that referenced this pull request Sep 30, 2022
10576: [Backport stable/8.0] Add verification timeout to SuccessfulDeploymentTest.shouldSendResponse r=saig0 a=backport-action

# Description
Backport of #10573 to `stable/8.0`.

relates to #10492

Co-authored-by: Christopher Zell <zelldon91@googlemail.com>
@Zelldon Zelldon added the version:8.1.0 Marks an issue as being completely or in parts released in 8.1.0 label Oct 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
version:8.1.0 Marks an issue as being completely or in parts released in 8.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

SuccessfulDeploymentTest.shouldSendResponse is flaky
4 participants