Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(benchmark): publish messages with no TTL #10935

Merged
merged 1 commit into from
Nov 8, 2022

Conversation

saig0
Copy link
Member

@saig0 saig0 commented Nov 8, 2022

Description

Currently, the benchmark publishes messages with a default TTL of one hour. The TTL can cause additional load on the broker. If the benchmark publishes a high rate of messages with TTL then it could overload the broker. See #10643.

Set the TTL to ZERO and disable the buffering of messages.

Related issues

closes #10552

Definition of Done

Not all items need to be done depending on the issue and the pull request.

Code changes:

  • The changes are backwards compatibility with previous versions
  • If it fixes a bug then PRs are created to backport the fix to the last two minor versions. You can trigger a backport by assigning labels (e.g. backport stable/1.3) to the PR, in case that fails you need to create backports manually.

Testing:

  • There are unit/integration tests that verify all acceptance criterias of the issue
  • New tests are written to ensure backwards compatibility with further versions
  • The behavior is tested manually
  • The change has been verified by a QA run
  • The impact of the changes is verified by a benchmark

Documentation:

  • The documentation is updated (e.g. BPMN reference, configuration, examples, get-started guides, etc.)
  • If the PR changes how BPMN processes are validated (e.g. support new BPMN element) then the Camunda modeling team should be informed to adjust the BPMN linting.

Please refer to our review guidelines.

Currently, the benchmark published messages with a default TTL of one hour. The TTL can cause additional load on the broker. If the benchmark publishes a high rate of message with TTL then it could overload the broker. See #10643.

 Set the TTL to ZERO and disable the buffering of messages.
Copy link
Member

@npepinpe npepinpe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

As this is since 8.1, I'll mark this to be backported to 8.1 as well (since we generate benchmark images per version on release)

bors merge

zeebe-bors-camunda bot added a commit that referenced this pull request Nov 8, 2022
10935: fix(benchmark): publish messages with no TTL r=npepinpe a=saig0

## Description

Currently, the benchmark publishes messages with a [default TTL](https://github.com/camunda/zeebe/blob/main/clients/java/src/main/java/io/camunda/zeebe/client/impl/ZeebeClientBuilderImpl.java#L57) of one hour. The TTL can cause additional load on the broker. If the benchmark publishes a high rate of messages with TTL then it could overload the broker. See #10643.

Set the TTL to ZERO and disable the buffering of messages.

## Related issues

closes #10552



Co-authored-by: Philipp Ossler <philipp.ossler@gmail.com>
@github-actions
Copy link
Contributor

github-actions bot commented Nov 8, 2022

Test Results

   950 files  ±    0     950 suites  ±0   1h 42m 15s ⏱️ - 3m 3s
7 474 tests  - 312  7 467 ✔️  - 312  7 💤 ±0  0 ±0 
7 672 runs   - 312  7 663 ✔️  - 312  9 💤 ±0  0 ±0 

Results for commit abdcd77. ± Comparison against base commit 4ade0fb.

@zeebe-bors-camunda
Copy link
Contributor

Build failed:

@npepinpe
Copy link
Member

npepinpe commented Nov 8, 2022

bors r+

Known flaky test

@zeebe-bors-camunda
Copy link
Contributor

Build succeeded:

@backport-action
Copy link
Collaborator

Successfully created backport PR #10939 for stable/8.1.

zeebe-bors-camunda bot added a commit that referenced this pull request Nov 8, 2022
10939: [Backport stable/8.1] fix(benchmark): publish messages with no TTL r=npepinpe a=backport-action

# Description
Backport of #10935 to `stable/8.1`.

relates to #10552

Co-authored-by: Philipp Ossler <philipp.ossler@gmail.com>
zeebe-bors-camunda bot added a commit that referenced this pull request Nov 8, 2022
10939: [Backport stable/8.1] fix(benchmark): publish messages with no TTL r=npepinpe a=backport-action

# Description
Backport of #10935 to `stable/8.1`.

relates to #10552

Co-authored-by: Philipp Ossler <philipp.ossler@gmail.com>
zeebe-bors-camunda bot added a commit that referenced this pull request Nov 11, 2022
10936: fix(benchmark): enable the message publisher again r=npepinpe a=saig0

## Description

Previously, the message process was disabled because it led to big message states (#10643). This issue was fixed by setting the message TTL to ZERO (#10935). So, we can enable the message process again.

## Related issues



Co-authored-by: Philipp Ossler <philipp.ossler@gmail.com>
zeebe-bors-camunda bot added a commit that referenced this pull request Nov 11, 2022
10936: fix(benchmark): enable the message publisher again r=npepinpe a=saig0

## Description

Previously, the message process was disabled because it led to big message states (#10643). This issue was fixed by setting the message TTL to ZERO (#10935). So, we can enable the message process again.

## Related issues



Co-authored-by: Philipp Ossler <philipp.ossler@gmail.com>
@remcowesterhoud remcowesterhoud added the version:8.1.4 Marks an issue as being completely or in parts released in 8.1.4 label Nov 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
version:8.1.4 Marks an issue as being completely or in parts released in 8.1.4
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Mixed benchmarks always fall in a weird state after several hours
4 participants