Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PIP-82] [pulsar-broker] Misc fixes: #11918

Merged
merged 1 commit into from
Sep 7, 2021

Conversation

kaushik-develop
Copy link
Contributor

@kaushik-develop kaushik-develop commented Sep 3, 2021

  • fix a race between accumulating/reporting/retrieving local-usage RG stats
  • fix a bug in calling quota-calculator from the local-usage aggregator

Motivation

Fixes a couple of bugs found during testing of publish rate limiter for resource groups

Explain here the context, and why you're making that change. What is the problem you're trying to solve.

Modifications

Describe the modifications you've done.

Verifying this change

  • [ X] Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).
mvn test -Dtest=org.apache.pulsar.broker.resourcegroup.ResourceGroupUsageAggregationTest -pl pulsar-broker
mvn test -Dtest=org.apache.pulsar.broker.resourcegroup.ResourceQuotaCalculatorImplTest -pl pulsar-broker
mvn test -Dtest=org.apache.pulsar.broker.resourcegroup.RGUsageMTAggrWaitForAllMesgsTest -pl pulsar-broker

(or)

This change added tests and can be verified as follows:

(example:)

  • Added integration tests for end-to-end deployment with large payloads (10MB)
  • Extended integration test for recovery after broker failure

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API: (no)
  • The schema: (no)
  • The default values of configurations: (no)
  • The wire protocol: (no)
  • The rest endpoints: (no)
  • The admin cli options: (no)
  • Anything that affects deployment: (no)

Documentation

Check the box below and label this PR (if you have committer privilege).

Need to update docs? no

  • doc-required

    (If you need help on updating docs, create a doc issue)

  • no-need-doc

    (Please explain why)

  • doc

    (If this PR contains doc changes)

@kaushik-develop
Copy link
Contributor Author

/pulsarbot run-failure-checks

2 similar comments
@kaushik-develop
Copy link
Contributor Author

/pulsarbot run-failure-checks

@kaushik-develop
Copy link
Contributor Author

/pulsarbot run-failure-checks

@kaushik-develop kaushik-develop force-pushed the fix_quota_calc_race branch 2 times, most recently from 56e1bf9 to f6323a3 Compare September 3, 2021 23:16
@kaushik-develop
Copy link
Contributor Author

/pulsarbot run-failure-checks

1 similar comment
@kaushik-develop
Copy link
Contributor Author

/pulsarbot run-failure-checks

- fix a race between accummulating/reporting/retrieving local-usage RG stats
- fix a bug in calling quota-calculator from the local-usage aggregator
@kaushik-develop
Copy link
Contributor Author

/pulsarbot run-failure-checks

@jerrypeng jerrypeng merged commit 693bf9d into apache:master Sep 7, 2021
jerrypeng pushed a commit to jerrypeng/incubator-pulsar that referenced this pull request Nov 4, 2021
- fix a race between accummulating/reporting/retrieving local-usage RG stats
- fix a bug in calling quota-calculator from the local-usage aggregator

Co-authored-by: Kaushik Ghosh <kaushikg@splunk.com>
bharanic-dev pushed a commit to bharanic-dev/pulsar that referenced this pull request Mar 18, 2022
- fix a race between accummulating/reporting/retrieving local-usage RG stats
- fix a bug in calling quota-calculator from the local-usage aggregator

Co-authored-by: Kaushik Ghosh <kaushikg@splunk.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants