Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C++] Add consumer's configs for reader #8905

Merged

Conversation

BewareMyPower
Copy link
Contributor

@BewareMyPower BewareMyPower commented Dec 10, 2020

Motivation

C++ reader cannot set some consumer's configs. Like CryptoReader, if the config is not supported for reader, then reader cannot decrypt encrypted messages. Also, reader cannot set other configs like AckGroupingTimeMs so that reader cannot control the behavior of AckGroupingTracker.

Modifications

  • Add other consumer's configs for reader, except:
    • NegativeAckRedeliveryDelayMs: reader has no chance to call negativeAcknowledge
    • BrokerConsumerStatsCacheTimeInMs: reader has no chance to call getBrokerConsumerStatsAsync
    • KeySharedPolicy and ConsumerType: reader only supports Exclusive subscription now
    • MaxTotalReceiverQueueSizeAcrossPartitions: reader doesn't support partitioned topics now
    • PatternAutoDiscoveryPeriod: reader doesn't support regex subscription now
  • Add some fields to get the consumer config before reader's internal consumer is created, then add some unit tests for the consumer config.

Verifying this change

  • Make sure that the change passes the CI checks.

This change added tests and can be verified as follows:

  • Run ReaderConfigurationTest

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API: (yes)
  • The schema: (no)
  • The default values of configurations: (no)
  • The wire protocol: (no)
  • The rest endpoints: (no)
  • The admin cli options: (no)
  • Anything that affects deployment: (no)

Documentation

  • Does this pull request introduce a new feature? (yes)
  • If yes, how is the feature documented? (docs)

@BewareMyPower
Copy link
Contributor Author

/pulsarbot run-failure-checks

1 similar comment
@BewareMyPower
Copy link
Contributor Author

/pulsarbot run-failure-checks

@BewareMyPower
Copy link
Contributor Author

@sijie @jiazhai @merlimat PTAL

Copy link
Member

@sijie sijie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@codelipenghui codelipenghui merged commit a3ac12e into apache:master Dec 15, 2020
codelipenghui pushed a commit that referenced this pull request Dec 21, 2020
### Motivation

C++ reader cannot set some consumer's configs. Like `CryptoReader`, if the config is not supported for reader, then reader cannot decrypt encrypted messages. Also, reader cannot set other configs like `AckGroupingTimeMs`  so that reader cannot control the behavior of `AckGroupingTracker`.

### Modifications

- Add other consumer's configs for reader, except:
    - NegativeAckRedeliveryDelayMs: reader has no chance to call `negativeAcknowledge`
    - BrokerConsumerStatsCacheTimeInMs: reader has no chance to call `getBrokerConsumerStatsAsync`
    - KeySharedPolicy and ConsumerType: reader only supports Exclusive subscription now
    - MaxTotalReceiverQueueSizeAcrossPartitions: reader doesn't support partitioned topics now
    - PatternAutoDiscoveryPeriod: reader doesn't support regex subscription now
- Add some fields to get the consumer config before reader's internal consumer is created, then add some unit tests for the consumer config.

(cherry picked from commit a3ac12e)
codelipenghui pushed a commit that referenced this pull request Dec 21, 2020
### Motivation

C++ reader cannot set some consumer's configs. Like `CryptoReader`, if the config is not supported for reader, then reader cannot decrypt encrypted messages. Also, reader cannot set other configs like `AckGroupingTimeMs`  so that reader cannot control the behavior of `AckGroupingTracker`.

### Modifications

- Add other consumer's configs for reader, except:
    - NegativeAckRedeliveryDelayMs: reader has no chance to call `negativeAcknowledge`
    - BrokerConsumerStatsCacheTimeInMs: reader has no chance to call `getBrokerConsumerStatsAsync`
    - KeySharedPolicy and ConsumerType: reader only supports Exclusive subscription now
    - MaxTotalReceiverQueueSizeAcrossPartitions: reader doesn't support partitioned topics now
    - PatternAutoDiscoveryPeriod: reader doesn't support regex subscription now
- Add some fields to get the consumer config before reader's internal consumer is created, then add some unit tests for the consumer config.

(cherry picked from commit a3ac12e)
@codelipenghui codelipenghui added the cherry-picked/branch-2.7 Archived: 2.7 is end of life label Dec 21, 2020
@BewareMyPower BewareMyPower deleted the bewaremypower/add-reader-config branch June 10, 2021 10:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants