Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve][offload] Support to configure more offload driver #20736

Merged
merged 2 commits into from Jul 11, 2023

Conversation

zymap
Copy link
Member

@zymap zymap commented Jul 6, 2023

Fixes #xyz

Main Issue: #xyz

PIP: #xyz

Motivation

In pulsar offload, we will check if the specified offload driver is supported. But our offload can extend by implementing the offload interface. For easier to specify the other offload name, we should provide a way to configure the offload driver name. We are limiting the offload driver name by an immutable list. Making it can accept more offload driver names by properties.

Modifications

Verifying this change

  • Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

  • Added integration tests for end-to-end deployment with large payloads (10MB)
  • Extended integration test for recovery after broker failure

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

  • Dependencies (add or upgrade a dependency)
  • The public API
  • The schema
  • The default values of configurations
  • The threading model
  • The binary protocol
  • The REST endpoints
  • The admin CLI options
  • The metrics
  • Anything that affects deployment

Documentation

  • doc
  • doc-required
  • doc-not-needed
  • doc-complete

Matching PR in forked repository

PR in forked repository:

---

### Motivation

In pulsar offload, we will check if the specified offload driver
is supported. But our offload can extend by implement the offload
interface. For more easier to specified the other offload name,
we should provide a way to configure the offload dirver name.
We are limit the offload driver name by a immutable list.
Makeing it can accept more offload driver name by properties.
@zymap zymap added type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages area/tieredstorage labels Jul 6, 2023
@zymap zymap added this to the 3.1.0 milestone Jul 6, 2023
@zymap zymap requested review from hangc0276 and gaoran10 July 6, 2023 08:54
@github-actions
Copy link

github-actions bot commented Jul 6, 2023

@zymap Please add the following content to your PR description and select a checkbox:

- [ ] `doc` <!-- Your PR contains doc changes -->
- [ ] `doc-required` <!-- Your PR changes impact docs and you will update later -->
- [ ] `doc-not-needed` <!-- Your PR changes do not impact docs -->
- [ ] `doc-complete` <!-- Docs have been already added -->

@github-actions github-actions bot added the doc-not-needed Your PR changes do not impact docs label Jul 6, 2023
@zymap zymap added ready-to-test and removed doc-not-needed Your PR changes do not impact docs labels Jul 6, 2023
@zymap zymap added the doc-not-needed Your PR changes do not impact docs label Jul 6, 2023
@zymap zymap closed this Jul 6, 2023
@zymap zymap reopened this Jul 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/tieredstorage cherry-picked/branch-2.11 cherry-picked/branch-3.0 doc-not-needed Your PR changes do not impact docs ready-to-test release/2.11.3 release/3.0.2 type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants