Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pulsar-functions] Pass SubscriptionPosition from FunctionDetails to FunctionConfig / SinkConfig #11831

Conversation

freeznet
Copy link
Contributor

@freeznet freeznet commented Aug 29, 2021

Motivation

FunctionDetails defined SubscriptionPosition, but the value is not converted back to FunctionConfig / SinkConfig and will cause SubscriptionPosition lost.

Modifications

Pass SubscriptionPosition from FunctionDetails to FunctionConfig / SinkConfig

Verifying this change

  • Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

  • Added integration tests for end-to-end deployment with large payloads (10MB)
  • Extended integration test for recovery after broker failure

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): (yes / no)
  • The public API: (yes / no)
  • The schema: (yes / no / don't know)
  • The default values of configurations: (yes / no)
  • The wire protocol: (yes / no)
  • The rest endpoints: (yes / no)
  • The admin cli options: (yes / no)
  • Anything that affects deployment: (yes / no / don't know)

Documentation

Check the box below and label this PR (if you have committer privilege).

Need to update docs?

  • doc-required

    (If you need help on updating docs, create a doc issue)

  • no-need-doc

    (Please explain why)
    internal bug fix

  • doc

    (If this PR contains doc changes)

@freeznet freeznet added type/bug The PR fixed a bug or issue reported a bug area/function release/2.8.2 labels Aug 29, 2021
@freeznet freeznet added this to the 2.9.0 milestone Aug 29, 2021
@freeznet freeznet self-assigned this Aug 29, 2021
@Anonymitaet Anonymitaet added the doc-not-needed Your PR changes do not impact docs label Aug 30, 2021
Copy link
Contributor

@gaoran10 gaoran10 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@nlu90 nlu90 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@freeznet freeznet merged commit bfd6542 into apache:master Sep 15, 2021
codelipenghui pushed a commit that referenced this pull request Sep 18, 2021
… to `FunctionConfig` / `SinkConfig` (#11831)

* pass SubscriptionPosition from FunctionDetails to config

* address comment

* reduce code duplication

* set subscriptionPosition in FunctionConfig, SinkConfig with init value

* fix default values

* fix CI

* revert init data

* fix CI

* fix CI

* fix CI

(cherry picked from commit bfd6542)
@codelipenghui codelipenghui added the cherry-picked/branch-2.8 Archived: 2.8 is end of life label Sep 18, 2021
nicoloboschi pushed a commit to datastax/pulsar that referenced this pull request Oct 27, 2021
… to `FunctionConfig` / `SinkConfig` (apache#11831)

* pass SubscriptionPosition from FunctionDetails to config

* address comment

* reduce code duplication

* set subscriptionPosition in FunctionConfig, SinkConfig with init value

* fix default values

* fix CI

* revert init data

* fix CI

* fix CI

* fix CI

(cherry picked from commit bfd6542)
(cherry picked from commit dbddfe5)
bharanic-dev pushed a commit to bharanic-dev/pulsar that referenced this pull request Mar 18, 2022
… to `FunctionConfig` / `SinkConfig` (apache#11831)

* pass SubscriptionPosition from FunctionDetails to config

* address comment

* reduce code duplication

* set subscriptionPosition in FunctionConfig, SinkConfig with init value

* fix default values

* fix CI

* revert init data

* fix CI

* fix CI

* fix CI
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/function cherry-picked/branch-2.8 Archived: 2.8 is end of life doc-not-needed Your PR changes do not impact docs release/2.8.2 release/2.9.0 type/bug The PR fixed a bug or issue reported a bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants