Skip to content

#325 add State Store configs to support stateful functions in Pulsar #359

Merged
freeznet merged 13 commits into
masterfrom
freeznet/add-pulsar-stateful-function-support
May 23, 2022
Merged

#325 add State Store configs to support stateful functions in Pulsar #359
freeznet merged 13 commits into
masterfrom
freeznet/add-pulsar-stateful-function-support

Conversation

@freeznet
Copy link
Copy Markdown
Member

@freeznet freeznet commented May 11, 2022

Fixes #325

Motivation

Modifications

  • Add Stateful Resource to support config stateful function's state store backend.
  • Add PulsarStateStore Resource to provide state config for pulsar functions.
  • Add --state_storage_serviceurl and --state_storage_impl_class support for pulsar functions.
  • Add tests
  • Add examples

Verifying this change

  • Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

  • Added integration tests for end-to-end deployment with large payloads (10MB)
  • Extended integration test for recovery after broker failure

Documentation

Check the box below.

Need to update docs?

@freeznet freeznet requested a review from nlu90 as a code owner May 11, 2022 02:12
@freeznet freeznet self-assigned this May 11, 2022
@freeznet freeznet added type/feature Indicates new functionality 2022-m5 labels May 11, 2022
@github-actions
Copy link
Copy Markdown

@freeznet:Thanks for your contribution. For this PR, do we need to update docs?
(The PR template contains info about doc, which helps others know more about the changes. Can you provide doc-related info in this and future PR descriptions? Thanks)

@github-actions github-actions Bot added the doc-info-missing This pr needs to mark a document option in description label May 11, 2022
@github-actions
Copy link
Copy Markdown

@freeznet:Thanks for providing doc info!

@github-actions github-actions Bot removed the doc-info-missing This pr needs to mark a document option in description label May 11, 2022
@github-actions
Copy link
Copy Markdown

@freeznet:Thanks for your contribution. For this PR, do we need to update docs?
(The PR template contains info about doc, which helps others know more about the changes. Can you provide doc-related info in this and future PR descriptions? Thanks)

@github-actions github-actions Bot added doc-required This pr needs a document doc-info-missing This pr needs to mark a document option in description and removed doc-info-missing This pr needs to mark a document option in description labels May 11, 2022
@github-actions
Copy link
Copy Markdown

@freeznet:Thanks for providing doc info!

@freeznet freeznet requested a review from tpiperatgod May 11, 2022 02:15
@freeznet freeznet force-pushed the freeznet/add-pulsar-stateful-function-support branch from b5d9133 to 2877813 Compare May 17, 2022 08:55
@freeznet freeznet changed the title [WIP] #325 add State Store configs #325 add State Store configs to support stateful functions in Pulsar May 17, 2022
Comment thread api/v1alpha1/function_types.go Outdated
Comment thread api/v1alpha1/common.go Outdated
Comment thread api/v1alpha1/validate.go
@freeznet freeznet merged commit edd275b into master May 23, 2022
@freeznet freeznet deleted the freeznet/add-pulsar-stateful-function-support branch May 23, 2022 01:48
@Huanli-Meng Huanli-Meng added doc-added and removed doc-required This pr needs a document labels Jul 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

doc-added m/2022-10 type/feature Indicates new functionality

Projects

None yet

Development

Successfully merging this pull request may close these issues.

support stateful function

3 participants