Skip to content

[INLONG-9804][Agent] Add Pulsar source for Agent#9805

Merged
dockerzhang merged 11 commits intoapache:masterfrom
haifxu:feature-9804
Mar 13, 2024
Merged

[INLONG-9804][Agent] Add Pulsar source for Agent#9805
dockerzhang merged 11 commits intoapache:masterfrom
haifxu:feature-9804

Conversation

@haifxu
Copy link
Member

@haifxu haifxu commented Mar 12, 2024

Prepare a Pull Request

Motivation

  1. Add resetTime in PulsarTask, used to reset consume.
  2. Add PulsarSource to consume message.
  3. Add PulsarTask and PulsarInstance to manage PulsarSource.

Modifications

When the dataproxy is invalid for a period of time and restarted, the data will be sent later and the memory will be restored.
image

justinwwhuang
justinwwhuang previously approved these changes Mar 12, 2024
Copy link
Contributor

@justinwwhuang justinwwhuang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

aloyszhang
aloyszhang previously approved these changes Mar 13, 2024
haifxu and others added 2 commits March 13, 2024 12:21
…t/constant/TaskConstants.java

Co-authored-by: Charles Zhang <dockerzhang@apache.org>
@dockerzhang dockerzhang changed the title [INLONG-9804][Agent] Add Pulsar Source for Agent [INLONG-9804][Agent] Add Pulsar source for Agent Mar 13, 2024
aloyszhang
aloyszhang previously approved these changes Mar 13, 2024
Copy link
Contributor

@aloyszhang aloyszhang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@justinwwhuang justinwwhuang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dockerzhang dockerzhang merged commit 5bd1010 into apache:master Mar 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature][Agent] Add Pulsar Source for Agent

4 participants