Skip to content

[INLONG-4866][Manager] Support batch task for Inlong group#4868

Closed
kipshi wants to merge 2 commits intoapache:masterfrom
kipshi:INLONG-4866
Closed

[INLONG-4866][Manager] Support batch task for Inlong group#4868
kipshi wants to merge 2 commits intoapache:masterfrom
kipshi:INLONG-4866

Conversation

@kipshi
Copy link
Copy Markdown
Contributor

@kipshi kipshi commented Jul 4, 2022

Prepare a Pull Request

(Change the title refer to the following example)

  • Title Example: [INLONG-XYZ][Component] Title of the pull request

(The following XYZ should be replaced by the actual GitHub Issue number)

Motivation

Modifications

1 add batch.task flag for inlong group.
2 remove unused classes.

Verifying this change

(Please pick either of the following options)

  • This change is a trivial rework/code cleanup without any test coverage.

  • This change is already covered by existing tests, such as:
    (please describe tests)

  • This change added tests and can be verified as follows:

    (example:)

    • Added integration tests for end-to-end deployment with large payloads (10MB)
    • Extended integration test for recovery after broker failure

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
  • If a feature is not applicable for documentation, explain why?
  • If a feature is not documented yet in this PR, please create a follow-up issue for adding the documentation


public static final Integer UN_SYNC_SEND = 0;

public static final String BATCH_TASK = "batch.task";
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to save this param into inlong_group table?

Copy link
Copy Markdown
Contributor

@thesumery thesumery left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please add more description for motivation

return new GroupInfo(groupId, streamInfos);
}

private Map<String, List<StreamSource>> createPulsarSources(
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

java doc

return ListenerResult.success();
}

private void upsertDataFlow(InlongGroupInfo groupInfo, InlongGroupExtInfo extInfo) {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

java doc

@woofyzhao
Copy link
Copy Markdown
Contributor

Duplicated with #5399

@healchow healchow closed this Aug 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Improve][Manager] Support batch task for Inlong group

6 participants