-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding push job type of segment metadata only mode #5967
Conversation
e3095b2
to
cb159a3
Compare
Curious, why is this mode needed? Could this lead to inconsistency between metadata and segments? |
This mode should be used in caution. |
I see. I can see this can be a useful tool for issue mitigation. It'll be good to add some description of the scenarios that it targets in the PR description. |
bb4e5da
to
7d72d38
Compare
7d72d38
to
a0aa8e6
Compare
...ava/org/apache/pinot/controller/api/resources/PinotSegmentUploadDownloadRestletResource.java
Outdated
Show resolved
Hide resolved
...ava/org/apache/pinot/controller/api/resources/PinotSegmentUploadDownloadRestletResource.java
Outdated
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Outdated
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Outdated
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Outdated
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Outdated
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Outdated
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM otherwise. Please add a test if possible
...ava/org/apache/pinot/controller/api/resources/PinotSegmentUploadDownloadRestletResource.java
Outdated
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Outdated
Show resolved
Hide resolved
...on-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
Outdated
Show resolved
Hide resolved
2d32aaf
to
dc89494
Compare
dc89494
to
41ce862
Compare
41ce862
to
d7ca99f
Compare
Description
METADATA
/segments/metadata
endpoint to upload segment with METADATA only mode.