-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding custom metadata props into both segment metadata properties file and zk metadata record #6299
Conversation
Codecov Report
@@ Coverage Diff @@
## master #6299 +/- ##
===========================================
- Coverage 66.44% 45.79% -20.66%
===========================================
Files 1075 1252 +177
Lines 54773 61233 +6460
Branches 8168 8866 +698
===========================================
- Hits 36396 28043 -8353
- Misses 15700 30897 +15197
+ Partials 2677 2293 -384
Flags with carried forward coverage won't be shown. Click here to find out more.
Continue to review full report at Codecov.
|
a05ccdd
to
2b0df65
Compare
…le and zk metadata record
2b0df65
to
1e8393f
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
for (String key : _customMap.keySet()) { | ||
customConfigs.put(key, _customMap.get(key)); | ||
} | ||
segmentMetadata.set("custom", customConfigs); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Use constant
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
here I kind of following the convention that all the previous field names are in strings.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
And this is only used by the rest api
Description
Allow adding custom configs during the segment creation phase, and made those available in both segment metadata property file and zookeeper znRecord.
Note that those configs will have
custom.
prefix in metadata.properties file.Sample output:
metadata.property file:
zk metadata: