-
Notifications
You must be signed in to change notification settings - Fork 542
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Flexible format and DailyOffsetPartition Parser #275
Conversation
gcs folder partition
…nto flexible-partion-format
flexible timestamp format
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall looks fine. Minor comments
@@ -83,6 +102,30 @@ static boolean usingMinutely(SecorConfig config) { | |||
return config.getBoolean("partitioner.granularity.minute", false); | |||
} | |||
|
|||
static String usingDateFormat(SecorConfig config) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should these methods instance method (vs. static)? Otherwise how did you make subclass override them?
|
||
} | ||
|
||
static boolean usingHourly(SecorConfig config) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should these be instance methods?
changed access modifier
i have updated the access modifier on the fields , there is no need to |
Thanks for the contribution |
Made Timestamped MessageParser to have flexible prefix and partition format for date, hour and minute, also added daily offset partitioning message parser to support following format to have partiotions backup up per day with hour and minute granularity
/mnt/secor_data/message_logs/backup/28248_12/Log/20161021/02/of fset=0/1_0_00000000000000025658.gz