New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
More flexible Json_Date_Format #848
Comments
this is a good enhancement, it make sense. It will be implemented shortly. |
@restyler: Until this enhancement is complete, you may have luck using a Lua script in a filter to create your own custom timestamp. I had to do something similar to get a different time format. Here's an example of how I did it:
As far as how this could be implemented in fluent bit, would it work for you if there was possibly an additional field where you could specify the timestamp format? Maybe something like how it's done for the regex parser? Perhaps something like:
|
@edsiper: I worked on #1111, and after reviewing
This would be a breaking change unfortunately, so not sure how that would be handled. |
…fluent#848) Signed-off-by: YoussefRizkalla <youssefr@google.com>
Clickhouse is pretty strict on data formats and fails to parse "2018-10-13T17:46:23.000000Z" which is generated by json_date_format iso8601. So, as far as I understand, the only way to fix this is to create a proxy server which will convert this format to Clickhouse supported "2016-06-15 00:11:21". It would be helpful to do it on the fluentbit output plugin level.
The text was updated successfully, but these errors were encountered: