Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Can't configure datasource column as date/time if data set starts with null / empty values #2294
Describe the bug
Desktop (please complete the following information):
@siepkes I'm sorry for the late reply. :(
Note that you have to specify one column for the timestamp role because the engine is a time series database. When you specify the currently mentioned column as the timestamp role, the query may be possible, but not efficient in terms of data ingestion. please refer this link: https://metatron-app.github.io/metatron-doc-discovery/en/discovery/part01/druid_features.html#ingestion
No sweat! Thanks for replying!
I understand that this is conceptually somewhat of a hard problem. What if only 15% of the column has a value and the rest is
As an idea; Maybe instead of a hard error it should display a warning like: "Only 50% of the data in this column matches this date format. " and simply ignore the data it can't parse?
Sorry my example screenshot is a bad one in that regard. The column in which I demonstrate the issue is not the column that is to be used as the primary timeseries. I hadn't selected the primary timeseries when I made the screenshot to visualize the issue. I should have done that first to avoid confusion.