Currently, Doris is not well-supported for nested data parsing in data ingestion
Users may need to load data sources, like JSON/Parquet files, with nested structure.
Now we can extract data from JSON string by column mapping using function get_json_string with specified jsonpath.
It is quite useful to have a general way to extract data from nested structure. For example, we can read all non-primitive fields from different data sources as JSON string(or some general structure) first, then extract data by jsonpath at the stage of column mapping.
Currently, Doris is not well-supported for nested data parsing in data ingestion
Users may need to load data sources, like JSON/Parquet files, with nested structure.
Now we can extract data from JSON string by column mapping using function
get_json_stringwith specifiedjsonpath.It is quite useful to have a general way to extract data from nested structure. For example, we can read all non-primitive fields from different data sources as JSON string(or some general structure) first, then extract data by
jsonpathat the stage of column mapping.