[Feature] Enable load struct type data through routine load from kafka #44665
Description
Search before asking
- I had searched in the issues and found no similar issues.
Description
I load data which contains struct type to my table from Kafka by creating a routine load task. However, the field which has type struct is null.
I create my table as:
CREATE TABLE IF NOT EXISTS test_struct (
event_t BIGINT,
price STRUCT<p_int:int, p_float:float, p_char:varchar>
)
DUPLICATE KEY(event_t)
DISTRIBUTED BY HASH (event_t) BUCKETS 2
PROPERTIES(
"light_schema_change" = "true"
);
The message from kafka is:
{
"event_t": 1732088517827,
"price": {
"p_int":1, "p_float":1.2, "p_char":"sa1"
}
}
A routine load task is created to load this message to the table, however, the column of price is null.
Use case
struct type is needed in the table schema and data is imported from kafka though routine load.
Related issues
support loading data of struct type by different importing ways
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct