[Feature]: Support insert part of columns of mixed-format table with flink in streaming mode #256
Closed as not planned
Description
Description
Support insert part of columns of arctic table with flink in streaming mode
Use case/motivation
Arctic only support insert all table columns with flink in streaming mode now.
If souce table DOES NOT have all columns which sink table need, user must join multiple source table, which will cause a big state problem.
If Arctic support insert part of columns, user can start multiple flink job and each job insert part of columns(including join column) into arctic table to avoid problem mentioned above.
Describe the solution
- Support insert part of columns of arctic table with flink in streaming mode
- Merge all columns together when optiming
Related issues
No response
Are you willing to submit a PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct