Skip to content

[Feature] Make ClickhouseFileSinker support tables containing materialized columns#6949

Closed
ddna1021 wants to merge 8 commits intoapache:devfrom
ddna1021:dev-materializedCol-fdl-20240605
Closed

[Feature] Make ClickhouseFileSinker support tables containing materialized columns#6949
ddna1021 wants to merge 8 commits intoapache:devfrom
ddna1021:dev-materializedCol-fdl-20240605

Conversation

@ddna1021
Copy link
Contributor

@ddna1021 ddna1021 commented Jun 5, 2024

Make ClickhouseFileSinker support tables containing materialized columns by ignoring the materialized columns in the CK table when building the temporary table. In this way, when generating the ck part file, the file corresponding to the materialized column will be automatically generated, otherwise an exception will be thrown when generating the file.

ddna1021 added 8 commits July 7, 2023 20:32
support spark and flink engine

If you need to use this feature, add "partition_balance = true" in the env configuration, the default value is false
…mns by ignoring the materialized columns in the CK table when building the temporary table.
@ddna1021 ddna1021 closed this Jun 5, 2024
@ddna1021 ddna1021 deleted the dev-materializedCol-fdl-20240605 branch June 5, 2024 09:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant