How to combine vertically split tables into one table in iceberg

[moonService]

Query engine

flink

Question

I tried the following:
CREATE TABLE source_part_1 (
columns...
PRIMARY KEY (pk) NOT ENFORCED
) WITH (
connectinfo...
);

CREATE TABLE source_part_2 (
columns...
PRIMARY KEY (pk) NOT ENFORCED
) WITH (
connectinfo...
);

CREATE TABLE iceberg_table (
part_1_columns...
part_2_columns...
PRIMARY KEY (pk) NOT ENFORCED
) WITH (
connectinfo...
);

insert into iceberg_table (part_1_columns...) select part_1_columns from source_part_1;
insert into iceberg_table (part_2_columns...) select part_2_columns from source_part_2;

but iceberg can not just update part of fields ，only can update by line，How can I solve this problem？

[xuzhiwen1255]

I know your problem, for example, you can change SQL, such as JOIN, but this is not a good solution

[moonService]

@xuzhiwen1255 Yes, that means I need to manage the state of Flink, which will cause additional resource waste

[xuzhiwen1255]

At present, iceberg only achieves row-level update, so it has to get around this problem by other ways

[majin1102]

It could be done in offline way using MERGE INTO sql

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'