feat(schema): refactor UpdateSchemaAction for schema evolution in Iceberg#2451
feat(schema): refactor UpdateSchemaAction for schema evolution in Iceberg#2451TwinklerG wants to merge 6 commits into
UpdateSchemaAction for schema evolution in Iceberg#2451Conversation
…dateColumn` struct; promotion type check in Column Update; remove useless test case
UpdateSchemaAction for schema evolution in Iceberg
UpdateSchemaAction for schema evolution in IcebergUpdateSchemaAction for schema evolution in Iceberg
|
I'm not sure if this is the correct direction: it changes the update_schema API, and I don't think it adds much value for users/devs Could you share more about your reasoning here? |
Well, I have been continuously tracking the Issues #2119 #697 and the related PRs. I noticed that the merged PR #2120 only added the capabilities of adding column and deleting column, but this is obviously only a small part of the schema evolution, and I don't think the original implementation was a good one. Therefore, I imitated the implementation of iceberg java and completed this refactoring |
Which issue does this PR close?
SchemaUpdatelogic to Iceberg-Rust #697What changes are included in this PR?
Add
schema_updatefunction and refactorUpdateSchemaActionto support schema evolution operations on Iceberg tables.A similar PR #2120(only add column and delete column), but refactor it to add more features.
Are these changes tested?
Yes. Besides, I add some complex test cases which are ported from iceberg-java, a few of them to be implemented.