Iceberg Schema Sync ignores provided field IDs

[the-other-tim-brown]

Search before asking

• I had searched in the issues and found no similar issues.

Please describe the bug 🐞

The schema sync in Iceberg is not respecting the provided field IDs. When a table is first created, the provided field IDs are completely overwritten. When the schema is updated, the field IDs are not guaranteed to match the input schema either.

If the source schema's ID generation differs from the Iceberg ID generation pattern, there are runtime issues when querying the data. This is very limiting and we should try to fix this.

Are you willing to submit PR?

• I am willing to submit a PR!
• I am willing to submit a PR but need help getting started!

Code of Conduct

• I agree to follow this project's Code of Conduct