Condition in `insert into replace where` statement is always case sensitive

[zhoujinsong]

Apache Iceberg version

1.6.1

Query engine

Spark

Please describe the bug 🐞

I encountered an issue in my Spark 3.5 + Iceberg 1.6 environment.
When executing the query:

insert into test_table replace where ID in (2) select * from another_table

I got the error: org.apache.iceberg.exceptions.ValidationException: Cannot find field 'ID' in struct: struct<1: id: optional int, 2: name: optional string>.
The spark.sql.caseSensitive configuration is set to the default false. It seems this setting isn't being passed to Iceberg's org.apache.iceberg.OverwriteFiles call, even though this interface has a caseSensitive method.

Willingness to contribute

• I can contribute a fix for this bug independently
• I would be willing to contribute a fix for this bug with guidance from the Iceberg community
• I cannot contribute a fix for this bug at this time

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'