Skip to content

Spark 4.1: Mark overrides of deprecated Spark API as deprecated#16028

Open
manuzhang wants to merge 1 commit into
apache:mainfrom
manuzhang:deprecate-SparkTable-schema
Open

Spark 4.1: Mark overrides of deprecated Spark API as deprecated#16028
manuzhang wants to merge 1 commit into
apache:mainfrom
manuzhang:deprecate-SparkTable-schema

Conversation

@manuzhang
Copy link
Copy Markdown
Member

@manuzhang manuzhang commented Apr 18, 2026

Mark Spark 4.1 overrides of deprecated catalog and table schema methods as deprecated ahead of 1.12.0. Implement the TableInfo catalog methods and route legacy StructType overloads through a shared Spark3Util helper so the active path avoids Spark's deprecated APIs.


Co-authored-by: @codex

@github-actions github-actions Bot added the spark label Apr 18, 2026
Comment thread spark/v4.1/spark/src/main/java/org/apache/iceberg/spark/RollbackStagedTable.java Outdated
Mark Spark 4.1 overrides of deprecated catalog and table schema methods as deprecated ahead of 1.12.0. Implement the TableInfo catalog methods and route legacy StructType overloads through a shared Spark3Util helper so the active path avoids Spark's deprecated APIs.

Co-authored-by: Codex <codex@openai.com>
@manuzhang manuzhang force-pushed the deprecate-SparkTable-schema branch from 9b89e14 to fe74213 Compare April 19, 2026 09:02
@manuzhang manuzhang changed the title Spark 4.1: Deprecate schema() on Spark Table implementations Spark 4.1: Mark overrides of deprecated Spark API as deprecated Apr 19, 2026
@manuzhang
Copy link
Copy Markdown
Member Author

@huaxingao Fixed previous issues and I extended the scope of this PR to all deprecated Spark API. Please help review again. Thanks!

@github-actions
Copy link
Copy Markdown

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions.

@github-actions github-actions Bot added the stale label May 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants