Skip to content

[#6719][#6337][#7413] feat(iceberg): upgrade Iceberg version to 1.9#7917

Merged
jerryshao merged 10 commits intoapache:mainfrom
FANNG1:iceberg_6719
Aug 6, 2025
Merged

[#6719][#6337][#7413] feat(iceberg): upgrade Iceberg version to 1.9#7917
jerryshao merged 10 commits intoapache:mainfrom
FANNG1:iceberg_6719

Conversation

@FANNG1
Copy link
Contributor

@FANNG1 FANNG1 commented Aug 4, 2025

What changes were proposed in this pull request?

  • Upgrade Iceberg version from 1.6 to 1.9
  • Add support for Endpoints in the config response for better compatibility with Trino.

Why are the changes needed?

Fix: #6719 #6337 #7413

Does this PR introduce any user-facing change?

No

How was this patch tested?

compiled and check Iceberg version, test whether it works.

@FANNG1 FANNG1 marked this pull request as draft August 4, 2025 09:23
@FANNG1 FANNG1 changed the title [SIP] upgrade Iceberg version to 1.9 [#6719][#6337][#7413] feat(iceberg): upgrade Iceberg version to 1.9 Aug 4, 2025
@FANNG1
Copy link
Contributor Author

FANNG1 commented Aug 5, 2025

@jerryshao @jerqi PTAL, thx

@FANNG1 FANNG1 marked this pull request as ready for review August 5, 2025 01:22
iceberg = '1.6.1' # used for Gravitino Iceberg catalog and Iceberg REST service
iceberg4spark = "1.4.1" # used for compile spark connector
iceberg = '1.9.2' # used for Gravitino Iceberg catalog and Iceberg REST service
iceberg4connector = "1.6.1" # used for compile spark connector
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is not only used for Spark, right? I think you should change a word.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, updated


@ParameterizedTest
@ValueSource(strings = {"hello", "\\\n\t\\\'", "\u0024", "\100", "[_~", "default_catalog/"})
@ValueSource(strings = {"hello", "\\\n\t\\\'", "\u0024", "\100", "[_~"})
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we do such change?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

default_catalog is the default catalog name if the user doesn't specify the catalog name in prefix. After this PR , we add ENDPOINTS to the config interface which represent the capacity of the underlying catalog backend. if user doesn't specifing the catalog name, we will response the catalog capacibilities from default_catalog and set prefix to the catalog name of default_catalog. so default_catalog is a valid catalog identifier.

@jerryshao jerryshao merged commit c894157 into apache:main Aug 6, 2025
30 of 32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Update Iceberg version to latest

2 participants