Add StorageIceberg and table function iceberg

[ucasfl]

Changelog category (leave one):

• New Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Add StorageIceberg and table function iceberg to access iceberg table store on S3.

[didip]

What an amazing effort! I hope that this will be merged soon!

[nickitat]

build without Avro is broken. let's fix or revert

[ucasfl]

build without Avro is broken. let's fix or revert

It's because the metadata of Iceberg is Avro format, so I need Avro to parse the metadata.

[azat]

I've also hit by this, @ucasfl any PR?

[Samrose-Ahmed]

Excuse my ignorance but why does the code do listFiles on S3, is that just a scrappy V0 impl, Iceberg shouldn't require any listing, just following the metadata files.

[ucasfl]

Excuse my ignorance but why does the code do listFiles on S3, is that just a scrappy V0 impl, Iceberg shouldn't require any listing, just following the metadata files.

Because we don't have Iceberg C++ API.

[ucasfl]

build without Avro is broken. let's fix or revert

@nickitat Fixed in #46554.

[rice668]

By the way, do we also consider supporting Iceberg tables stored in HDFS ?

[kssenii]

yes