Fix icebergS3Cluster reading with position deletes rows

[Ted-Jiang]

Changelog category (leave one):

• Bug Fix (user-visible misbehavior in an official stable release)

Changelog entry (a user-readable short description of the changes that goes into CHANGELOG.md):

Fix icebergS3Cluster protocol. Started supporting schema evolution, positional and equality deletes in iceberg cluster function. Resolves #88287

Documentation entry for user-facing changes

• Documentation is written (mandatory for new features)

Details

Related issue: #88287
Closes: #88287

[Ted-Jiang]

related issue #88287

[Ted-Jiang]

@kssenii could you plz look at this pr or maybe ping someone related this ❤️

[Ted-Jiang]

Another question is how to generate related test data like below.

ClickHouse/tests/queries/0_stateless/03402_cluster_table_functions_settings_parsing.sql

Line 5 in 7f6dea2

SELECT * FROM icebergS3Cluster('test_cluster_two_shards_localhost', s3_conn, filename='est', SETTINGS iceberg_metadata_file_path = 'metadata/v2.metadata.json');

[kssenii]

maybe ping someone related this

@divanik @scanhex12

[clickhouse-gh]

Workflow [PR], commit [5d01e48]

Summary: ❌

job_name	test_name	status	info	comment
Integration tests (amd_asan, old analyzer, 4/6)		failure
	test_replicated_database_recover_digest_mismatch/test.py::test_recover_digest_mismatch	FAIL	cidb, flaky
Upgrade check (amd_tsan)		failure
	Killed by signal (in clickhouse-server.log)	FAIL	cidb
	Fatal message in clickhouse-server.log (see fatal_messages.txt)	FAIL	cidb
	Killed by signal (output files)	FAIL	cidb
	Found signal in gdb.log	FAIL	cidb

[Ted-Jiang]

@kssenii @alexey-milovidov Is there anything i can do to make this pr in progress?

[divanik]

Yes, that's a good fix, I wanted to do the same for last several weeks but was busy by other tasks

[divanik]

@Ted-Jiang, please, add an integration test. Do you know how to do it?

[divanik]

I did the last change (changed warning to info) because we trigger on warnings in our integration tests (I think this is a wrong behavior, but I don't want to deal with it now)

[divanik]

Upgrade check (amd_tsan) - #89409

[divanik]

@Ted-Jiang, thank you for your contribution! The ClickHouse community really appreciates it

[Ted-Jiang]

@Ted-Jiang, thank you for your contribution! The ClickHouse community really appreciates it

@divanik Thanks for your helping, make this happen! 👍