Skip to content

Fix S3Queue partition test race condition#97230

Merged
alexey-milovidov merged 1 commit intomasterfrom
flaky-check-soft-time-limit
Feb 18, 2026
Merged

Fix S3Queue partition test race condition#97230
alexey-milovidov merged 1 commit intomasterfrom
flaky-check-soft-time-limit

Conversation

@alexey-milovidov
Copy link
Copy Markdown
Member

@alexey-milovidov alexey-milovidov commented Feb 17, 2026

Summary

  • Fix race condition in test_ordered_mode_with_regex_partitioning_large_num_files: the ZooKeeper partition metadata check now retries instead of asserting immediately, since S3Queue commits ZK metadata after data insertion

Test plan

  • The S3Queue test fix addresses the root cause: ZK metadata commit happens after data insertion, so the immediate check could see stale state

CI report: https://s3.amazonaws.com/clickhouse-test-reports/json.html?PR=95819&sha=87f9612ea036a8a2fcb7b2e770adacf9cbd934b2&name_0=PR&name_1=Integration%20tests%20%28amd_binary%2C%204%2F5%29
#95819

Changelog category (leave one):

  • CI Fix or Improvement (changelog entry is not required)

Changelog entry (a user-readable short description of the changes that goes into CHANGELOG.md):

...

🤖 Generated with Claude Code

…iles`

The test had a race condition: it checked ZooKeeper partition metadata
immediately after verifying all rows were in the destination table.
However, S3Queue commits ZooKeeper metadata after data insertion, so the
last batch's ZK commit may not have completed yet.

Added a retry loop (up to 30 seconds) for the ZooKeeper partition check.

https://s3.amazonaws.com/clickhouse-test-reports/json.html?PR=95819&sha=87f9612ea036a8a2fcb7b2e770adacf9cbd934b2&name_0=PR&name_1=Integration%20tests%20%28amd_binary%2C%204%2F5%29

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@clickhouse-gh
Copy link
Copy Markdown
Contributor

clickhouse-gh Bot commented Feb 17, 2026

Workflow [PR], commit [9aaff64]

Summary:

@clickhouse-gh clickhouse-gh Bot added the pr-ci label Feb 17, 2026
@alexey-milovidov alexey-milovidov changed the title Fix flaky check timeout and S3Queue partition test race condition Fix S3Queue partition test race condition Feb 17, 2026
@alexey-milovidov alexey-milovidov self-assigned this Feb 18, 2026
@alexey-milovidov alexey-milovidov added this pull request to the merge queue Feb 18, 2026
Merged via the queue into master with commit 894b968 Feb 18, 2026
147 checks passed
@alexey-milovidov alexey-milovidov deleted the flaky-check-soft-time-limit branch February 18, 2026 05:03
@robot-ch-test-poll4 robot-ch-test-poll4 added the pr-synced-to-cloud The PR is synced to the cloud repo label Feb 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-ci pr-synced-to-cloud The PR is synced to the cloud repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants