Skip to content

CI: Add workflow to collect and track flaky test issues#88821

Merged
maxknv merged 2 commits intomasterfrom
ci_flaky_catalog
Oct 21, 2025
Merged

CI: Add workflow to collect and track flaky test issues#88821
maxknv merged 2 commits intomasterfrom
ci_flaky_catalog

Conversation

@maxknv
Copy link
Copy Markdown
Member

@maxknv maxknv commented Oct 20, 2025 •
edited
Loading

Changelog category (leave one):

  • Not for changelog (changelog entry is not required)

Details:

  • New scheduled workflow and job to collect all open issues with flaky tests from GH
  • New feature in praktika to mark failed flaky test with label "flaky" if issue is in "flaky catalog"

@clickhouse-gh
Copy link
Copy Markdown
Contributor

clickhouse-gh Bot commented Oct 20, 2025 •
edited
Loading

Workflow [PR], commit [972f939]

Summary: ❌

job_name test_name status info comment
Stateless tests (amd_asan, distributed plan, parallel, 2/2) failure
03203_drop_detached_partition_all FAIL cidb, flaky
Stateless tests (amd_binary, ParallelReplicas, s3 storage, parallel) failure
Code error cidb
03578_parallel_replicas_minicrawl FAIL cidb, flaky

@clickhouse-gh clickhouse-gh Bot added the pr-not-for-changelog This PR should not be mentioned in the changelog label Oct 20, 2025
@maxknv maxknv changed the title CI: Add hourly workflow to collect and track flaky test issues CI: Add workflow to collect and track flaky test issues Oct 20, 2025
@maxknv maxknv force-pushed the ci_flaky_catalog branch 4 times, most recently from 8b5010f to ca56984 Compare October 20, 2025 23:19
@maxknv
Copy link
Copy Markdown
Member Author

maxknv commented Oct 20, 2025

new tag in pr comment. example:
image

new label in the report. example:
image

Note: it's a fake flaky test for test purposes

@maxknv maxknv enabled auto-merge October 21, 2025 00:21
@maxknv
Copy link
Copy Markdown
Member Author

maxknv commented Oct 21, 2025 •
edited
Loading

Code: error - parsing error, not related, addressed in #88825

@maxknv maxknv added this pull request to the merge queue Oct 21, 2025
Merged via the queue into master with commit 464ef7d Oct 21, 2025
237 of 242 checks passed
@maxknv maxknv deleted the ci_flaky_catalog branch October 21, 2025 08:30
@robot-ch-test-poll2 robot-ch-test-poll2 added the pr-synced-to-cloud The PR is synced to the cloud repo label Oct 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

pr-not-for-changelog This PR should not be mentioned in the changelog pr-synced-to-cloud The PR is synced to the cloud repo

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@maxknv @robot-ch-test-poll2