Skip to content

ci: retry flaky tests in daemon/wrapper-daemon modes#1150

Merged
svarlamov merged 2 commits intomainfrom
flaky-tests-tmp-workaround
Apr 20, 2026
Merged

ci: retry flaky tests in daemon/wrapper-daemon modes#1150
svarlamov merged 2 commits intomainfrom
flaky-tests-tmp-workaround

Conversation

@svarlamov
Copy link
Copy Markdown
Member

@svarlamov svarlamov commented Apr 20, 2026

Summary

  • Adds retry logic for flaky tests in CI for daemon and wrapper-daemon test modes only
  • On first failure, parses failed test names from cargo output and re-runs only those specific tests individually
  • If all retried tests pass on second run, emits a GitHub Actions warning annotation and exits successfully
  • Tests that fail on retry still fail the build normally
  • wrapper mode has no retry — failures there are treated as real
  • Supports both Unix (bash script) and Windows (PowerShell script)

Test plan

  • Verify Ubuntu CI passes (daemon + wrapper-daemon + wrapper modes)
  • Verify macOS CI passes
  • Verify Windows CI passes
  • Confirm wrapper mode still fails immediately on test failure (no retry)

🤖 Generated with Claude Code


Open in Devin Review

Only retries individually-failed tests (not the full suite) for speed.
If all previously-failed tests pass on retry, emits a warning and exits 0.
Tests that fail on retry still fail the build. Wrapper mode (non-daemon)
has no retry — failures there are treated as real.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
devin-ai-integration[bot]

This comment was marked as resolved.

On Windows, Out-String joins lines with \r\n. Splitting only on \n
leaves trailing \r which breaks regex anchors. Fix by splitting on
\r?\n and trimming lines before comparison.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@svarlamov svarlamov merged commit 1d7555c into main Apr 20, 2026
26 of 27 checks passed
@svarlamov svarlamov deleted the flaky-tests-tmp-workaround branch April 20, 2026 14:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant