Skip to content

ci: manual deflake workflow [WPB-25106]#4772

Merged
emmaoke-w merged 8 commits into
developfrom
ci/WPB-25106-manual-deflake-workflow
Apr 30, 2026
Merged

ci: manual deflake workflow [WPB-25106]#4772
emmaoke-w merged 8 commits into
developfrom
ci/WPB-25106-manual-deflake-workflow

Conversation

@emmaoke-w
Copy link
Copy Markdown
Contributor

@emmaoke-w emmaoke-w commented Apr 29, 2026

https://wearezeta.atlassian.net/browse/WPB-25106


PR Submission Checklist for internal contributors

  • The PR Title

    • conforms to the style of semantic commits messages¹ supported in Wire's Github Workflow²
    • contains a reference JIRA issue number like SQPIT-764
    • answers the question: If merged, this PR will: ... ³
  • The PR Description

    • is free of optional paragraphs and you have filled the relevant parts to the best of your ability

What's new in this PR?

  • Renamed the existing QA Android UI workflow to reflect its actual purpose as the critical flow workflow.
  • Reduced the default automatic failed-test rerun count from 2 to 1.
  • Exported a standard deflake input artifact from the critical flow workflow, including run metadata and leftover failed tests.
  • Added a separate QA Android UI Test Manual Deflake workflow.
  • Made the manual deflake workflow download the artifact from a selected previous run and rerun only the failed tests from that run.
  • Kept manual deflake reporting separate from the original run by generating a fresh Allure report for each deflake run.
  • Re-exported the same deflake artifact from the manual deflake workflow so a deflake run can be deflaked again later.
  • Reused the existing execution, retry, and reporting scripts where possible instead of introducing a second parallel implementation.

Issues

Briefly describe the issue you have solved or implemented with this pull request. If the PR contains multiple issues, use a bullet list.

Causes (Optional)

Briefly describe the causes behind the issues. This could be helpful to understand the adopted solutions behind some nasty bugs or complex issues.

Solutions

Briefly describe the solutions you have implemented for the issues explained above.

Dependencies (Optional)

If there are some other pull requests related to this one (e.g. new releases of frameworks), specify them here.

Needs releases with:

  • GitHub link to other pull request

Testing

Test Coverage (Optional)

  • I have added automated test to this contribution

How to Test

Briefly describe how this change was tested and if applicable the exact steps taken to verify that it works as expected.

Notes (Optional)

Specify here any other facts that you think are important for this issue.

Attachments (Optional)

Attachments like images, videos, etc. (drag and drop in the text box)


PR Post Submission Checklist for internal contributors (Optional)

  • Wire's Github Workflow has automatically linked the PR to a JIRA issue

PR Post Merge Checklist for internal contributors

  • If any soft of configuration variable was introduced by this PR, it has been added to the relevant documents and the CI jobs have been updated.

References
  1. https://sparkbox.com/foundry/semantic_commit_messages
  2. https://github.com/wireapp/.github#usage
  3. E.g. feat(conversation-list): Sort conversations by most emojis in the title #SQPIT-764.

@emmaoke-w emmaoke-w force-pushed the ci/WPB-25106-manual-deflake-workflow branch from cded5c8 to e2988be Compare April 29, 2026 07:57
@emmaoke-w emmaoke-w changed the title Ci/wpb 25106 manual deflake workflow ci: manual deflake workflow [WPB-25106] Apr 29, 2026
@emmaoke-w emmaoke-w marked this pull request as ready for review April 29, 2026 08:07
@emmaoke-w emmaoke-w requested a review from a team as a code owner April 29, 2026 08:08
@emmaoke-w emmaoke-w requested review from MohamadJaara, mathias-niboulies, ohassine, sbakhtiarov and typfel and removed request for a team April 29, 2026 08:08
@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 29, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 50.80%. Comparing base (38fa9ce) to head (b9b90c1).
⚠️ Report is 1 commits behind head on develop.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop    #4772   +/-   ##
========================================
  Coverage    50.80%   50.80%           
========================================
  Files          605      605           
  Lines        20887    20887           
  Branches      3370     3370           
========================================
  Hits         10612    10612           
  Misses        9276     9276           
  Partials       999      999           

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 38fa9ce...b9b90c1. Read the comment docs.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@emmaoke-w emmaoke-w requested a review from yamilmedina April 29, 2026 12:44
waitUntilLoginFlowIsCompleted()
clickAllowNotificationButton()
clickAgreeShareDataAlert()
// clickAgreeShareDataAlert()
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

question: do we need to remove ?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The commented code is deliberate, I want the test to fail so it can appear as a failed test when I want to manually rerun it.

Copy link
Copy Markdown
Contributor

@yamilmedina yamilmedina left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm! some commented code perhaps we need to remove, or bring back?

@emmaoke-w emmaoke-w requested a review from CinnamonNinja April 29, 2026 15:46
Comment thread .github/workflows/qa-android-ui-test-manual-deflake.yml Outdated
Comment thread .github/workflows/qa-android-ui-test-manual-deflake.yml Outdated
@emmaoke-w emmaoke-w requested a review from MohamadJaara April 30, 2026 12:49
@sonarqubecloud
Copy link
Copy Markdown

@emmaoke-w emmaoke-w removed the request for review from MohamadJaara April 30, 2026 15:33
@emmaoke-w emmaoke-w enabled auto-merge April 30, 2026 15:34
@emmaoke-w emmaoke-w disabled auto-merge April 30, 2026 15:35
@emmaoke-w emmaoke-w dismissed MohamadJaara’s stale review April 30, 2026 15:36

Suggestion implemented

@emmaoke-w emmaoke-w added this pull request to the merge queue Apr 30, 2026
Merged via the queue into develop with commit 0e49853 Apr 30, 2026
17 checks passed
@emmaoke-w emmaoke-w deleted the ci/WPB-25106-manual-deflake-workflow branch April 30, 2026 15:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants