Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mac_arm64_android run_release_test is 21.65% flaky #138076

Closed
fluttergithubbot opened this issue Nov 8, 2023 · 3 comments
Closed

Mac_arm64_android run_release_test is 21.65% flaky #138076

fluttergithubbot opened this issue Nov 8, 2023 · 3 comments
Labels
c: flake Tests that sometimes, but not always, incorrectly pass P0 Critical issues such as a build break or regression team-android Owned by Android platform team

Comments

@fluttergithubbot
Copy link
Contributor

The post-submit test builder Mac_arm64_android run_release_test had a flaky ratio 21.65% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9061
Commit: 8375dfd

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9061
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9056
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9055
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9053
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9052
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9051
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9049
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9048
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9047
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9046
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9045
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9044
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9043
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9036
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9035
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9033
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9031
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9030
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9029
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9026
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9025
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9024

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_arm64_android%20run_release_test

Please follow https://github.com/flutter/flutter/wiki/Reducing-Test-Flakiness#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

@fluttergithubbot fluttergithubbot added c: flake Tests that sometimes, but not always, incorrectly pass P0 Critical issues such as a build break or regression team-tool Owned by Flutter Tool team labels Nov 8, 2023
@zanderso
Copy link
Member

zanderso commented Nov 8, 2023

Similar to #138061 cc @camsim99

@zanderso zanderso removed their assignment Nov 8, 2023
@zanderso zanderso added team-android Owned by Android platform team and removed team-tool Owned by Flutter Tool team labels Nov 8, 2023
@camsim99
Copy link
Contributor

camsim99 commented Nov 9, 2023

Should be fixed by #138093

@camsim99 camsim99 closed this as completed Nov 9, 2023
Copy link

This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Nov 23, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
c: flake Tests that sometimes, but not always, incorrectly pass P0 Critical issues such as a build break or regression team-android Owned by Android platform team
Projects
None yet
Development

No branches or pull requests

3 participants