Mac_x64 module_test_ios is 3.00% flaky

[fluttergithubbot]

The post-submit test builder Mac_x64 module_test_ios had a flaky ratio 3.00% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
Commit: d3c274b

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

Please follow https://github.com/flutter/flutter/wiki/Reducing-Test-Flakiness#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

[jmagman]

 [2024-03-03 19:56:51.382516] [STDOUT] stdout:     t =    34.02s Get number of matches for: Elements matching predicate '"This is Marquee" IN identifiers'
 [2024-03-03 19:56:52.057342] [STDOUT] stdout: /Volumes/Work/s/w/ir/x/t/flutter_module_test.tfsA5B/hello_host_app/FlutterUITests/FlutterUITests.m:122: error: -[FlutterUITests testDualCold] : Asynchronous wait failed: Exceeded timeout of 30 seconds, with unfulfilled expectations: "Expect predicate `count == 2` for object <XCUIElementQuery: 0x600002140230>".
 [2024-03-03 19:56:52.059265] [STDOUT] stdout:     t =    34.70s Tear Down
 [2024-03-03 19:56:52.303887] [STDOUT] stdout: Test Case '-[FlutterUITests testDualCold]' failed (34.944 seconds).

The simulator rebooted in the middle of the test, which would be an Xcode issue.

This looks the same as #142125. #143967 added retry logic for testFlutterViewWarm but this one is testDualCold.

[jmagman]

 [2024-03-01 04:45:29.765690] [STDOUT] stdout:     t =    66.75s     Checking `Expect predicate `exists == 1` for object "Flutter iOS Demos Home" NavigationBar`
 [2024-03-01 04:45:29.766683] [STDOUT] stdout:     t =    66.75s         Checking existence of `"Flutter iOS Demos Home" NavigationBar`
 [2024-03-01 04:45:29.791278] [STDOUT] stdout:     t =    66.77s         Capturing element debug description
 [2024-03-01 04:45:29.968312] [STDOUT] stdout:     t =    66.95s Checking existence of `"Flutter iOS Demos Home" NavigationBar`
 [2024-03-01 04:45:29.991019] [STDOUT] stdout:     t =    66.97s Capturing debug information
 [2024-03-01 04:45:29.992448] [STDOUT] stdout:     t =    66.97s     Requesting snapshot of accessibility hierarchy for app with pid 45473
 [2024-03-01 04:45:30.174742] [STDOUT] stdout: /Volumes/Work/s/w/ir/x/t/flutter_module_test.Yt9NmR/hello_host_app/FlutterUITests/FlutterUITests.m:126: error: -[FlutterUITests testDualCold] : (([app.navigationBars[@"Flutter iOS Demos Home"] waitForExistenceWithTimeout:kStandardTimeOut]) is true) failed
 [2024-03-01 04:45:30.176602] [STDOUT] stdout:     t =    67.16s Tear Down
 [2024-03-01 04:45:30.445736] [STDOUT] stdout: Test Case '-[FlutterUITests testDualCold]' failed (67.426 seconds).

It's rebooting randomly in the middle of these tests on random "waits" so just doing the retry on "Increment via Flutter" isn't enough, it needs to be all waits. 🤮

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-01 and 2024-03-07 is 5.10%. Flaky number: 5; total number: 98.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
Commit: 894620b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-13 and 2024-03-19 is 4.00%. Flaky number: 4; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/260
Commit: 98369bd
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/260
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/240
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/235
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/215

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-01 and 2024-03-07 is 5.10%. Flaky number: 5; total number: 98.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
Commit: 894620b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-19 and 2024-03-26 is 2.00%. Flaky number: 2; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/360
Commit: 3373961
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/360
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/311

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-04 and 2024-03-07 is 4.23%. Flaky number: 3; total number: 71.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
Commit: 894620b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-26 and 2024-04-02 is 2.00%. Flaky number: 2; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/449
Commit: bca1d6a
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/449
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/437

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-03 and 2024-04-09 is 3.00%. Flaky number: 3; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/610
Commit: b5b9165
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/610
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/591
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/531

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-06 and 2024-04-16 is 4.00%. Flaky number: 4; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/698
Commit: 08bae32
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/698
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/693
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/675
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/610

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-17 and 2024-04-23 is 1.00%. Flaky number: 1; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/814
Commit: d737b7b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/814

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-23 and 2024-04-30 is 3.00%. Flaky number: 3; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/921
Commit: 07db2c4
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/921
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/896
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/885

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-05-01 and 2024-05-07 is 2.00%. Flaky number: 2; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/1025
Commit: 2e8c9fb
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/1025
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/1023

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[jmagman]

Deleting with #148264, this test isn't adding anything.

[github-actions]

This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.