Mac tool_integration_tests_2_4 is 2.04% flaky

[fluttergithubbot]

The post-submit test builder Mac tool_integration_tests_2_4 had a flaky ratio 2.04% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_2_4/15811
Commit: b39660d

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_2_4/15811
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_2_4/15803

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac%20tool_integration_tests_2_4

Please follow https://github.com/flutter/flutter/wiki/Reducing-Test-Flakiness#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

[christopherfujino]

Looks like these are both the same error:

16:01 +15 -1: test/integration.shard/hot_reload_test.dart: hot restart works without error [E]                                                                                                         
  TimeoutException after 0:15:00.000000: Test timed out after 15 minutes.
  dart:isolate  _RawReceivePort._handleMessage
  
27s            Spawning flutter [run, --disable-service-auth-codes, --machine, --no-serve-observatory, -d, flutter-tester] in /Volumes/Work/s/w/ir/x/t/flutter_hot_reload_test.1pt6tt

<=stdout=  Resolving dependencies...

<=stdout=  Downloading packages...

<=stdout=    material_color_utilities 0.8.0 (0.11.1 available)

<=stdout=  Got dependencies!

<=stdout=  1 package has newer versions incompatible with dependency constraints.

<=stdout=  Try `flutter pub outdated` for more information.

28s <=stdout=  [{"event":"daemon.connected","params":{"version":"0.6.1","pid":37161}}]

OK (daemon.connected event)

<=stdout=  [{"event":"app.start","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","deviceId":"flutter-tester","directory":"/Volumes/Work/s/w/ir/x/t/flutter_hot_reload_test.1pt6tt","supportsRestart":true,"launchMode":"run","mode":"debug"}}]

OK (app.start event)

<=stdout=  Launching lib/main.dart on Flutter test device in debug mode...

32s <=stdout=  ((((TICK 1))))

<=stdout=  [{"event":"app.debugPort","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","port":51649,"wsUri":"ws://127.0.0.1:51649/ws","baseUri":"file:///Volumes/Work/s/w/ir/x/t/flutter_hot_reload_test.1pt6ttV11w6k/flutter_hot_reload_test.1pt6tt/"}}]

<=stdout=  [{"event":"app.progress","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","id":"0","progressId":null,"message":"Syncing files to device Flutter test device...","finished":false}}]

<=stdout=  [{"event":"app.progress","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","id":"0","progressId":null,"finished":true}}]

<=stdout=  [{"event":"app.started","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea"}}]

OK (app.started event)

Performing hot restart...

=stdin=>   [{"id":1,"method":"app.restart","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","fullRestart":true,"pause":false,"debounce":false,"debounceDurationOverrideMs":null}}]

<=stdout=  [{"event":"app.progress","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","id":"1","progressId":"hot.restart","message":"Performing hot restart...","finished":false}}]

<=stdout=  [{"event":"app.progress","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","id":"2","progressId":null,"message":"Syncing files to device Flutter test device...","finished":false}}]

<=stdout=  [{"event":"app.progress","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","id":"2","progressId":null,"finished":true}}]

33s <=stdout=  ((((TICK 1))))

37s            Expecting response to request 1
[+     4] <=stdout=  [{"event":"app.progress","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","id":"1","progressId":"hot.restart","message":"Performing hot restart...","finished":false}}]
[+     8] <=stdout=  [{"event":"app.progress","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","id":"2","progressId":null,"message":"Syncing files to device Flutter test device...","finished":false}}]
[+    51] <=stdout=  [{"event":"app.progress","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea","id":"2","progressId":null,"finished":true}}]
[+   315] <=stdout=  ((((TICK 1))))

Expecting response to request 1 is taking longer than usual...

927s            Stopping application...

=stdin=>   [{"id":2,"method":"app.stop","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea"}}]

<=stdout=  Application finished.

<=stdout=  [{"event":"app.stop","params":{"appId":"aec22b17-7ef0-44a8-8d41-e515296528ea"}}]
  Exception: Received app.stop event while waiting for response to request 1

<=stdout=  [{"id":2,"result":true}]

OK (response to request 2)

Waiting for process to end...

Process exited (0)

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-27 and 2024-04-02 is 0.00%. Flaky number: 0; total number: 99.

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-04-03 and 2024-04-09 is 0.00%. Flaky number: 0; total number: 94.

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-04-08 and 2024-04-16 is 2.04%. Flaky number: 2; total number: 98.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_2_4/16148
Commit: c06faf4
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_2_4/16148
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_2_4/16144

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac%20tool_integration_tests_2_4

[christopherfujino]

These were both the timeout from: #145812 (comment)