Failing Test

[lishaduck]

Contact Details

No response

What happened?

Bootstrap test failed.

Reproduction steps

n/a

What should have happened?

Shouldn't fail.

Date

Sep. 13th

What device are you seeing the problem on?

Mac

What platforms are you seeing the problem on? If on Web, also select browser.

MacOS

Context

I've been trying to fix this, but I can't figure out the issue.

Code of Conduct

• I agree to follow this project's Code of Conduct

[lishaduck]

How's this goin', @ParkerH27?

[PetalCat]

I'mma be real: confusingly.

[lishaduck]

Yeah. That was my experience. Did you see the branch I pushed w/my try @ fixing it?

[lishaduck]

Context:

#187 was fine until it was rebased atop 491b9b6, which looks to be a completely unrelated change.

Logs:

'package:flutter_test/src/binding.dart': Failed assertion: line 1332 pos 12: 'inTest': is not true.
dart:core                                           _AssertionError._throwNew
package:flutter_test/src/binding.dart 1332:12       AutomatedTestWidgetsFlutterBinding.scheduleAttachRootWidget
package:flutter/src/widgets/binding.dart 1095:7     runApp
package:pirate_code/app/app.dart 79:5               App.bootstrap
===== asynchronous gap ===========================
dart:async                                          _CustomZone.registerBinaryCallback
test/app/app_test.dart 93:11                        main.<fn>.<fn>.<fn>
package:matcher                                     expectLater
package:flutter_test/src/widget_tester.dart 491:25  expectLater
test/app/app_test.dart 91:13                        main.<fn>.<fn>

This test failed after it had already completed.
Make sure to use a matching library which informs the test runner
of pending async work.
dart:core                                           _AssertionError._throwNew
package:flutter_test/src/binding.dart 1332:12       AutomatedTestWidgetsFlutterBinding.scheduleAttachRootWidget
package:flutter/src/widgets/binding.dart 1095:7     runApp
package:pirate_code/app/app.dart 79:5               App.bootstrap
===== asynchronous gap ===========================
dart:async                                          _CustomZone.registerBinaryCallback
test/app/app_test.dart 93:11                        main.<fn>.<fn>.<fn>
package:matcher                                     expectLater
package:flutter_test/src/widget_tester.dart 491:25  expectLater
test/app/app_test.dart 91:13                        main.<fn>.<fn>

00:29 +30 -2: Some tests failed.
Failing Tests:
 - test/app/app_test.dart 
        - [ERROR] Bootstrapping Tests! Test the boots...
        - [ERROR] Bootstrapping Tests! Test the boots...

Previous branch to fix test: fix-test

[lishaduck]

Hmmm. It seems to be pretty flaky, seeing as it failed on merge queues and succeeded on pushes. Let's wait and see.

[lishaduck]

Nope. It's flaky, but at least we know that.
It's consistently failing on my macbook, so it might a linux thing.

[lishaduck]

Reposting this to keep threads on topic:

You wanna tackle this next after #193, @ParkerH27?

I guess so.... #193 is brain breaking

Yeah. Flaky tests are no fun. Did you look at 57339e9? I've found invertase's Assertions In Dart And Flutter Tests: An (Now For Sure) Ultimate Cheat Sheet to be quite useful. Also Flaky Tests: Getting Rid Of A Living Nightmare In Testing is a good article on why tests flake.