Skip to content

Clean up all flaky tests to be much more straightforward. #543

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jul 15, 2021

Conversation

jonsimantov
Copy link
Contributor

This PR adds RunFlakyTestSection, which lets you use regular EXPECT macros.

(This touches some internal googletest stuff, so it may break in the future if we update to a later googletest version.)

Rather than using RunFlakyTestSection directly, you should use the following two macros:
FLAKY_TEST_SECTION_BEGIN();
FLAKY_TEST_SECTION_END();

This PR also cleans up existing tests to use this new method.

This touches some internal googletest stuff, so it may break in the
future if we update to a later googletest version.

Rather than using this directly, you should use the following two
macros:
FLAKY_TEST_SECTION_BEGIN();
FLAKY_TEST_SECTION_END();

This change also cleans up existing tests to use this new method.
@google-cla google-cla bot added the cla: yes label Jul 15, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Jul 15, 2021
DellaBitta
DellaBitta previously approved these changes Jul 15, 2021
@github-actions github-actions bot added tests: in-progress This PR's integration tests are in progress. and removed tests-requested: quick Trigger a quick set of integration tests. labels Jul 15, 2021
@github-actions
Copy link

github-actions bot commented Jul 15, 2021

❌  Integration test FAILED

Requested by @jonsimantov on commit f6d1bee
Last updated: Thu Jul 15 18:48 PDT 2021
View integration test log & download artifacts

Failures Configs
firestore [TEST] [FAILURE] [Android] [windows] [android_latest]
(1 failed tests)  TestListenUnlistenRelistenSequenceOfMirrorQueries

@jonsimantov jonsimantov enabled auto-merge (squash) July 15, 2021 20:39
@github-actions github-actions bot added the tests: failed This PR's integration tests failed. label Jul 15, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label Jul 15, 2021
@jonsimantov jonsimantov removed the tests: failed This PR's integration tests failed. label Jul 15, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Jul 15, 2021
@github-actions github-actions bot added tests: in-progress This PR's integration tests are in progress. and removed tests-requested: quick Trigger a quick set of integration tests. labels Jul 15, 2021
@github-actions github-actions bot added the tests: succeeded This PR's integration tests succeeded. label Jul 15, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label Jul 15, 2021
@jonsimantov jonsimantov merged commit f6d1bee into main Jul 15, 2021
@github-actions github-actions bot added tests: in-progress This PR's integration tests are in progress. and removed tests: succeeded This PR's integration tests succeeded. labels Jul 15, 2021
@jonsimantov jonsimantov deleted the feature/flaky-test-magnum-opus branch July 16, 2021 00:22
@github-actions github-actions bot added the tests: succeeded This PR's integration tests succeeded. label Jul 16, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label Jul 16, 2021
@github-actions github-actions bot added the tests: failed This PR's integration tests failed. label Jul 16, 2021
@firebase firebase locked and limited conversation to collaborators Aug 15, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
cla: yes tests: failed This PR's integration tests failed. tests: succeeded This PR's integration tests succeeded.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants