Skip to content

Improve integration test results reporting. #348

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 32 commits into from
Mar 29, 2021
Merged

Improve integration test results reporting. #348

merged 32 commits into from
Mar 29, 2021

Conversation

@jonsimantov
Copy link
Contributor

@jonsimantov jonsimantov commented Mar 25, 2021 •
edited
Loading

Each test phase now uploads its results summary as a temporary artifact. A new summarize script looks at those artifacts and prints out a table and/or a github log entry at the end of the test run, if any builds or tests failed.

@google-cla google-cla bot added the cla: yes label Mar 25, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Mar 25, 2021
@github-actions github-actions bot added tests: in-progress This PR's integration tests are in progress. and removed tests-requested: quick Trigger a quick set of integration tests. labels Mar 25, 2021
@github-actions github-actions bot added the tests: failed This PR's integration tests failed. label Mar 25, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Mar 25, 2021
@github-actions github-actions bot removed tests-requested: quick Trigger a quick set of integration tests. tests: failed This PR's integration tests failed. labels Mar 25, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Mar 25, 2021
@github-actions github-actions bot removed the tests-requested: quick Trigger a quick set of integration tests. label Mar 25, 2021
@github-actions github-actions bot added the tests: failed This PR's integration tests failed. label Mar 25, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Mar 25, 2021
@github-actions github-actions bot removed tests-requested: quick Trigger a quick set of integration tests. tests: failed This PR's integration tests failed. labels Mar 25, 2021
@github-actions github-actions bot added the tests: failed This PR's integration tests failed. label Mar 25, 2021
@firebase firebase deleted a comment from github-actions bot Mar 25, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Mar 25, 2021
@jonsimantov jonsimantov removed the tests-requested: quick Trigger a quick set of integration tests. label Mar 25, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label Mar 26, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Mar 26, 2021
@github-actions github-actions bot added tests: in-progress This PR's integration tests are in progress. tests: failed This PR's integration tests failed. and removed tests-requested: quick Trigger a quick set of integration tests. tests: failed This PR's integration tests failed. labels Mar 26, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label Mar 26, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Mar 26, 2021
@github-actions github-actions bot added tests: in-progress This PR's integration tests are in progress. tests: failed This PR's integration tests failed. and removed tests-requested: quick Trigger a quick set of integration tests. tests: failed This PR's integration tests failed. labels Mar 26, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label Mar 26, 2021
@jonsimantov jonsimantov added the tests-requested: quick Trigger a quick set of integration tests. label Mar 26, 2021
@github-actions github-actions bot added tests: in-progress This PR's integration tests are in progress. and removed tests-requested: quick Trigger a quick set of integration tests. tests: failed This PR's integration tests failed. labels Mar 26, 2021
@github-actions
Copy link

github-actions bot commented Mar 26, 2021 •
edited
Loading

❌  Integration test FAILED

Requested by @jonsimantov on commit 2b42394
Last updated: Fri Mar 26 18:51:50 PDT 2021
View integration test results

Platform Build failures Test failures
Android (built on Windows)
(12 items)admob
analytics
auth
database
dynamic_links
firestore
functions
installations
instance_id
messaging
remote_config
storage

@github-actions github-actions bot added the tests: failed This PR's integration tests failed. label Mar 27, 2021
@firebase-workflow-trigger firebase-workflow-trigger bot removed the tests: in-progress This PR's integration tests are in progress. label Mar 27, 2021
@jonsimantov jonsimantov requested a review from DellaBitta March 29, 2021 17:00
@jonsimantov jonsimantov removed the tests: failed This PR's integration tests failed. label Mar 29, 2021
@jonsimantov jonsimantov merged commit 1ea86a7 into main Mar 29, 2021
@jonsimantov jonsimantov deleted the feature/improve-test-reporting branch March 30, 2021 20:10
@firebase firebase locked and limited conversation to collaborators Apr 29, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

@DellaBitta DellaBitta DellaBitta approved these changes

Assignees

No one assigned

Labels

cla: yes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@jonsimantov @DellaBitta