Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Export RSpec results metadata to CircleCI #1321

Merged
merged 1 commit into from
Jan 22, 2021
Merged

Conversation

marcotc
Copy link
Member

@marcotc marcotc commented Jan 21, 2021

This PR exports RSpec of test results to CircleCI.

This allows CircleCI to properly record and display test failures, instead of us having to dig around the plain text output: (from Ruby 2.0 test failure)
Screen Shot 2021-01-21 at 5 56 23 PM

There's also a way to get historically flaky and slow tests, but it's only available through CircleCI API calls. I haven't had the time to do this API work yet, but it's good to start collecting data already for such report.

@marcotc marcotc added the dev/ci Involves CircleCI, GitHub Actions, or GitLab label Jan 21, 2021
@marcotc marcotc self-assigned this Jan 21, 2021
@marcotc marcotc requested a review from a team January 21, 2021 23:08
@brettlangdon
Copy link
Member

This will also feed into CircleCI insights (today it doesn't show per-test failures, but it is a planned feature and we can fetch the data via the API)

@marcotc marcotc merged commit ae0e276 into master Jan 22, 2021
@marcotc marcotc deleted the test-circleci-metadata branch January 22, 2021 16:45
@github-actions github-actions bot added this to the 0.45.0 milestone Jan 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dev/ci Involves CircleCI, GitHub Actions, or GitLab
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants