Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KPI Request: No. of correlated test failures #139

Closed
1 task
Shreyanand opened this issue Mar 2, 2021 · 0 comments · Fixed by #150
Closed
1 task

KPI Request: No. of correlated test failures #139

Shreyanand opened this issue Mar 2, 2021 · 0 comments · Fixed by #150
Assignees
Projects

Comments

@Shreyanand
Copy link
Member

As an Openshift developer or manager, I would like to know for each test, the average number of other tests that are most likely to fail during the same build. If a test has a lot of failed correlated tests, it indicates that there could be issues with this test as well and vice versa.

@MichaelClifford already wrote a notebook that finds correlation between tests. This notebook can be repurposed for this metric.

Acceptance criteria

  • small notebook in notebooks/data-sources/TestGrid/metrics/ that collects this metric and stores it in ceph as a parquet
@chauhankaranraj chauhankaranraj self-assigned this Mar 8, 2021
@aakankshaduggal aakankshaduggal self-assigned this Mar 8, 2021
@aakankshaduggal aakankshaduggal added this to New in AI-4-CI via automation Mar 9, 2021
@MichaelClifford MichaelClifford moved this from New to In Progress in AI-4-CI Mar 10, 2021
AI-4-CI automation moved this from In Progress to Done Mar 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
AI-4-CI
  
Done
Development

Successfully merging a pull request may close this issue.

4 participants