Skip to content

Enable Codecov Test Analytics across all CI test jobs #5206

@Yicong-Huang

Description

@Yicong-Huang

Task Summary

Codecov already receives coverage from four flags (frontend, amber, python, agent-service) plus five per-service platform flags. Codecov also offers Test Analytics — JUnit-XML-based reporting that surfaces failing tests with stack traces in PR comments, detects flaky tests against main, and tracks per-test run-time / failure-rate over time. The data is independent of coverage and uploads through the same codecov/codecov-action@v5 with report_type: test_results.

Enable it for every CI test job:

  • pytest (python) — add --junit-xml=junit.xml
  • Vitest (frontend, unit + browser) — configure JUnit reporter in vitest.config.ts / vitest.browser.config.ts
  • bun test (agent-service) — add --reporter=junit --reporter-outfile=junit.xml
  • ScalaTest (amber, amber-integration, five platform matrix entries) — ThisBuild / Test / testOptions gets -u target/test-reports

Then add one codecov/codecov-action@v5 upload step per test job with report_type: test_results, reusing the existing flag name and CODECOV_TOKEN.

Task Type

  • DevOps / Deployment / CI

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No fields configured for Task.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions