Skip to content

Add library_branch tag to Test Optimization reporting#6440

Merged
nccatoni merged 4 commits into
mainfrom
nccatoni/test-optim-library-branch
Mar 6, 2026
Merged

Add library_branch tag to Test Optimization reporting#6440
nccatoni merged 4 commits into
mainfrom
nccatoni/test-optim-library-branch

Conversation

@nccatoni
Copy link
Copy Markdown
Collaborator

@nccatoni nccatoni commented Mar 5, 2026

Summary

  • Tag test results uploaded to Datadog Test Optimization with test.configuration.ci_environment (dev/prod/custom)
  • Reuses the existing ci_environment input already computed by compute-workflow-parameters.py
  • Updates ci_environment description in system-tests.yml to reflect its usage for Test Optimization tagging

Test plan

  • Verify CI runs with dev matrix version produce test.configuration.ci_environment:dev in Test Optimization
  • Verify CI runs with prod matrix version produce test.configuration.ci_environment:prod in Test Optimization
  • Verify external callers with custom binaries_artifact produce test.configuration.ci_environment:custom

Tag test results with test.configuration.library_branch (dev/prod)
so we can distinguish runs by library version type in Datadog Test
Optimization. The value is inferred from _system_tests_dev_mode and
binaries_artifact inputs.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@nccatoni nccatoni requested a review from a team as a code owner March 5, 2026 12:51
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 5, 2026

CODEOWNERS have been resolved as:

.github/actions/push_to_test_optim/action.yml                           @DataDog/system-tests-core
.github/workflows/run-end-to-end.yml                                    @DataDog/system-tests-core
.github/workflows/run-parametric.yml                                    @DataDog/system-tests-core

Copy link
Copy Markdown
Collaborator

@cbeauchesne cbeauchesne left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you use ci_environment which contains dev or prod, it'll make the overall change simpler

Simplify by reusing the existing ci_environment input (dev/prod)
instead of adding a new parameter through the workflow chain.
Also update ci_environment description to reflect its usage for
Test Optimization tagging.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@nccatoni
Copy link
Copy Markdown
Collaborator Author

nccatoni commented Mar 5, 2026

Do you also want to use ci_environment as the name for the test optimization attribute ?

@nccatoni nccatoni requested a review from cbeauchesne March 5, 2026 14:24
@cbeauchesne
Copy link
Copy Markdown
Collaborator

Do you also want to use ci_environment as the name for the test optimization attribute ?

yes, it makes sense, WDYT ?

nccatoni added 2 commits March 5, 2026 15:29
Use ci_environment consistently as both the action input name and
the test.configuration tag name in Datadog Test Optimization.
@datadog-official
Copy link
Copy Markdown

datadog-official Bot commented Mar 6, 2026

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: f721d58 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback!

@nccatoni nccatoni merged commit 0945ee8 into main Mar 6, 2026
1449 of 1453 checks passed
@nccatoni nccatoni deleted the nccatoni/test-optim-library-branch branch March 6, 2026 14:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants