Send hidden tags under _dd.ci.library_configuration_error in every event of a test session#8274
Conversation
…figuration_request
Overall package sizeSelf size: 5.81 MB Dependency sizes| name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 3.0.1 | 82.56 kB | 817.39 kB | | dc-polyfill | 0.1.11 | 25.74 kB | 25.74 kB |🤖 This report was automatically generated by heaviest-objects-in-the-universe |
🎉 All green!❄️ No new flaky tests detected 🎯 Code Coverage (details) 🔗 Commit SHA: ce80826 | Docs | Datadog PR Page | Give us feedback! |
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: b485b28e68
ℹ️ About Codex in GitHub
Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".
BenchmarksBenchmark execution time: 2026-05-11 10:10:13 Comparing candidate commit ce80826 in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 1739 metrics, 105 unstable metrics. |
…figuration_request
…ror_tag_for_library_configuration_request
…figuration_request
…figuration_request
…figuration_request
|
@codex review |
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: e32f79c21a
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
E2E Test Report: SUCCESSTested by: Shepherd Agent (autonomous QA for Datadog Test Optimization) Test Environment
Results
Each scenario emitted Issues FoundNo product issues found. A local test-file selection mistake during setup was corrected before the reported runs; the reported scenarios all passed. VerificationVerified locally against mockdog parsed CI Visibility payloads with Test Methodology
This E2E test was performed by Shepherd - autonomous QA agent for Datadog Test Optimization. |
|
@codex review |
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: c67ae4d245
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
…ed tests for checking error tags on every level (session, module, suite and test). Added error tag spreading at suite level on vitest and cypress
…figuration_request
|
@codex review |
|
Codex Review: Didn't find any major issues. Can't wait for the next one! ℹ️ About Codex in GitHubCodex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
If Codex has suggestions, it will comment; otherwise it will react with 👍. When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback". |
…figuration_request
…figuration_request
…ent of a test session (#8274)
What does this PR do?
Update the JS tracer to send the hidden tags under
_dd.ci.library_configuration_errorin every event of a test session (tests, suites, modules, and sessions) when a communication error occurs with the backend during library configuration requests.The tags sent are:
_dd.ci.library_configuration_error.settings_dd.ci.library_configuration_error.skippable_tests_dd.ci.library_configuration_error.known_tests_dd.ci.library_configuration_error.test_management_testsMotivation
Whenever there is a communication error between the library and our backend, especially in the
/api/v2/libraries/tests/services/settingendpoint, our advanced features stop working, leaving the customer confused as to why a quarantine (or others) is not working.The way we’re going to mitigate this is by sending a hidden set of tags under
_dd.ci.library_configuration_errorin every event of that test session. This means tests, suites, modules and sessions. The whole set of tags will be the following, one per request type we perform to the backend:_dd.ci.library_configuration_error.settings_dd.ci.library_configuration_error.skippable_tests_dd.ci.library_configuration_error.known_tests_dd.ci.library_configuration_error.test_management_tests