Skip to content

Send hidden tags under _dd.ci.library_configuration_error in every event of a test session#8274

Merged
cbasitodx merged 18 commits into
masterfrom
sebas_conde/feat/error_tag_for_library_configuration_request
May 11, 2026
Merged

Send hidden tags under _dd.ci.library_configuration_error in every event of a test session#8274
cbasitodx merged 18 commits into
masterfrom
sebas_conde/feat/error_tag_for_library_configuration_request

Conversation

@cbasitodx
Copy link
Copy Markdown
Contributor

What does this PR do?

Update the JS tracer to send the hidden tags under _dd.ci.library_configuration_error in every event of a test session (tests, suites, modules, and sessions) when a communication error occurs with the backend during library configuration requests.

The tags sent are:

  • _dd.ci.library_configuration_error.settings
  • _dd.ci.library_configuration_error.skippable_tests
  • _dd.ci.library_configuration_error.known_tests
  • _dd.ci.library_configuration_error.test_management_tests

Motivation

Whenever there is a communication error between the library and our backend, especially in the /api/v2/libraries/tests/services/setting endpoint, our advanced features stop working, leaving the customer confused as to why a quarantine (or others) is not working.

The way we’re going to mitigate this is by sending a hidden set of tags under _dd.ci.library_configuration_error in every event of that test session. This means tests, suites, modules and sessions. The whole set of tags will be the following, one per request type we perform to the backend:

  • _dd.ci.library_configuration_error.settings
  • _dd.ci.library_configuration_error.skippable_tests
  • _dd.ci.library_configuration_error.known_tests
  • _dd.ci.library_configuration_error.test_management_tests

@cbasitodx cbasitodx requested a review from a team as a code owner May 5, 2026 16:04
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 5, 2026

Overall package size

Self size: 5.81 MB
Deduped: 6.66 MB
No deduping: 6.66 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 3.0.1 | 82.56 kB | 817.39 kB | | dc-polyfill | 0.1.11 | 25.74 kB | 25.74 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@datadog-prod-us1-5
Copy link
Copy Markdown

datadog-prod-us1-5 Bot commented May 5, 2026

Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

🎯 Code Coverage (details)
Patch Coverage: 96.00%
Overall Coverage: 86.77% (+0.03%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: ce80826 | Docs | Datadog PR Page | Give us feedback!

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b485b28e68

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread integration-tests/ci-visibility/jest-plugin-tests/jest-focus.js Outdated
Comment thread packages/datadog-plugin-cypress/src/cypress-plugin.js
@codecov
Copy link
Copy Markdown

codecov Bot commented May 5, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 89.98%. Comparing base (e276b97) to head (ce80826).

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #8274      +/-   ##
==========================================
+ Coverage   89.97%   89.98%   +0.01%     
==========================================
  Files         836      836              
  Lines       44953    44972      +19     
  Branches     8354     8360       +6     
==========================================
+ Hits        40446    40470      +24     
+ Misses       4507     4502       -5     
Flag Coverage Δ
aiguard-integration-active 40.52% <18.18%> (-0.03%) ⬇️
aiguard-integration-latest 40.47% <18.18%> (-0.03%) ⬇️
aiguard-integration-maintenance 40.52% <18.18%> (-0.03%) ⬇️
aiguard-macos 35.19% <19.04%> (-0.11%) ⬇️
aiguard-ubuntu 35.30% <19.04%> (-0.11%) ⬇️
aiguard-windows 35.10% <19.04%> (-0.11%) ⬇️
apm-capabilities-tracing-macos 49.01% <19.04%> (+0.02%) ⬆️
apm-capabilities-tracing-ubuntu-active 49.04% <19.04%> (-0.02%) ⬇️
apm-capabilities-tracing-ubuntu-latest 49.01% <19.04%> (-0.02%) ⬇️
apm-capabilities-tracing-ubuntu-maintenance 49.22% <19.04%> (+0.16%) ⬆️
apm-capabilities-tracing-ubuntu-oldest 49.03% <19.04%> (-0.20%) ⬇️
apm-capabilities-tracing-windows 48.84% <19.04%> (+0.09%) ⬆️
apm-integrations-aerospike-18-gte.5.2.0 34.23% <19.04%> (-0.11%) ⬇️
apm-integrations-aerospike-20-gte.5.5.0 34.25% <19.04%> (-0.11%) ⬇️
apm-integrations-aerospike-22-gte.5.12.1 34.25% <19.04%> (-0.11%) ⬇️
apm-integrations-aerospike-22-gte.6.0.0 34.25% <19.04%> (-0.11%) ⬇️
apm-integrations-aerospike-eol- 34.16% <19.04%> (-0.11%) ⬇️
apm-integrations-child-process 35.22% <19.04%> (-0.11%) ⬇️
apm-integrations-confluentinc-kafka-javascript-18 41.05% <19.04%> (-0.11%) ⬇️
apm-integrations-confluentinc-kafka-javascript-20 41.07% <19.04%> (-0.11%) ⬇️
apm-integrations-confluentinc-kafka-javascript-22 41.07% <19.04%> (-0.11%) ⬇️
apm-integrations-confluentinc-kafka-javascript-24 41.00% <19.04%> (-0.11%) ⬇️
apm-integrations-couchbase-18 34.55% <19.04%> (+0.03%) ⬆️
apm-integrations-couchbase-eol 34.66% <19.04%> (-0.11%) ⬇️
apm-integrations-dns 34.11% <19.04%> (-0.10%) ⬇️
apm-integrations-elasticsearch 34.90% <19.04%> (-0.10%) ⬇️
apm-integrations-http-latest 42.04% <19.04%> (-0.10%) ⬇️
apm-integrations-http-maintenance 42.10% <19.04%> (-0.10%) ⬇️
apm-integrations-http-oldest 42.11% <19.04%> (-0.10%) ⬇️
apm-integrations-http2 39.52% <19.04%> (-0.11%) ⬇️
apm-integrations-kafkajs-latest 40.94% <19.04%> (-0.11%) ⬇️
apm-integrations-kafkajs-oldest 40.98% <19.04%> (-0.14%) ⬇️
apm-integrations-net 34.79% <19.04%> (-0.11%) ⬇️
apm-integrations-next-11.1.4 29.01% <19.04%> (-0.09%) ⬇️
apm-integrations-next-13.2.0 30.69% <19.04%> (-0.10%) ⬇️
apm-integrations-next-gte.10.2.0.and.lt.11 22.99% <ø> (ø)
apm-integrations-next-gte.11.0.0.and.lt.13 30.70% <19.04%> (-0.10%) ⬇️
apm-integrations-next-gte.13.0.0.and.lt.14 30.95% <19.04%> (-0.10%) ⬇️
apm-integrations-next-gte.14.0.0.and.lte.14.2.6 30.76% <19.04%> (-0.10%) ⬇️
apm-integrations-next-gte.14.2.7.and.lt.15 30.76% <19.04%> (-0.10%) ⬇️
apm-integrations-next-gte.15.0.0 30.83% <19.04%> (-0.10%) ⬇️
apm-integrations-oracledb 34.54% <19.04%> (-0.10%) ⬇️
apm-integrations-prisma-18-gte.6.16.0.and.lt.7.0.0 34.92% <19.04%> (-0.10%) ⬇️
apm-integrations-prisma-latest-all 35.33% <19.04%> (-0.10%) ⬇️
apm-integrations-restify 36.29% <19.04%> (-0.10%) ⬇️
apm-integrations-sharedb 33.78% <19.04%> (-0.11%) ⬇️
apm-integrations-tedious 34.34% <19.04%> (-0.10%) ⬇️
appsec-express 51.86% <19.04%> (-0.10%) ⬇️
appsec-fastify 48.58% <19.04%> (-0.09%) ⬇️
appsec-graphql 48.87% <19.04%> (-0.09%) ⬇️
appsec-integration-active 36.90% <17.39%> (-0.01%) ⬇️
appsec-integration-latest 36.87% <17.39%> (-0.01%) ⬇️
appsec-integration-maintenance 36.89% <17.39%> (-0.01%) ⬇️
appsec-integration-oldest 36.89% <17.39%> (-0.01%) ⬇️
appsec-kafka 41.36% <19.04%> (-0.10%) ⬇️
appsec-ldapjs 40.61% <19.04%> (-0.10%) ⬇️
appsec-lodash 40.72% <19.04%> (-0.10%) ⬇️
appsec-macos 55.71% <19.04%> (-0.10%) ⬇️
appsec-mongodb-core 45.05% <19.04%> (-0.10%) ⬇️
appsec-mongoose 45.91% <19.04%> (-0.10%) ⬇️
appsec-mysql 47.91% <19.04%> (-0.14%) ⬇️
appsec-next-latest-11.1.4 29.13% <19.04%> (-0.09%) ⬇️
appsec-next-latest-13.2.0 30.83% <19.04%> (-0.10%) ⬇️
appsec-next-latest-gte.10.2.0.and.lt.11 28.57% <ø> (ø)
appsec-next-latest-gte.11.0.0.and.lt.13 30.82% <19.04%> (-0.10%) ⬇️
appsec-next-latest-gte.13.0.0.and.lt.14 31.06% <19.04%> (-0.10%) ⬇️
appsec-next-latest-gte.14.0.0.and.lte.14.2.6 30.91% <19.04%> (-0.10%) ⬇️
appsec-next-latest-gte.14.2.7.and.lt.15 30.91% <19.04%> (-0.10%) ⬇️
appsec-next-latest-gte.15.0.0 30.91% <19.04%> (-0.10%) ⬇️
appsec-next-oldest-11.1.4 29.13% <19.04%> (-0.10%) ⬇️
appsec-next-oldest-13.2.0 31.11% <19.04%> (-0.10%) ⬇️
appsec-next-oldest-gte.10.2.0.and.lt.11 28.69% <ø> (ø)
appsec-next-oldest-gte.11.0.0.and.lt.13 30.83% <19.04%> (-0.10%) ⬇️
appsec-next-oldest-gte.13.0.0.and.lt.14 31.30% <19.04%> (-0.10%) ⬇️
appsec-next-oldest-gte.14.0.0.and.lte.14.2.6 31.15% <19.04%> (-0.10%) ⬇️
appsec-next-oldest-gte.14.2.7.and.lt.15 31.15% <19.04%> (-0.10%) ⬇️
appsec-next-oldest-gte.15.0.0 31.15% <19.04%> (-0.10%) ⬇️
appsec-node-serialize 39.94% <19.04%> (-0.10%) ⬇️
appsec-passport 43.59% <19.04%> (-0.10%) ⬇️
appsec-postgres 47.50% <19.04%> (-0.09%) ⬇️
appsec-sourcing 39.28% <19.04%> (-0.10%) ⬇️
appsec-stripe 41.37% <19.04%> (-0.10%) ⬇️
appsec-template 40.10% <19.04%> (-0.10%) ⬇️
appsec-ubuntu 55.78% <19.04%> (-0.10%) ⬇️
appsec-windows 55.63% <19.04%> (-0.12%) ⬇️
debugger-ubuntu-active 43.14% <18.18%> (-0.03%) ⬇️
debugger-ubuntu-latest 43.54% <18.18%> (+0.42%) ⬆️
debugger-ubuntu-maintenance 43.16% <18.18%> (-0.03%) ⬇️
debugger-ubuntu-oldest 43.59% <18.18%> (-0.03%) ⬇️
instrumentations-instrumentation-bluebird 29.23% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-body-parser 36.83% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-child_process 34.70% <19.04%> (-0.11%) ⬇️
instrumentations-instrumentation-cookie-parser 31.07% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-express 31.28% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-express-mongo-sanitize 31.18% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-express-session 36.52% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-fs 28.91% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-generic-pool 29.82% <28.57%> (+<0.01%) ⬆️
instrumentations-instrumentation-http 36.19% <19.04%> (-0.11%) ⬇️
instrumentations-instrumentation-knex 29.20% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-light-my-request 36.45% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-mongoose 30.33% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-multer 36.61% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-mysql2 34.74% <19.04%> (-0.11%) ⬇️
instrumentations-instrumentation-passport 40.24% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-passport-http 40.01% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-passport-local 40.50% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-pg 34.29% <19.04%> (-0.11%) ⬇️
instrumentations-instrumentation-promise 29.16% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-promise-js 29.17% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-q 29.20% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-url 29.17% <19.04%> (-0.10%) ⬇️
instrumentations-instrumentation-when 29.18% <19.04%> (-0.10%) ⬇️
instrumentations-integration-esbuild-active 19.30% <26.66%> (+<0.01%) ⬆️
instrumentations-integration-esbuild-latest 19.29% <26.66%> (+<0.01%) ⬆️
instrumentations-integration-esbuild-maintenance 19.30% <26.66%> (+<0.01%) ⬆️
instrumentations-integration-esbuild-oldest 19.29% <26.66%> (+<0.01%) ⬆️
llmobs-ai 37.66% <19.04%> (-0.10%) ⬇️
llmobs-anthropic 37.71% <19.04%> (-0.10%) ⬇️
llmobs-bedrock 36.42% <19.04%> (-0.09%) ⬇️
llmobs-google-genai 36.74% <19.04%> (-0.10%) ⬇️
llmobs-langchain 36.45% <19.04%> (-0.09%) ⬇️
llmobs-openai 40.49% <19.04%> (-0.10%) ⬇️
llmobs-sdk-active 45.28% <19.04%> (-0.12%) ⬇️
llmobs-sdk-latest 45.22% <19.04%> (-0.12%) ⬇️
llmobs-sdk-maintenance 45.28% <19.04%> (-0.12%) ⬇️
llmobs-sdk-oldest 45.27% <19.04%> (-0.12%) ⬇️
llmobs-vertex-ai 36.89% <19.04%> (-0.10%) ⬇️
openfeature-macos 37.89% <18.18%> (-0.03%) ⬇️
openfeature-ubuntu 37.97% <18.18%> (-0.03%) ⬇️
openfeature-unit-active 48.38% <ø> (ø)
openfeature-unit-latest 48.22% <ø> (ø)
openfeature-unit-maintenance 48.38% <ø> (ø)
openfeature-unit-oldest 48.38% <ø> (ø)
openfeature-windows 37.76% <18.18%> (-0.03%) ⬇️
platform-core 37.27% <ø> (ø)
platform-esbuild 40.61% <ø> (ø)
platform-instrumentations-misc 30.66% <19.04%> (-0.02%) ⬇️
platform-integration-active 46.89% <18.18%> (-0.04%) ⬇️
platform-integration-latest 46.85% <18.18%> (-0.04%) ⬇️
platform-integration-maintenance 46.91% <18.18%> (-0.03%) ⬇️
platform-integration-oldest 47.07% <18.18%> (-0.03%) ⬇️
platform-shimmer 42.29% <ø> (ø)
platform-unit-guardrails 36.12% <ø> (ø)
platform-webpack 20.43% <26.66%> (+<0.01%) ⬆️
plugins-azure-durable-functions 36.88% <18.18%> (-0.02%) ⬇️
plugins-azure-event-hubs 34.72% <18.18%> (-0.02%) ⬇️
plugins-azure-service-bus 35.19% <18.18%> (-0.02%) ⬇️
plugins-bullmq 39.97% <19.04%> (-0.22%) ⬇️
plugins-cassandra 34.55% <19.04%> (-0.23%) ⬇️
plugins-cookie 26.65% <ø> (ø)
plugins-cookie-parser 26.46% <ø> (ø)
plugins-crypto 27.69% <ø> (ø)
plugins-dd-trace-api 34.63% <19.04%> (-0.11%) ⬇️
plugins-express-mongo-sanitize 26.59% <ø> (ø)
plugins-express-session 26.42% <ø> (ø)
plugins-fastify 38.59% <19.04%> (-0.10%) ⬇️
plugins-fetch 34.92% <19.04%> (-0.10%) ⬇️
plugins-fs 34.98% <19.04%> (-0.11%) ⬇️
plugins-generic-pool 25.58% <ø> (ø)
plugins-google-cloud-pubsub 42.35% <19.04%> (-0.12%) ⬇️
plugins-grpc 37.37% <19.04%> (-0.10%) ⬇️
plugins-handlebars 26.63% <ø> (ø)
plugins-hapi 36.49% <19.04%> (-0.11%) ⬇️
plugins-hono 36.77% <19.04%> (-0.10%) ⬇️
plugins-ioredis 35.07% <19.04%> (-0.11%) ⬇️
plugins-knex 26.31% <ø> (ø)
plugins-langgraph 34.34% <19.04%> (-0.10%) ⬇️
plugins-ldapjs 24.20% <ø> (ø)
plugins-light-my-request 26.06% <ø> (ø)
plugins-limitd-client 29.46% <19.04%> (-0.10%) ⬇️
plugins-lodash 25.65% <ø> (ø)
plugins-mariadb 36.02% <19.04%> (-0.11%) ⬇️
plugins-memcached 34.72% <19.04%> (-0.11%) ⬇️
plugins-microgateway-core 35.61% <19.04%> (-0.10%) ⬇️
plugins-modelcontextprotocol-sdk 33.63% <19.04%> (-0.11%) ⬇️
plugins-moleculer 37.45% <19.04%> (-0.11%) ⬇️
plugins-mongodb 35.92% <19.04%> (-0.21%) ⬇️
plugins-mongodb-core 35.63% <19.04%> (-0.13%) ⬇️
plugins-mongoose 35.43% <19.04%> (-0.10%) ⬇️
plugins-multer 26.42% <ø> (ø)
plugins-mysql 35.70% <19.04%> (+0.03%) ⬆️
plugins-mysql2 35.79% <19.04%> (-0.11%) ⬇️
plugins-node-serialize 26.69% <ø> (ø)
plugins-opensearch 34.43% <19.04%> (-0.10%) ⬇️
plugins-passport-http 26.47% <ø> (ø)
plugins-pino 31.17% <19.04%> (-0.10%) ⬇️
plugins-postgres 33.81% <19.04%> (-0.10%) ⬇️
plugins-process 27.69% <ø> (ø)
plugins-pug 26.65% <ø> (ø)
plugins-redis 35.07% <19.04%> (-0.17%) ⬇️
plugins-router 39.06% <19.04%> (+0.02%) ⬆️
plugins-sequelize 25.36% <ø> (ø)
plugins-test-and-upstream-amqp10 34.83% <19.04%> (-0.24%) ⬇️
plugins-test-and-upstream-amqplib 40.19% <19.04%> (-0.09%) ⬇️
plugins-test-and-upstream-apollo 35.84% <19.04%> (-0.10%) ⬇️
plugins-test-and-upstream-avsc 34.31% <19.04%> (-0.11%) ⬇️
plugins-test-and-upstream-bunyan 30.54% <19.04%> (-0.10%) ⬇️
plugins-test-and-upstream-connect 37.15% <19.04%> (-0.11%) ⬇️
plugins-test-and-upstream-graphql 36.72% <19.04%> (-0.13%) ⬇️
plugins-test-and-upstream-koa 36.75% <19.04%> (-0.11%) ⬇️
plugins-test-and-upstream-protobufjs 34.51% <19.04%> (-0.11%) ⬇️
plugins-test-and-upstream-rhea 40.20% <19.04%> (-0.11%) ⬇️
plugins-undici 35.65% <19.04%> (-0.10%) ⬇️
plugins-url 27.69% <ø> (ø)
plugins-valkey 34.73% <19.04%> (-0.12%) ⬇️
plugins-vm 27.69% <ø> (ø)
plugins-winston 31.06% <19.04%> (-0.10%) ⬇️
plugins-ws 38.26% <19.04%> (-0.11%) ⬇️
profiling-macos 42.67% <18.18%> (-0.04%) ⬇️
profiling-ubuntu 43.02% <18.18%> (-0.09%) ⬇️
profiling-windows 39.93% <18.18%> (-0.09%) ⬇️
serverless-aws-sdk-latest-aws-sdk ?
serverless-aws-sdk-latest-bedrockruntime 32.97% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-latest-client 22.38% <ø> (ø)
serverless-aws-sdk-latest-dynamodb 35.59% <19.04%> (-0.04%) ⬇️
serverless-aws-sdk-latest-eventbridge 28.74% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-latest-kinesis 38.52% <19.04%> (-0.10%) ⬇️
serverless-aws-sdk-latest-lambda 35.78% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-latest-s3 33.74% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-latest-serverless-peer-service 39.89% <19.04%> (-0.11%) ⬇️
serverless-aws-sdk-latest-sns 39.62% <19.04%> (-0.10%) ⬇️
serverless-aws-sdk-latest-sqs 38.91% <19.04%> (-0.10%) ⬇️
serverless-aws-sdk-latest-stepfunctions 34.35% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-latest-util 47.45% <ø> (ø)
serverless-aws-sdk-oldest-aws-sdk 34.73% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-oldest-bedrockruntime 33.25% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-oldest-client 22.75% <ø> (ø)
serverless-aws-sdk-oldest-dynamodb 35.66% <19.04%> (-0.10%) ⬇️
serverless-aws-sdk-oldest-eventbridge 28.79% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-oldest-kinesis 38.65% <19.04%> (-0.10%) ⬇️
serverless-aws-sdk-oldest-lambda 35.86% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-oldest-s3 33.81% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-oldest-serverless-peer-service 39.95% <19.04%> (-0.11%) ⬇️
serverless-aws-sdk-oldest-sns 39.70% <19.04%> (-0.10%) ⬇️
serverless-aws-sdk-oldest-sqs 38.80% <19.04%> (-0.10%) ⬇️
serverless-aws-sdk-oldest-stepfunctions 34.43% <19.04%> (-0.09%) ⬇️
serverless-aws-sdk-oldest-util 47.77% <ø> (ø)
serverless-azure-functions-eventhubs 38.37% <18.18%> (-0.03%) ⬇️
serverless-azure-functions-servicebus 38.43% <18.18%> (-0.03%) ⬇️
serverless-lambda 32.74% <19.04%> (-0.10%) ⬇️
test-optimization-cucumber-latest-7.0.0 50.50% <82.60%> (+0.29%) ⬆️
test-optimization-cucumber-latest-latest 53.10% <86.95%> (+0.18%) ⬆️
test-optimization-cucumber-oldest-7.0.0 50.40% <82.60%> (+0.18%) ⬆️
test-optimization-cypress-latest-12.0.0-commonJS 48.73% <68.00%> (+0.15%) ⬆️
test-optimization-cypress-latest-12.0.0-esm 48.76% <68.00%> (+0.15%) ⬆️
test-optimization-cypress-latest-14.5.4-commonJS 48.58% <68.00%> (+0.18%) ⬆️
test-optimization-cypress-latest-14.5.4-esm 48.61% <68.00%> (+0.18%) ⬆️
test-optimization-cypress-latest-latest-commonJS 49.07% <68.00%> (+0.17%) ⬆️
test-optimization-cypress-latest-latest-esm 49.22% <68.00%> (+0.29%) ⬆️
test-optimization-cypress-oldest-12.0.0-commonJS 48.77% <68.00%> (+0.18%) ⬆️
test-optimization-cypress-oldest-12.0.0-esm 48.80% <68.00%> (+0.18%) ⬆️
test-optimization-cypress-oldest-14.5.4-commonJS 48.62% <68.00%> (+0.18%) ⬆️
test-optimization-cypress-oldest-14.5.4-esm 48.65% <68.00%> (+0.18%) ⬆️
test-optimization-jest-latest-latest 54.95% <90.90%> (+0.22%) ⬆️
test-optimization-jest-latest-oldest 53.63% <90.90%> (+0.09%) ⬆️
test-optimization-jest-oldest-latest 54.85% <90.90%> (+0.12%) ⬆️
test-optimization-jest-oldest-oldest 53.60% <90.90%> (+0.12%) ⬆️
test-optimization-mocha-latest-latest 53.37% <86.36%> (+0.13%) ⬆️
test-optimization-mocha-latest-oldest 50.98% <81.81%> (+0.14%) ⬆️
test-optimization-mocha-oldest-latest 53.43% <86.36%> (+0.13%) ⬆️
test-optimization-mocha-oldest-oldest 50.92% <81.81%> (+0.14%) ⬆️
test-optimization-playwright-latest-latest-playwright-active-test-span 44.23% <45.45%> (+0.28%) ⬆️
test-optimization-playwright-latest-latest-playwright-atr 42.99% <45.45%> (+0.11%) ⬆️
test-optimization-playwright-latest-latest-playwright-efd 43.42% <63.63%> (+0.14%) ⬆️
test-optimization-playwright-latest-latest-playwright-final-status 43.46% <45.45%> (+0.11%) ⬆️
test-optimization-playwright-latest-latest-playwright-impacted-tests 42.92% <45.45%> (+<0.01%) ⬆️
test-optimization-playwright-latest-latest-playwright-reporting 42.87% <81.81%> (+0.54%) ⬆️
test-optimization-playwright-latest-latest-playwright-test-management 44.65% <63.63%> (+0.15%) ⬆️
test-optimization-playwright-latest-oldest-playwright-active-test-span 44.29% <45.45%> (+0.28%) ⬆️
test-optimization-playwright-latest-oldest-playwright-atr 43.21% <45.45%> (+0.11%) ⬆️
test-optimization-playwright-latest-oldest-playwright-efd 43.47% <63.63%> (+0.14%) ⬆️
test-optimization-playwright-latest-oldest-playwright-final-status 43.52% <45.45%> (+0.11%) ⬆️
test-optimization-playwright-latest-oldest-playwright-impacted-tests 42.97% <45.45%> (+<0.01%) ⬆️
test-optimization-playwright-latest-oldest-playwright-reporting 42.94% <81.81%> (+0.55%) ⬆️
test-optimization-playwright-latest-oldest-playwright-test-management 44.72% <63.63%> (+0.15%) ⬆️
test-optimization-playwright-oldest-latest-playwright-active-test-span 44.27% <45.45%> (+0.28%) ⬆️
test-optimization-playwright-oldest-latest-playwright-atr 43.03% <45.45%> (+0.11%) ⬆️
test-optimization-playwright-oldest-latest-playwright-efd 43.43% <63.63%> (+0.14%) ⬆️
test-optimization-playwright-oldest-latest-playwright-final-status 43.48% <45.45%> (+0.11%) ⬆️
test-optimization-playwright-oldest-latest-playwright-impacted-tests 42.96% <45.45%> (+<0.01%) ⬆️
test-optimization-playwright-oldest-latest-playwright-reporting 42.88% <81.81%> (+0.54%) ⬆️
test-optimization-playwright-oldest-latest-playwright-test-management 44.66% <63.63%> (+0.15%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-active-test-span 44.33% <45.45%> (+0.28%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-atr 43.24% <45.45%> (+0.11%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-efd 43.49% <63.63%> (+0.14%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-final-status 43.53% <45.45%> (+0.11%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-impacted-tests 43.01% <45.45%> (+<0.01%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-reporting 42.95% <81.81%> (+0.55%) ⬆️
test-optimization-playwright-oldest-oldest-playwright-test-management 44.74% <63.63%> (+0.15%) ⬆️
test-optimization-selenium-latest 45.61% <47.82%> (+0.07%) ⬆️
test-optimization-selenium-oldest 45.11% <45.45%> (+0.07%) ⬆️
test-optimization-testopt-active 46.97% <47.82%> (+0.13%) ⬆️
test-optimization-testopt-latest 46.93% <47.82%> (+0.13%) ⬆️
test-optimization-testopt-maintenance 46.97% <47.82%> (+0.13%) ⬆️
test-optimization-testopt-oldest 47.84% <45.45%> (+0.14%) ⬆️
test-optimization-vitest-latest 50.97% <90.90%> (+0.14%) ⬆️
test-optimization-vitest-oldest 47.98% <90.90%> (+0.66%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented May 5, 2026

Benchmarks

Benchmark execution time: 2026-05-11 10:10:13

Comparing candidate commit ce80826 in PR branch sebas_conde/feat/error_tag_for_library_configuration_request with baseline commit e276b97 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 1739 metrics, 105 unstable metrics.

@juan-fernandez
Copy link
Copy Markdown
Collaborator

@codex review

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e32f79c21a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread packages/dd-trace/src/plugins/ci_plugin.js
Copy link
Copy Markdown
Collaborator

E2E Test Report: SUCCESS

Tested by: Shepherd Agent (autonomous QA for Datadog Test Optimization)

Test Environment

  • Method: Local E2E testing with Shepherd crook + mockdog
  • Playground: express (JavaScript, Mocha)
  • Command shape: ./bin/crook run express --command single --file test/app.all.js --dep dd-trace-js=sebas_conde/feat/error_tag_for_library_configuration_request --scenario <scenario> --debug
  • Revision tested: e32f79c21a344e734e4f376031dc0e15c7aab351

Results

Scenario Mockdog run Endpoint failure simulated Verification
Settings request error 20260508-115144 /api/v2/libraries/tests/services/setting returned 404 _dd.ci.library_configuration_error.settings=true present on session, module, suite, and test events
Skippable tests request error 20260508-115320 /api/v2/ci/tests/skippable returned 404 _dd.ci.library_configuration_error.skippable_tests=true present on session, module, suite, and test events
Known tests request error 20260508-115435 /api/v2/ci/libraries/tests returned 404 _dd.ci.library_configuration_error.known_tests=true present on session, module, suite, and test events
Test management tests request error 20260508-115549 /api/v2/test/libraries/test-management/tests returned 404 _dd.ci.library_configuration_error.test_management_tests=true present on session, module, suite, and test events

Each scenario emitted 20 CI test cycle events to mockdog: 2 tests, 1 suite, 1 module, and 1 session.

Issues Found

No product issues found. A local test-file selection mistake during setup was corrected before the reported runs; the reported scenarios all passed.

Verification

Verified locally against mockdog parsed CI Visibility payloads with bin/query-spans. Datadog UI verification was not performed because this run intentionally used a local mock backend to force backend configuration endpoint failures deterministically.

Test Methodology

  1. Created focused mockdog scenarios for each library configuration request failure path.
  2. Injected this PR branch into the Express/Mocha playground with --dep dd-trace-js=<branch>.
  3. Ran the same small Mocha file under each scenario with debug logging enabled.
  4. Confirmed each intended backend request failed with 404 in logs.
  5. Queried mockdog parsed spans and verified the expected hidden tag on test session, module, suite, and test events.

This E2E test was performed by Shepherd - autonomous QA agent for Datadog Test Optimization.

@juan-fernandez
Copy link
Copy Markdown
Collaborator

@codex review

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c67ae4d245

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread packages/dd-trace/src/plugins/util/test.js
cbasitodx and others added 3 commits May 8, 2026 16:33
…ed tests for checking error tags on every level (session, module, suite and test). Added error tag spreading at suite level on vitest and cypress
@cbasitodx
Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector
Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Can't wait for the next one!

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

@cbasitodx cbasitodx enabled auto-merge (squash) May 11, 2026 09:54
@cbasitodx cbasitodx merged commit e9eca79 into master May 11, 2026
938 of 939 checks passed
@cbasitodx cbasitodx deleted the sebas_conde/feat/error_tag_for_library_configuration_request branch May 11, 2026 10:22
@dd-octo-sts dd-octo-sts Bot mentioned this pull request May 12, 2026
rochdev pushed a commit that referenced this pull request May 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants