Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ci-visibility] Extract code coverage from cypress #3159

Merged
merged 8 commits into from
May 23, 2023

Conversation

juan-fernandez
Copy link
Collaborator

@juan-fernandez juan-fernandez commented May 16, 2023

What does this PR do?

If window.__coverage__ available from the test's context, it means that the web app has been instrumented with code coverage. If that's the case, we extract it.

Motivation

First step to making ITR usable with cypress.

@github-actions
Copy link

github-actions bot commented May 16, 2023

Overall package size

Self size: 4.16 MB
Deduped: 58.29 MB
No deduping: 58.33 MB

Dependency sizes

name version self size total size
@datadog/pprof 2.2.1 14.24 MB 15.12 MB
@datadog/native-iast-taint-tracking 1.4.1 14.85 MB 14.86 MB
@datadog/native-appsec 3.1.0 13.31 MB 13.32 MB
protobufjs 7.1.2 2.76 MB 6.55 MB
@datadog/native-iast-rewriter 2.0.1 2.09 MB 2.1 MB
@datadog/native-metrics 2.0.0 898.77 kB 1.3 MB
opentracing 0.14.7 194.81 kB 194.81 kB
semver 7.3.8 88.2 kB 118.6 kB
@datadog/sketches-js 2.1.0 109.9 kB 109.9 kB
lodash.sortby 4.7.0 75.76 kB 75.76 kB
lru-cache 7.14.0 74.95 kB 74.95 kB
ipaddr.js 2.0.1 59.52 kB 59.52 kB
ignore 5.2.0 48.87 kB 48.87 kB
import-in-the-middle 1.3.5 34.34 kB 38.81 kB
istanbul-lib-coverage 3.2.0 29.34 kB 29.34 kB
retry 0.10.1 27.44 kB 27.44 kB
lodash.uniq 4.5.0 25.01 kB 25.01 kB
limiter 1.1.5 23.17 kB 23.17 kB
lodash.kebabcase 4.1.1 17.75 kB 17.75 kB
lodash.pick 4.4.0 16.33 kB 16.33 kB
node-abort-controller 3.0.1 14.33 kB 14.33 kB
crypto-randomuuid 1.0.0 11.18 kB 11.18 kB
diagnostics_channel 1.1.0 7.07 kB 7.07 kB
path-to-regexp 0.1.7 6.78 kB 6.78 kB
koalas 1.0.2 6.47 kB 6.47 kB
methods 1.1.2 5.29 kB 5.29 kB
module-details-from-path 1.0.3 4.47 kB 4.47 kB

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@codecov
Copy link

codecov bot commented May 16, 2023

Codecov Report

Merging #3159 (dddebc7) into master (3428a1f) will decrease coverage by 0.31%.
The diff coverage is 61.53%.

@@            Coverage Diff             @@
##           master    #3159      +/-   ##
==========================================
- Coverage   86.95%   86.64%   -0.31%     
==========================================
  Files         322      328       +6     
  Lines       11763    11866     +103     
  Branches       33       33              
==========================================
+ Hits        10228    10281      +53     
- Misses       1535     1585      +50     
Impacted Files Coverage Δ
packages/datadog-plugin-cucumber/src/index.js 0.00% <ø> (ø)
packages/datadog-plugin-jest/src/index.js 76.54% <0.00%> (-0.96%) ⬇️
packages/datadog-plugin-mocha/src/index.js 0.00% <0.00%> (ø)
packages/datadog-plugin-cypress/src/plugin.js 82.24% <50.00%> (-6.06%) ⬇️
...ages/dd-trace/src/encode/coverage-ci-visibility.js 100.00% <100.00%> (ø)

... and 30 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@pr-commenter
Copy link

pr-commenter bot commented May 17, 2023

Benchmarks

Comparing candidate commit dddebc7 in PR branch juan-fernandez/extra-coverage-from-cypress with baseline commit 3428a1f in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 440 metrics, 32 unstable metrics.

@juan-fernandez juan-fernandez force-pushed the juan-fernandez/extra-coverage-from-cypress branch from 155908b to 566fa65 Compare May 17, 2023 10:51
@juan-fernandez juan-fernandez marked this pull request as ready for review May 17, 2023 11:01
@juan-fernandez juan-fernandez requested a review from a team as a code owner May 17, 2023 11:01
@juan-fernandez
Copy link
Collaborator Author

I'm moving this back to draft because I found an important bug

@juan-fernandez juan-fernandez marked this pull request as draft May 18, 2023 10:16
@juan-fernandez juan-fernandez force-pushed the juan-fernandez/extra-coverage-from-cypress branch from 567cc36 to eaac6b5 Compare May 18, 2023 10:49
traceId: this.testSuiteSpan.context()._traceId,
spanId: this.testSuiteSpan.context()._spanId,
sessionId: this.testSuiteSpan.context()._traceId,
suiteId: this.testSuiteSpan.context()._spanId,
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unrelated fix: these names make more sense, given that that's what we end up encoding

@juan-fernandez
Copy link
Collaborator Author

I'm moving this back to draft because I found an important bug

ok that should be fixed

@juan-fernandez juan-fernandez marked this pull request as ready for review May 18, 2023 11:51
const coverageFiles = getCoveredFilenamesFromCoverage(coverage)
const relativeCoverageFiles = coverageFiles.map(file => getTestSuitePath(file, rootDir))
const formattedCoverage = {
sessionId: testSuiteSpan.context()._traceId,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no need to call .context() twice no ?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also in jest and mocha

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

everytime i use both spanId and traceId i usually "cache" the span context

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

true. Will change that

simon-id
simon-id previously approved these changes May 22, 2023
uurien
uurien previously approved these changes May 22, 2023
integration-tests/cypress/cypress.spec.js Show resolved Hide resolved
Co-authored-by: Ugaitz Urien <ugaitz.urien@datadoghq.com>
@juan-fernandez juan-fernandez merged commit ca96946 into master May 23, 2023
104 checks passed
@juan-fernandez juan-fernandez deleted the juan-fernandez/extra-coverage-from-cypress branch May 23, 2023 07:19
thedavl pushed a commit that referenced this pull request May 30, 2023

Co-authored-by: Ugaitz Urien <ugaitz.urien@datadoghq.com>
uurien added a commit that referenced this pull request Jun 1, 2023

Co-authored-by: Ugaitz Urien <ugaitz.urien@datadoghq.com>
uurien added a commit that referenced this pull request Jun 1, 2023

Co-authored-by: Ugaitz Urien <ugaitz.urien@datadoghq.com>
uurien added a commit that referenced this pull request Jun 1, 2023

Co-authored-by: Ugaitz Urien <ugaitz.urien@datadoghq.com>
This was referenced Jun 1, 2023
uurien added a commit that referenced this pull request Jun 2, 2023

Co-authored-by: Ugaitz Urien <ugaitz.urien@datadoghq.com>
uurien added a commit that referenced this pull request Jun 2, 2023

Co-authored-by: Ugaitz Urien <ugaitz.urien@datadoghq.com>
uurien added a commit that referenced this pull request Jun 2, 2023

Co-authored-by: Ugaitz Urien <ugaitz.urien@datadoghq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants