feat: new experience to get coverage report #1785

AkashKumar7902 · 2024-04-06T13:32:06Z

Related Issue

Closes: #1735

Describe the changes you've made

Add coverage data to test report
coverage data will be appended for applications written in:

golang
node
python
java

Type of change

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds functionality)
Code style update (formatting, local variables)
Breaking change (fix or feature that would cause existing functionality to not work as expected)
This change requires a documentation update

Please let us know if any test cases are added

Please describe the tests(if any). Provide instructions how its affecting the coverage.

Describe if there is any unusual behaviour of your code(Write `NA` if there isn't)

A clear and concise description of it.

Checklist:

My code follows the style guidelines of this project.
I have performed a self-review of my own code.
I have commented my code, particularly in hard-to-understand areas.
I have made corresponding changes to the documentation.
My changes generate no new warnings.
I have added tests that prove my fix is effective or that my feature works.
New and existing unit tests pass locally with my changes.

Screenshots (if any)

Original	Updated
original screenshot	updated screenshot

* solved halting execution due to keploy config error Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * solved halting execution due to errors in keploy-config Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * solved halting execution due to errors in keploy-config Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * implemented passthrough in postgres parser Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * added continue Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * removed unnecessary packages Signed-off-by: EraKin575 <tejaskumar574@gmail.com> --------- Signed-off-by: EraKin575 <tejaskumar574@gmail.com> Co-authored-by: Sarthak Shyngle <50234097+Sarthak160@users.noreply.github.com>

* fix: runs the commands using the -c flag of sh the sh shell provides a flag to run multiple commands from a single shell cmd. So using this we will be able to use the parsing of script cmds of shell Signed-off-by: re-Tick <jain.ritik.1001@gmail.com> --------- Signed-off-by: re-Tick <jain.ritik.1001@gmail.com>

* fix: remove binary match Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: add in memoryDb in test mode Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: merge conflicts Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: add binary matching with benchmark Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove mongo changes Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove print statements Signed-off-by: charankamarapu <kamarapucharan@gmail.com> --------- Signed-off-by: charankamarapu <kamarapucharan@gmail.com>

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

Signed-off-by: charankamarapu <kamarapucharan@gmail.com>

…y#1300) * add coverage flag to implement serve Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * removed serve.go and moved functionality to test Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * changed workflow according to new changes Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * changed workflow according to new changes Signed-off-by: EraKin575 <tejaskumar574@gmail.com> --------- Signed-off-by: EraKin575 <tejaskumar574@gmail.com>

* fix: updates the decode function for OpMsg section the decode function is not able to distinguish the closing braces of the string json and sectionSingle, so used the prefix and suffix in place of regex to extract the document correctly Signed-off-by: re-Tick <jain.ritik.1001@gmail.com>

* refactor: provide some null checks in pg parser Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> * refactor: provide some null checks Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> * refactor: change log object to zap logger Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> --------- Signed-off-by: Sarthak160 <rocksarthak45@gmail.com>

keploy#1300)" (keploy#1319) This reverts commit 013e6e2. Co-authored-by: Sarthak Shyngle <50234097+Sarthak160@users.noreply.github.com>

Signed-off-by: charankamarapu <kamarapucharan@gmail.com>

…adability (keploy#1276) * ‘look by kind’changes in mysql Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * base64 encoding-decoding for some packet Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * refactor(mysqlparser): change binary lists in mysql mocks to base64 strings for readability change binary lists in mysql mocks to base64 strings for readability and add a function to filter out the firstSQL mock for handshake Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * fix: run cmd using the shell's -c flag (keploy#1273) * fix: runs the commands using the -c flag of sh the sh shell provides a flag to run multiple commands from a single shell cmd. So using this we will be able to use the parsing of script cmds of shell Signed-off-by: re-Tick <jain.ritik.1001@gmail.com> --------- Signed-off-by: re-Tick <jain.ritik.1001@gmail.com> Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * fix: unexpected behaviour with multiple dependencies (keploy#1214) * fix: remove binary match Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: add in memoryDb in test mode Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: merge conflicts Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: add binary matching with benchmark Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove mongo changes Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove print statements Signed-off-by: charankamarapu <kamarapucharan@gmail.com> --------- Signed-off-by: charankamarapu <kamarapucharan@gmail.com> Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * ‘look by kind’changes in mysql Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * refactor(mysql parser related files): add omitempty,flow to json,yaml tags in MYSQL add omitempty,flow to json,yaml tags in MYSQL Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * fix: unexpected behaviour with multiple dependencies (keploy#1214) * fix: remove binary match Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: add in memoryDb in test mode Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: merge conflicts Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: add binary matching with benchmark Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove mongo changes Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove print statements Signed-off-by: charankamarapu <kamarapucharan@gmail.com> --------- Signed-off-by: charankamarapu <kamarapucharan@gmail.com> Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * fix: fixed typo of word gracefully (keploy#1299) Signed-off-by: Asish Kumar <officialasishkumar@gmail.com> Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> * fix: generic bug (keploy#1297) Signed-off-by: charankamarapu <kamarapucharan@gmail.com> Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> --------- Signed-off-by: Hermione Dadheech <hermionedadheech@gmail.com> Signed-off-by: re-Tick <jain.ritik.1001@gmail.com> Signed-off-by: charankamarapu <kamarapucharan@gmail.com> Signed-off-by: Asish Kumar <officialasishkumar@gmail.com> Co-authored-by: Ritik Jain <60597329+re-Tick@users.noreply.github.com> Co-authored-by: Charan Kamarapu <kamarapucharan@gmail.com> Co-authored-by: Asish Kumar <87874775+officialasishkumar@users.noreply.github.com> Co-authored-by: Sarthak Shyngle <50234097+Sarthak160@users.noreply.github.com>

Co-authored-by: Neha Gupta <gneha21@yahoo.in>

keploy#1341) * feat(pg-parser): ignore deletion of startup request mocks during match Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> * refactor: improve debug logs Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> --------- Signed-off-by: Sarthak160 <rocksarthak45@gmail.com>

* fix: refactor mock filtering and sorting logic * fix: change postgres mocks to config from tcs * refactor: save different mock names in yaml Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> * refactor: made some code change Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> * refactor: improve logging incase of no timestamp found Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> --------- Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> Co-authored-by: slayerjain <shubhamkjain@outlook.com>

Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> Co-authored-by: Shubham Jain <shubhamkjain@outlook.com>

Signed-off-by: charankamarapu <kamarapucharan@gmail.com> Co-authored-by: Shubham Jain <shubhamkjain@outlook.com>

* fix: HTTP handling for partial header reception Signed-off-by: gouravkrosx <gouravgreatkr@gmail.com> * fix: multiple content-length of http response in mocks * bug: add nil check for destConn in test mode Signed-off-by: gouravkrosx <gouravgreatkr@gmail.com> * enhanced: saving http mock in separate goroutine Signed-off-by: gouravkrosx <gouravgreatkr@gmail.com> --------- Signed-off-by: gouravkrosx <gouravgreatkr@gmail.com>

* chore: logging an example when generate-config fails Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com> * refactor: removed unnecessary changes in mod files Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com> * refactor: removed unnecessary files Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com> --------- Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com>

* fix: generalize test-set name Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: error in mongo Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: add logs Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: if condition Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove print statements Signed-off-by: charankamarapu <kamarapucharan@gmail.com> --------- Signed-off-by: charankamarapu <kamarapucharan@gmail.com> Co-authored-by: Shubham Jain <shubhamkjain@outlook.com> Co-authored-by: Pranshu Srivastava <37413698+PranshuSrivastava@users.noreply.github.com>

* fix: matching logic Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: change boolean Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: limit unfiltered mocks to 10 Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove go-memdb Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: remove mock limit Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: append Id Signed-off-by: charankamarapu <kamarapucharan@gmail.com> * fix: postgres matching bug Signed-off-by: charankamarapu <kamarapucharan@gmail.com> --------- Signed-off-by: charankamarapu <kamarapucharan@gmail.com> Co-authored-by: Shubham Jain <shubhamkjain@outlook.com>

Signed-off-by: slayerjain <shubhamkjain@outlook.com>

…#1407) * fix: empty req in case of multiple chunk resp Signed-off-by: slayerjain <shubhamkjain@outlook.com> * fix: missing requests and their timestamps (keploy#1405) Signed-off-by: gouravkrosx <gouravgreatkr@gmail.com> * chore: add ebpf objects for amd64 * fix: set conn tracker processing event loop to 100ms Signed-off-by: slayerjain <shubhamkjain@outlook.com> --------- Signed-off-by: slayerjain <shubhamkjain@outlook.com> Signed-off-by: gouravkrosx <gouravgreatkr@gmail.com> Co-authored-by: Gourav kumar <44055698+gouravkrosx@users.noreply.github.com>

* feat: updated file structure for test reports Signed-off-by: EraKin575 <tejaskumar574@gmail.com> --------- Signed-off-by: EraKin575 <tejaskumar574@gmail.com> Co-authored-by: Ritik Jain <60597329+re-Tick@users.noreply.github.com>

…y#1366) * feat(command) : test return non-zero exit code Signed-off-by: seipan <yamasakipann0218@gmail.com> * fix : remove log & use os.Exit() Signed-off-by: seipan <yamasakipann0218@gmail.com> --------- Signed-off-by: seipan <yamasakipann0218@gmail.com> Co-authored-by: Ritik Jain <60597329+re-Tick@users.noreply.github.com>

Signed-off-by: Shubham Jain <shubhamkjain@outlook.com>

* updated file structure for test reports Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * updated file structure for test reports Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * updated file structure for test reports Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * updated file structure for test reports Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * updated file structure for test reports Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * updated file structure for test reports Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * resolving conflicts Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * Revert "Merge branch 'coverage'" This reverts commit b310711, reversing changes made to 51f0457. * updated PR Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * updated PR Signed-off-by: EraKin575 <tejaskumar574@gmail.com> --------- Signed-off-by: EraKin575 <tejaskumar574@gmail.com>

…#1432) * fixed workflows and removed serve package Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed workflows and removed serve package Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed workflows Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed workflows Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * fixed java workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * changed java workflows Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * changed docker container name in workflows Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * changed docker container name in workflows Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * changed docker container name in workflows Signed-off-by: EraKin575 <tejaskumar574@gmail.com> * changed python workflow Signed-off-by: EraKin575 <tejaskumar574@gmail.com> --------- Signed-off-by: EraKin575 <tejaskumar574@gmail.com>

* fixed unknown path problem in docker Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com> * added changes to the test mode as well Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com> * fix: made changes according to the comments Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com> * fix: build errors Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com> --------- Signed-off-by: Pranshu Srivastava <iampranshu24@gmail.com> Co-authored-by: Gourav kumar <44055698+gouravkrosx@users.noreply.github.com>

slayerjain

This looks awesome but it's a big change.

I think we should create a coverage package which hosts most of the logic related to coverage parsing, calculation, etc.

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

we can't preprocess in case of commandtype as docker because preprocess appends language specific coverage executable to the command provided and the command provided by the user in case of docker would start with "docker", so we don't want to append it in provided command rather we want to append it in the command to run in the docker container which can be extracted through docker client. but this approach is not good as after modifying the docker internal command we need to restart the container, that's why we are taking a different approach in which users have to edit their application command in dockerfile so preprocess won't happen from our end. Signed-off-by: Akash Kumar <meakash7902@gmail.com>

To support running `coverage json` command internally in keploy's docker, we need to install coveragepy Signed-off-by: Akash Kumar <meakash7902@gmail.com>

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

charankamarapu

LGTM

merge required

EraKin575 and others added 30 commits December 28, 2023 17:14

fix: fixed typo of word gracefully (keploy#1299)

5c9151c

Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>

fix: generic bug (keploy#1297)

c0cadfe

Signed-off-by: charankamarapu <kamarapucharan@gmail.com>

Revert " feat: add coverage flag to implement serve within test itself (

3b54e80

keploy#1300)" (keploy#1319) This reverts commit 013e6e2. Co-authored-by: Sarthak Shyngle <50234097+Sarthak160@users.noreply.github.com>

fix: mongo read function (keploy#1321)

5e5d821

Signed-off-by: charankamarapu <kamarapucharan@gmail.com>

refactor: readme (keploy#1330)

a6f4dda

Co-authored-by: Neha Gupta <gneha21@yahoo.in>

fix: add support for v1beta2 and old postgres mocks (keploy#1357)

194fa1e

fix: handle errors in console diff library (keploy#1375)

891acda

feat: make priority based fuzzy match for config mocks (keploy#1373)

c13d99e

Signed-off-by: Sarthak160 <rocksarthak45@gmail.com> Co-authored-by: Shubham Jain <shubhamkjain@outlook.com>

fix: allow setting custom test-set folder names (keploy#1379)

179a315

Signed-off-by: charankamarapu <kamarapucharan@gmail.com> Co-authored-by: Shubham Jain <shubhamkjain@outlook.com>

fix: race conditions in tele methods (keploy#1403)

ada087f

Signed-off-by: slayerjain <shubhamkjain@outlook.com>

chore: add url metadata to logs in the http parser (keploy#1428)

51f0457

Signed-off-by: Shubham Jain <shubhamkjain@outlook.com>

slayerjain previously requested changes Jun 18, 2024

View reviewed changes

AkashKumar7902 added 6 commits June 18, 2024 23:39

refactor: shift coverage logic to a standalone package

cdebb70

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

fix lint issue

d20ab09

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

fix coverage not getting calculated

dc78e86

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

fix jacoco merge issue when test set is of different name than default

90857d1

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

revert permission of go.sum

ad0c74e

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

fix linter issue

fd63c98

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

AkashKumar7902 force-pushed the add-coverage-data-to-report branch from 14e175d to fd63c98 Compare June 19, 2024 06:21

AkashKumar7902 and others added 4 commits June 24, 2024 17:40

Merge branch 'main' into add-coverage-data-to-report

a0b4944

refactor: create coverage package

fd074f3

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

fix minor bugs

989319a

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

Merge branch 'main' into add-coverage-data-to-report

90582cf

AkashKumar7902 force-pushed the add-coverage-data-to-report branch 3 times, most recently from 1babc7b to 7929af8 Compare July 1, 2024 09:36

Merge branch 'main' into add-coverage-data-to-report

8de4dc4

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

AkashKumar7902 force-pushed the add-coverage-data-to-report branch from 7929af8 to 8de4dc4 Compare July 2, 2024 07:41

AkashKumar7902 and others added 4 commits July 2, 2024 15:11

dockerfile: install python's coverage tool

c28bdcb

To support running `coverage json` command internally in keploy's docker, we need to install coveragepy Signed-off-by: Akash Kumar <meakash7902@gmail.com>

fix: apply check in case of docker and skipcoverage

58416f5

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

Merge branch 'main' into add-coverage-data-to-report

e3f2086

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

AkashKumar7902 force-pushed the add-coverage-data-to-report branch from 268609f to e3f2086 Compare July 3, 2024 08:44

fix golint issue

0fc3dbe

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

AkashKumar7902 force-pushed the add-coverage-data-to-report branch from b6c9237 to 0fc3dbe Compare July 3, 2024 09:16

remove coveragepy installation from dockerfile

795d207

Signed-off-by: Akash Kumar <meakash7902@gmail.com>

charankamarapu self-requested a review July 3, 2024 09:35

charankamarapu approved these changes Jul 3, 2024

View reviewed changes

charankamarapu merged commit d28ef53 into keploy:main Jul 3, 2024
19 checks passed

github-actions bot locked and limited conversation to collaborators Jul 3, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: new experience to get coverage report #1785

feat: new experience to get coverage report #1785

AkashKumar7902 commented Apr 6, 2024 •

edited

Loading

slayerjain left a comment

charankamarapu left a comment

feat: new experience to get coverage report #1785

feat: new experience to get coverage report #1785

Conversation

AkashKumar7902 commented Apr 6, 2024 • edited Loading

Related Issue

Describe the changes you've made

Type of change

Please let us know if any test cases are added

Describe if there is any unusual behaviour of your code(Write NA if there isn't)

Checklist:

Screenshots (if any)

slayerjain left a comment

Choose a reason for hiding this comment

charankamarapu left a comment

Choose a reason for hiding this comment

AkashKumar7902 commented Apr 6, 2024 •

edited

Loading

Describe if there is any unusual behaviour of your code(Write `NA` if there isn't)