Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tests/full: Measure coverage #1215

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

tests/full: Measure coverage #1215

wants to merge 1 commit into from

Conversation

lukaszachy
Copy link
Collaborator

Running in Beaker as TJ#6665529
Lets see how it behaves there (it produced expected output on my local exec as cd tests/full; tmt run)

@lukaszachy lukaszachy force-pushed the lzachar-tests-full-coverage branch from 13718e3 to afd4ea3 Compare May 30, 2022 10:49
@lukaszachy
Copy link
Collaborator Author

lukaszachy commented May 30, 2022 •
edited
Loading

Okay, it is important to install rpm first before using it for rpm -ql call.

Trying now in TJ#6669945

@lukaszachy lukaszachy force-pushed the lzachar-tests-full-coverage branch from afd4ea3 to 2721e94 Compare May 30, 2022 16:59
@lukaszachy lukaszachy mentioned this pull request Jun 6, 2022
Merged
@lukaszachy lukaszachy force-pushed the lzachar-tests-full-coverage branch from 2721e94 to 73c7106 Compare June 6, 2022 18:07
@lukaszachy lukaszachy force-pushed the lzachar-tests-full-coverage branch 2 times, most recently from 00d9033 to a589b40 Compare June 14, 2022 13:14
@lukaszachy
Option to measure test coverage in tests/full
0417587 
Set 'COVERAGE=1' and later check the submitted html report or output log
@lukaszachy
Copy link
Collaborator Author

Completely reworked, trying again.

@lukaszachy
Copy link
Collaborator Author

TJ#7764179

@lukaszachy
Copy link
Collaborator Author

Not bad.

                    Name                                                                 Stmts   Miss  Cover
                    ----------------------------------------------------------------------------------------
                    /usr/lib/python3.11/site-packages/tmt/__init__.py                        6      0   100%
                    /usr/lib/python3.11/site-packages/tmt/__main__.py                        2      2     0%
                    /usr/lib/python3.11/site-packages/tmt/base.py                         1531    117    92%
                    /usr/lib/python3.11/site-packages/tmt/beakerlib.py                     182     23    87%
                    /usr/lib/python3.11/site-packages/tmt/cli.py                           643     70    89%
                    /usr/lib/python3.11/site-packages/tmt/convert.py                       698    180    74%
                    /usr/lib/python3.11/site-packages/tmt/export/__init__.py               181     26    86%
                    /usr/lib/python3.11/site-packages/tmt/export/_dict.py                   24      2    92%
                    /usr/lib/python3.11/site-packages/tmt/export/nitrate.py                409    112    73%
                    /usr/lib/python3.11/site-packages/tmt/export/polarion.py               216    187    13%
                    /usr/lib/python3.11/site-packages/tmt/export/rst.py                     13      0   100%
                    /usr/lib/python3.11/site-packages/tmt/export/template.py                22      3    86%
                    /usr/lib/python3.11/site-packages/tmt/export/yaml.py                    24      0   100%
                    /usr/lib/python3.11/site-packages/tmt/identifier.py                     39      5    87%
                    /usr/lib/python3.11/site-packages/tmt/log.py                           236     19    92%
                    /usr/lib/python3.11/site-packages/tmt/options.py                        93     20    78%
                    /usr/lib/python3.11/site-packages/tmt/plugins/__init__.py               74      3    96%
                    /usr/lib/python3.11/site-packages/tmt/result.py                        127      7    94%
                    /usr/lib/python3.11/site-packages/tmt/steps/__init__.py                530     36    93%
                    /usr/lib/python3.11/site-packages/tmt/steps/discover/__init__.py       146      8    95%
                    /usr/lib/python3.11/site-packages/tmt/steps/discover/fmf.py            246     18    93%
                    /usr/lib/python3.11/site-packages/tmt/steps/discover/shell.py          128     11    91%
                    /usr/lib/python3.11/site-packages/tmt/steps/execute/__init__.py        248     13    95%
                    /usr/lib/python3.11/site-packages/tmt/steps/execute/internal.py        227     22    90%
                    /usr/lib/python3.11/site-packages/tmt/steps/execute/upgrade.py         133      7    95%
                    /usr/lib/python3.11/site-packages/tmt/steps/finish/__init__.py          72      2    97%
                    /usr/lib/python3.11/site-packages/tmt/steps/finish/ansible.py            8      0   100%
                    /usr/lib/python3.11/site-packages/tmt/steps/finish/shell.py             37      3    92%
                    /usr/lib/python3.11/site-packages/tmt/steps/prepare/__init__.py        117      4    97%
                    /usr/lib/python3.11/site-packages/tmt/steps/prepare/ansible.py          53      3    94%
                    /usr/lib/python3.11/site-packages/tmt/steps/prepare/install.py         278     60    78%
                    /usr/lib/python3.11/site-packages/tmt/steps/prepare/multihost.py        25      0   100%
                    /usr/lib/python3.11/site-packages/tmt/steps/prepare/shell.py            37      3    92%
                    /usr/lib/python3.11/site-packages/tmt/steps/provision/__init__.py      557     85    85%
                    /usr/lib/python3.11/site-packages/tmt/steps/provision/artemis.py       185     91    51%
                    /usr/lib/python3.11/site-packages/tmt/steps/provision/connect.py        53      6    89%
                    /usr/lib/python3.11/site-packages/tmt/steps/provision/local.py          49      2    96%
                    /usr/lib/python3.11/site-packages/tmt/steps/provision/mrack.py         270    180    33%
                    /usr/lib/python3.11/site-packages/tmt/steps/provision/podman.py        132      3    98%
                    /usr/lib/python3.11/site-packages/tmt/steps/provision/testcloud.py     286     57    80%
                    /usr/lib/python3.11/site-packages/tmt/steps/report/__init__.py          54      6    89%
                    /usr/lib/python3.11/site-packages/tmt/steps/report/display.py           36      0   100%
                    /usr/lib/python3.11/site-packages/tmt/steps/report/html.py              56      9    84%
                    /usr/lib/python3.11/site-packages/tmt/steps/report/junit.py             72      7    90%
                    /usr/lib/python3.11/site-packages/tmt/steps/report/polarion.py          84     53    37%
                    /usr/lib/python3.11/site-packages/tmt/steps/report/reportportal.py      63     42    33%
                    /usr/lib/python3.11/site-packages/tmt/templates.py                      19      0   100%
                    /usr/lib/python3.11/site-packages/tmt/utils.py                        1668    192    88%
                    ----------------------------------------------------------------------------------------
                    TOTAL                                                                10389   1699    84%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@psss psss Awaiting requested review from psss psss will be requested when the pull request is marked ready for review psss is a code owner

@happz happz Awaiting requested review from happz happz will be requested when the pull request is marked ready for review happz is a code owner

@thrix thrix Awaiting requested review from thrix thrix will be requested when the pull request is marked ready for review thrix is a code owner

@janhavlin janhavlin Awaiting requested review from janhavlin janhavlin will be requested when the pull request is marked ready for review janhavlin is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@lukaszachy