Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

orphaned_packages_check: Convert to automatic test failing on any orphans #9148

Merged
merged 2 commits into from
Dec 17, 2019

Conversation

okurz
Copy link
Member

@okurz okurz commented Dec 12, 2019

In fully supported systems there should be no orphaned packages.
Exceptions can still be introduced with record_soft_failure.

Verification runs:

openqa-clone-custom-git-refspec https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9148 https://openqa.suse.de/tests/3687791,https://openqa.suse.de/tests/3694570,https://openqa.suse.de/tests/3688460,https://openqa.suse.de/tests/3687327,https://openqa.suse.de/tests/3687480,https://openqa.suse.de/tests/3688112,https://openqa.suse.de/tests/3688119,https://openqa.suse.de/tests/3687934,https://openqa.suse.de/tests/3695950,https://openqa.suse.de/tests/3695955,https://openqa.suse.de/tests/3695908,https://openqa.suse.de/tests/3695910,https://openqa.suse.de/tests/3696347,https://openqa.suse.de/tests/3696150,https://openqa.suse.de/tests/3691124,https://openqa.suse.de/tests/3575719,https://openqa.opensuse.org/tests/1109703,https://openqa.opensuse.org/tests/1109721,https://openqa.opensuse.org/tests/1110774,https://openqa.opensuse.org/tests/1110773,https://openqa.opensuse.org/tests/1110605,https://openqa.opensuse.org/tests/1110641 EXCLUDE_MODULES=soundtouch,suse_module_tools,check_os_release

Related progress issue: https://progress.opensuse.org/issues/47333

@okurz okurz changed the title orphaned_packages_check: Convert to automatic test failing on any orphans [WIP] orphaned_packages_check: Convert to automatic test failing on any orphans Dec 12, 2019
@okurz okurz force-pushed the feature/orphans branch 8 times, most recently from c65157b to ed98f4e Compare December 13, 2019 11:50
@okurz okurz changed the title [WIP] orphaned_packages_check: Convert to automatic test failing on any orphans orphaned_packages_check: Convert to automatic test failing on any orphans Dec 13, 2019
@schlad
Copy link
Contributor

schlad commented Dec 17, 2019

Let me start from the basics and try to employ the good and efficient practices of reviews as I know them.

While this is sane on it's own and a good idea overall, it touches main.pm flow and as such might be fairly disruptive to many tests used in various runs. For this reason, could you provide more verbose git commit message please?

There is a problem in the git commit subject line length. Could you correct it please?

Only after the formal improvements of your commits, I will look into the code.

As proposed also by QA SLE PrjM we should check for orphaned packages in
more products. This commit is adding the existing test module
"orphaned_packages_check" in more test schedule flows, e.g. as part of
zdup upgrade tests whereas previously it was used only in "upgrade"
cases, e.g. medium based. Also adding this to more generic
extra_tests_console as especially in installation-based scenarios there
should be no unexpected orphan packages.

Related progress issue: https://progress.opensuse.org/issues/47336
In fully supported systems there should be no orphaned packages.
Exceptions can still be introduced with `record_soft_failure`.

This change had also been suggested by SUSE QA SLE PrjM to have a proper
automatic check rather than a list of orphan packages that would need to
be checked manually.

The test can still be instructed to not fail the test module by setting the
test variable "ZYPPER_ORPHANED_CHECK_ONLY" to a true-value. Exceptions
can be added to the according ignore-string.

Related progress issue: https://progress.opensuse.org/issues/47333
@okurz
Copy link
Member Author

okurz commented Dec 17, 2019

@schlad thx for review, updated git commit message.

As you can see from the list of verification runs I know where this module is used and have triggered according tests, e.g. many QAM ones.

@schlad
Copy link
Contributor

schlad commented Dec 17, 2019

All looks good. +2
@mimi1vx I'm merging this so please be aware as it affects qam run.

@schlad schlad merged commit 27f865c into os-autoinst:master Dec 17, 2019
@DimStar77
Copy link
Contributor

@okurz okurz deleted the feature/orphans branch December 17, 2019 15:47
@okurz
Copy link
Member Author

okurz commented Dec 17, 2019

@DimStar77 interesting. So packages that are specific to the live medium are already orphaned. So should we ignore "openSUSE-release" completely as well as "skelcd"?

@okurz
Copy link
Member Author

okurz commented Dec 17, 2019

@DimStar77 see #9186 for a fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants