[POC] [WIP] IPU 9 -> 10: Initial preparation: upgrade paths and leapp packages def #1169

pirat89 · 2024-01-23T09:42:41Z

Introducing initial changes needed for IPU 9 -> 10 to prevent abouvious crashes and inhibitors:

extend the list of supported source versions for the upgrade by el9
define upgrade paths for IPU 9 -> 10
define packages for RHEL 9 to prevent instant crashing of get_leapp_packages and get_leapp_dep_packages
- note this could be still changed as the list of packages we will want in el 10 is not defined yet

TODO (required bare minimum changes for the IPU 9 -> 10):

github-actions · 2024-01-23T09:42:53Z

Thank you for contributing to the Leapp project!

Please note that every PR needs to comply with the Leapp Guidelines and must pass all tests in order to be mergeable.
If you want to request a review or rebuild a package in copr, you can use following commands as a comment:

review please @oamg/developers to notify leapp developers of the review request
/packit copr-build to submit a public copr build using packit

Packit will automatically schedule regression tests for this PR's build and latest upstream leapp build. If you need a different version of leapp from PR#42, use /packit test oamg/leapp#42

It is possible to schedule specific on-demand tests as well. Currently 2 test sets are supported, beaker-minimal and kernel-rt, both can be used to be run on all upgrade paths or just a couple of specific ones.
To launch on-demand tests with packit:

/packit test --labels kernel-rt to schedule kernel-rt tests set for all upgrade paths
/packit test --labels beaker-minimal-8.9to9.3,kernel-rt-8.9to9.3 to schedule kernel-rt and beaker-minimal test sets for 8.9->9.3 upgrade path

[Deprecated] To launch on-demand regression testing public members of oamg organization can leave the following comment:

/rerun to schedule basic regression tests using this pr build and latest upstream leapp build as artifacts
/rerun 42 to schedule basic regression tests using this pr build and leapp*PR42* as artifacts
/rerun-sst to schedule sst tests using this pr build and latest upstream leapp build as artifacts
/rerun-sst 42 to schedule sst tests using this pr build and leapp*PR42* as artifacts

Please open ticket in case you experience technical problem with the CI. (RH internal only)

Note: In case there are problems with tests not being triggered automatically on new PR/commit or pending for a long time, please contact leapp-infra.

fernflower · 2024-01-23T09:57:08Z

repos/system_upgrade/common/libraries/rpms.py

                                     },
        LeappComponents.COCKPIT: {'7': {'pkgs': ['cockpit-leapp']},
-                                  '8': {'pkgs': ['cockpit-leapp']}
+                                  '8': {'pkgs': ['cockpit-leapp']},
+                                  '9': {'pkgs': ['']}


Why [''] and not an empty list?

good point, empty list is definitely expected. no idea why I put empty string inside /o\

fernflower · 2024-01-23T09:58:11Z

repos/system_upgrade/common/files/upgrade_paths.json

        "7": ["8.6", "8.8", "8.9", "8.10"],
-        "8": ["9.0", "9.2", "9.3", "9.4"]
+        "8": ["9.0", "9.2", "9.3", "9.4"],
+        "9": ["10.0"]


I'd say for each new upgrade path we should add a packit test. And ideally this should be done in this commit.

you are right. Q is whether it will need some additional tweaks regarding major upgrade path change (sometimes it could include some specific infra changes). we should check that later. but with minor update paths we should start doing that definitely in this way.

pirat89 · 2024-04-02T17:56:14Z

/packit copr-build

Introducing initial changes needed for IPU 9 -> 10 to prevent abouvious crashes and inhibitors: * extend the list of supported source versions for the upgrade by el9 * define upgrade paths for IPU 9 -> 10 TODO: * add RHEL 10 product certificates * add RHEL 10 GPG keys * Introducing el9toel10 repository created .gitkeep files inside empty dirs

TODO: - update commit msg - still incomplete - update Makefile Partially updated Makefile

TODO: * add certs for other architectures too

…ddrivers actor Currently we do not have yet data here for RHEL 10 HW, so dropping the actor for now. This cannot commit must be removed BEFORE the merge in upstream.

…kages def Enable upgrade from RHEL 9.4 & 9.5 to RHEL 10.0 for now. For the experiment purposes. These will not be supported for the upgrade at all, but to make testing and experimentations easier, allow it for now.

* TODO: this is just experimental, copied value from IPU 8 -> 9 to pass the execution without traceback. Check what should be really set inside.

Temporarily disabled, not sure now why. The commit will be for sure changed or dropped before the merge.

The tool file is fine but we need to create a separate actor for this

Set common python deps + builds-deps for RHEL 8+. Previosly, build deps have been set just for RHEL 8, not for RHEL 9, so we could not create *pyc files for RHEL 9 builds due to missing macros.

OAMG-10976

Until RHELBLD-15138 is resolved

They are not owned by any package and can dynamically grow to a huge amount of files causing hitting open files limit

"util-linux" package is not brought in as a dependency anymore and we are missing "/usr/bin/su"

The issue was fixed.

Rezney · 2024-06-11T17:24:20Z

/packit copr-build

fernflower reviewed Jan 23, 2024

View reviewed changes

pirat89 force-pushed the poc-ipu-9-10 branch from 6b722d6 to 905a922 Compare April 2, 2024 17:50

Rezney force-pushed the poc-ipu-9-10 branch 2 times, most recently from 9c512d4 to 1e42b2b Compare April 12, 2024 21:41

pirat89 added 11 commits April 19, 2024 14:50

Packaging: Introduce builds for EL 9 for IPU 9 -> 10

edf5b5a

TODO: - update commit msg - still incomplete - update Makefile Partially updated Makefile

Packit: add epel-9-x86_64 buildroot

cae49c7

IPU 9 -> 10: Add RHEL 10 certs (intel only now)

0cb75c8

TODO: * add certs for other architectures too

DROP_COMMIT_BEFORE_MERGE: temporarily removing checkdetecteddevicesan…

c1efdf4

…ddrivers actor Currently we do not have yet data here for RHEL 10 HW, so dropping the actor for now. This cannot commit must be removed BEFORE the merge in upstream.

IPU 9 -> 10: Add Python path for el 10 (py 3.12)

e22432b

DROP_COMMIT_BEFORE_MERGE: artificial repomap 9 -> 10

3e4b743

IPU 9 -> 10: Specify default PESIDS for el10

84b41bf

IPU 9 -> 10: Set gpg-pubkeys to be obsoleted

9d52704

* TODO: this is just experimental, copied value from IPU 8 -> 9 to pass the execution without traceback. Check what should be really set inside.

DROP_COMMIT_BEFORE_MERGE: drop some actions around certs

d1e153c

Temporarily disabled, not sure now why. The commit will be for sure changed or dropped before the merge.

pirat89 force-pushed the poc-ipu-9-10 branch from 1e42b2b to d1e153c Compare April 19, 2024 13:42

Rezney and others added 2 commits April 22, 2024 12:01

[TMP] - Handle RPM DB migration

2935fac

The tool file is fine but we need to create a separate actor for this

squash! Packaging: Introduce builds for EL 9 for IPU 9 -> 10

b2752c7

Set common python deps + builds-deps for RHEL 8+. Previosly, build deps have been set just for RHEL 8, not for RHEL 9, so we could not create *pyc files for RHEL 9 builds due to missing macros.

Rezney force-pushed the poc-ipu-9-10 branch from cd7e7d9 to b2752c7 Compare April 22, 2024 10:23

Rezney added 7 commits April 22, 2024 13:16

TMP: temp to_remove entry for testing

a3903a7

OAMG-10976

[TMP] - Official key

4a0acb5

Until RHELBLD-15138 is resolved

[TMP] - remove also "openssl-fips-provider-so"

921ac3c

Update PES data

852bb32

Skip "directory-hash" files

934a181

They are not owned by any package and can dynamically grow to a huge amount of files causing hitting open files limit

Install "util-linux" into the target container

d6ee5d7

"util-linux" package is not brought in as a dependency anymore and we are missing "/usr/bin/su"

Stop removing the "openssl-fips-provider" pkgs

7354da9

The issue was fixed.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[POC] [WIP] IPU 9 -> 10: Initial preparation: upgrade paths and leapp packages def #1169

[POC] [WIP] IPU 9 -> 10: Initial preparation: upgrade paths and leapp packages def #1169

pirat89 commented Jan 23, 2024 •

edited

github-actions bot commented Jan 23, 2024

fernflower Jan 23, 2024

pirat89 Jan 23, 2024

fernflower Jan 23, 2024

pirat89 Jan 23, 2024

pirat89 commented Apr 2, 2024

Rezney commented Jun 11, 2024

[POC] [WIP] IPU 9 -> 10: Initial preparation: upgrade paths and leapp packages def #1169

Are you sure you want to change the base?

[POC] [WIP] IPU 9 -> 10: Initial preparation: upgrade paths and leapp packages def #1169

Conversation

pirat89 commented Jan 23, 2024 • edited

github-actions bot commented Jan 23, 2024

Thank you for contributing to the Leapp project!

fernflower Jan 23, 2024

Choose a reason for hiding this comment

pirat89 Jan 23, 2024

Choose a reason for hiding this comment

fernflower Jan 23, 2024

Choose a reason for hiding this comment

pirat89 Jan 23, 2024

Choose a reason for hiding this comment

pirat89 commented Apr 2, 2024

Rezney commented Jun 11, 2024

pirat89 commented Jan 23, 2024 •

edited