[rhel-9.8] coreos.unique.boot.failure coreos.unique.boot.ignition.failure and coreos.ignition.failure are failing in ppc64le

[ravanelli]

[2026-02-03T21:01:06.035Z] ======== Re-running failed tests (flake detection) ========
[2026-02-03T21:01:06.035Z] 
[2026-02-03T21:01:06.035Z] ⏭️  Skipping kola test pattern "fips.enable":
[2026-02-03T21:01:06.035Z]   👉 https://issues.redhat.com/browse/RHEL-129425
[2026-02-03T21:01:06.035Z] ⏰ Snooze for kola test pattern "ext.config.systemd.journal-compat" expired on Feb 01 2026
[2026-02-03T21:01:06.035Z] ⚠️  Will warn on failure for kola test pattern "ext.config.systemd.journal-compat":
[2026-02-03T21:01:06.035Z]   👉 https://github.com/coreos/rhel-coreos-config/issues/151
[2026-02-03T21:01:06.035Z] === RUN   coreos.unique.boot.ignition.failure
[2026-02-03T21:01:06.035Z] === RUN   coreos.unique.boot.failure
[2026-02-03T21:01:06.035Z] === RUN   coreos.ignition.failure
[2026-02-03T21:02:02.203Z] 2026-02-03T21:03:42Z kola/tests/ignition/qemufailure: Journal dumping during emergency.target failed. Continuing best effort.
[2026-02-03T21:02:02.203Z] 2026-02-03T21:03:42Z kola/tests/ignition/qemufailure: Journal dumping during emergency.target failed. Continuing best effort.
[2026-02-03T21:02:02.203Z] 2026-02-03T21:03:42Z kola/tests/ignition/qemufailure: Journal dumping during emergency.target failed. Continuing best effort.
[2026-02-03T21:02:02.203Z] --- FAIL: coreos.unique.boot.failure (64.68s)
[2026-02-03T21:02:02.203Z]         qemufailure.go:74: timed out waiting for initramfs error: context deadline exceeded
[2026-02-03T21:02:02.203Z] --- FAIL: coreos.unique.boot.ignition.failure (64.71s)
[2026-02-03T21:02:02.203Z]         qemufailure.go:80: timed out waiting for initramfs error: context deadline exceeded
[2026-02-03T21:02:02.203Z] --- FAIL: coreos.ignition.failure (64.71s)
[2026-02-03T21:02:02.203Z]         qemufailure.go:68: timed out waiting for initramfs error: context deadline exceeded
[2026-02-03T21:02:02.203Z] FAIL, output in /home/jenkins/agent/workspace/build-arch/tmp/kola-0bQ9V/kola/rerun
[2026-02-03T21:02:02.203Z] Error: harness: test suite failed

[    0.825999] Demotion targets for Node 0: null
[    0.826091] page_owner is disabled
[    0.826190] Key type .fscrypt registered
[    0.826232] Key type fscrypt-provisioning registered
[    0.826418] pstore: Using crash dump compression: deflate
[    0.826494] Key type big_key registered
[    0.826545] Key type trusted registered
[    0.828883] Key type encrypted registered
[    0.828992] Secure boot mode disabled
[    0.829053] Loading compiled-in module X.509 certificates
[    0.829452] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 535c9f1b7653691c63698bded1558340f82b5468'
[    0.829566] ima: Allocated hash algorithm: sha256
[    0.840967] Secure boot mode disabled
[    0.841031] Trusted boot mode disabled
[    0.841077] ima: No architecture policies found
[    0.841141] evm: Initialising EVM extended attributes:
[    0.841200] evm: security.selinux
[    0.841243] evm: security.SMACK64 (disabled)
[    0.841335] evm: security.SMACK64EXEC (disabled)
[    0.841387] evm: security.SMACK64TRANSMUTE (disabled)
[    0.841444] evm: security.SMACK64MMAP (disabled)
[    0.841499] evm: security.apparmor (disabled)
[    0.841551] evm: security.ima
[    0.841598] evm: security.capability
[    0.841638] evm: HMAC attrs: 0x1
[    1.020934] Running certificate verification RSA selftest
[    1.021787] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db'
[    1.022596] Running certificate verification ECDSA selftest
[    1.024996] Loaded X.509 cert 'Certificate verification ECDSA self-testing key: 2900bcea1deb7bc8479a84a23d758efdfdd2b2d3'
[    1.027731] SED: plpks not available
[    1.033876] clk: Disabling unused clocks
[    1.035799] Freeing unused kernel image (initmem) memory: 7552K
[    1.036225] Checked W+X mappings: passed, no W+X pages found
[    1.036332] Run /init as init process
[    1.046640] systemd[1]: systemd 252-64.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    1.047083] systemd[1]: Detected virtualization kvm.
[    1.047155] systemd[1]: Detected architecture ppc64-le.
[    1.047225] systemd[1]: Running in initrd.
[    1.047493] systemd[1]: No hostname configured, using default hostname.
[    1.047660] systemd[1]: Hostname set to <localhost>.
[    1.047822] systemd[1]: Initializing machine ID from random generator.
[    1.047925] systemd[1]: Failed to write /etc/machine-id: No space left on device
[    1.137860] ln: 
[    1.137868] failed to create symbolic link '/var/log'
[    1.137954] : No such file or directory
[    1.138047] 
[    1.139455] ln: 
[    1.139460] failed to create symbolic link '/var/log'
[    1.139513] : No such file or directory
[    1.139583] 
[    1.311460] systemd[1]: Queued start job for default target Initrd Default Target.
[    1.326669] systemd[1]: Started Forward Password Requests to Clevis Directory Watch.
[    1.327024] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    1.327228] systemd[1]: Reached target Local Encrypted Volumes (Pre).
[    1.327375] systemd[1]: Reached target Local Encrypted Volumes.
[    1.327580] systemd[1]: Reached target Initrd /usr File System.
[    1.327753] systemd[1]: Reached target Path Units.
[    1.327900] systemd[1]: Reached target Slice Units.
[    1.328032] systemd[1]: Reached target Swaps.
[    1.328155] systemd[1]: Reached target Timer Units.
[    1.328405] systemd[1]: Listening on D-Bus System Message Bus Socket.
[    1.328590] systemd[1]: Listening on Open-iSCSI iscsid Socket.
[    1.328781] systemd[1]: Listening on Open-iSCSI iscsiuio Socket.
[    1.329077] systemd[1]: Listening on Journal Socket (/dev/log).
[    1.329342] systemd[1]: Listening on Journal Socket.
[    1.329613] systemd[1]: Listening on udev Control Socket.
[    1.329831] systemd[1]: Listening on udev Kernel Socket.
[    1.329955] systemd[1]: Reached target Socket Units.
[    1.331310] systemd[1]: Starting Afterburn Initrd Setup Network Kernel Arguments...
[    1.331551] systemd[1]: Check That Initrd Matches Kernel was skipped because of an unmet condition check (ConditionPathIsDirectory=!/usr/lib/modules/5.14.0-671.el9.ppc64le).
[    1.331967] systemd[1]: Finished CoreOS Tear Down Initramfs.
[    1.333048] systemd[1]: Starting CoreOS: Touch /run/agetty.reload...
[    1.336935] systemd[1]: Starting Create List of Static Device Nodes...
[    1.346162] systemd[1]: Starting Journal Service...
[    1.356269] systemd[1]: Starting Load Kernel Modules...
[    1.357352] systemd[1]: Starting Create System Users...
[    1.372478] systemd[1]: Starting Setup Virtual Console...
[    1.377844] systemd[1]: afterburn-network-kargs.service: Main process exited, code=exited, status=1/FAILURE
[    1.378163] systemd[1]: afterburn-network-kargs.service: Failed with result 'exit-code'.
[    1.379816] systemd[1]: Failed to start Afterburn Initrd Setup Network Kernel Arguments.
[    1.380001] systemd[1]: Dependency failed for Ignition Complete.
[    1.380123] systemd[1]: Dependency failed for Initrd Default Target.
[    1.380248] systemd[1]: initrd.target: Job initrd.target/start failed with result 'dependency'.
[    1.380404] systemd[1]: initrd.target: Triggering OnFailure= dependencies.
[    1.381194] systemd[1]: ignition-complete.target: Job ignition-complete.target/start failed with result 'dependency'.
[    1.381373] systemd[1]: afterburn-network-kargs.service: Triggering OnFailure= dependencies.
[    1.382822] systemd[1]: Unnecessary job was removed for /dev/disk/by-label/boot.
[    1.396740] systemd[1]: Finished Setup Virtual Console.
[    1.409773] systemd[1]: Stopped target Local Encrypted Volumes.
[    1.410009] systemd[1]: Stopped target Initrd /usr File System.
[    1.410185] systemd[1]: Stopped target Path Units.
[    1.410330] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.
[    1.659387] afterburn[266]: Error: failed to run
[    1.659543] afterburn[266]: Caused by:
[    1.659604] afterburn[266]:     0: failed to write network arguments fragment
[    1.659708] afterburn[266]:     1: No space left on device (os error 28)
[    1.685717] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.
[    1.686075] systemd[1]: Stopped target Local Encrypted Volumes (Pre).
[    1.686229] systemd[1]: clevis-luks-askpass.path: Deactivated successfully.
[    1.686750] fuse: init (API version 7.37)
[    1.687333] systemd-modules-load[271]: Inserted module 'fuse'
[    1.706123] systemd[1]: Stopped Forward Password Requests to Clevis Directory Watch.
[    1.706414] systemd[1]: Stopped target Slice Units.
[    1.706537] systemd[1]: Stopped target Socket Units.
[    1.706656] systemd[1]: Stopped target Swaps.
[    1.706768] systemd[1]: Stopped target Timer Units.
[    1.706939] systemd[1]: iscsid.socket: Deactivated successfully.
[    1.707109] systemd[1]: Closed Open-iSCSI iscsid Socket.
[    1.707279] systemd[1]: iscsiuio.socket: Deactivated successfully.
[    1.707413] systemd[1]: Closed Open-iSCSI iscsiuio Socket.
[    1.707665] systemd[1]: coreos-touch-run-agetty.service: Deactivated successfully.
[    1.707848] systemd[1]: Stopped CoreOS: Touch /run/agetty.reload.
[    1.726262] systemd[1]: Started Emergency Shell.
[    1.726591] systemd[1]: Reached target Emergency Mode.
[    1.727303] systemd[1]: dbus.socket: Deactivated successfully.
[    1.727450] systemd[1]: Closed D-Bus System Message Bus Socket.
[    1.727759] systemd[1]: kmod-static-nodes.service: Deactivated successfully.
[    1.727928] systemd[1]: Stopped Create List of Static Device Nodes.
[    1.728521] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.
[    1.728669] systemd[1]: Closed udev Control Socket.
[    1.728858] systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully.
[    1.729013] systemd[1]: Closed udev Kernel Socket.
[    1.729441] systemd[1]: Started Journal Service.
[    1.730201] systemd[1]: systemd-modules-load.service: Deactivated successfully.
[    1.730634] systemd[1]: Stopped Load Kernel Modules.
[    1.730984] systemd[1]: systemd-sysusers.service: Main process exited, code=killed, status=15/TERM
[    1.731271] systemd[1]: systemd-sysusers.service: Failed with result 'signal'.
[    1.731614] systemd[1]: Stopped Create System Users.
[    1.732059] systemd[1]: run-credentials-systemd\x2dsysusers.service.mount: Deactivated successfully.
[    1.733599] systemd[1]: Starting Dump Journal to Virtio Port...
[    1.735689] ignition-virtio-dump-journal[278]: Didn't find virtio port /dev/virtio-ports/com.coreos.ignition.journal
[    1.736324] systemd[1]: Finished Dump Journal to Virtio Port.
[    7.010902] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[    7.011134] device-mapper: uevent: version 1.0.3
[    7.011356] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev
Displaying logs from failed units: afterburn-network-kargs.service
systemd-sysusers.service
Feb 03 20:56:36 afterburn[266]: Error: failed to run
Feb 03 20:56:36 afterburn[266]: Caused by:
Feb 03 20:56:36 afterburn[266]:     0: failed to write network arguments fragment
Feb 03 20:56:36 afterburn[266]:     1: No space left on device (os error 28)
Feb 03 20:56:36 systemd[1]: [0;1;38;5;185m[0;1;39m[0;1;38;5;185msystemd-sysusers.service: Main process exited, code=killed, status=15/TERM[0m
Feb 03 20:56:36 systemd[1]: [0;1;38;5;185m[0;1;39m[0;1;38;5;185msystemd-sysusers.service: Failed with result 'signal'.[0m
Feb 03 20:56:36 systemd[1]: Stopped Create System Users.

Dracut was upgraded causing the issue

dracut 057-104.git20250919.el9_7 -> 057-110.git20260130.el9
 dracut-network 057-104.git20250919.el9_7 -> 057-110.git20260130.el9
 dracut-squash 057-104.git20250919.el9_7 -> 057-110.git20260130.el9