Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

openbsd cloud-init fails to apply (could not find data source) #12

Closed
jbpratt opened this issue Dec 3, 2021 · 25 comments · Fixed by canonical/cloud-init#1132
Closed
Assignees

Comments

@jbpratt
Copy link
Collaborator

jbpratt commented Dec 3, 2021

Playing around with packaging and booting an openbsd-6.9 CDI (no customizations). On boot, a few exceptions within cloud-init are thrown plus some concerning logs (util.py[WARNING]: Can not apply stage final, no datasource found! Likely bad things to come! 😅 ). We should work with @goneri (sorry for the tag!) on understanding and resolving these issues. This will also allow the 'upstream' image source (https://bsd-cloud-image.org/) to be consistently tested on kubevirt within our pipeline.

OpenBSD console logs
❯ virtctl console -n kargo openbsd-br0
Successfully connected to openbsd-br0 console. The escape sequence is ^]

cannot open hd0a:/etc/random.seed: No such file or directory
booting hd0a:/bsd: 14411048+3224584+344096+0+1175552 [1009441+128+1145856+866050]=0x1528eb0
entry point at 0xffffffff81001000
[ using 3022512 bytes of bsd ELF symbol table ]
Copyright (c) 1982, 1986, 1989, 1991, 1993
	The Regents of the University of California.  All rights reserved.
Copyright (c) 1995-2021 OpenBSD. All rights reserved.  https://www.OpenBSD.org

OpenBSD 6.9 (GENERIC.MP) #473: Mon Apr 19 10:40:28 MDT 2021
    deraadt@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 3983396864 (3798MB)
avail mem = 3847290880 (3669MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xf5a00 (11 entries)
bios0: vendor SeaBIOS version "1.14.0-1.el8s" date 04/01/2014
bios0: KubeVirt None
acpi0 at bios0: ACPI 3.0
acpi0: sleep states S5
acpi0: tables DSDT FACP APIC MCFG WAET
acpi0: wakeup devices
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM) i5-4690K CPU @ 3.50GHz, 664.21 MHz, 06-3c-03
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,UMIP,MD_CLEAR,IBRS,IBPB,STIBP,SSBD,ARAT,XSAVEOPT,MELTDOWN
cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB 64b/line 16-way L2 cache
cpu0: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped
cpu0: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 999MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM) i5-4690K CPU @ 3.50GHz, 750.26 MHz, 06-3c-03
cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT,SSE3,PCLMUL,VMX,SSSE3,FMA3,CX16,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,UMIP,MD_CLEAR,IBRS,IBPB,STIBP,SSBD,ARAT,XSAVEOPT,MELTDOWN
cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB 64b/line 16-way L2 cache
cpu1: ITLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped
cpu1: DTLB 255 4KB entries direct-mapped, 255 4MB entries direct-mapped
cpu1: smt 1, core 0, package 0
ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0xb0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
"ACPI0006" at acpi0 not configured
acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
acpicmos0 at acpi0
"PNP0A06" at acpi0 not configured
"PNP0A06" at acpi0 not configured
"QEMU0002" at acpi0 not configured
"ACPI0010" at acpi0 not configured
acpicpu0 at acpi0: C1(@1 halt!)
acpicpu1 at acpi0: C1(@1 halt!)
cpu0: using VERW MDS workaround
pvbus0 at mainbus0: KVM
pvclock0 at pvbus0
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 82G33 Host" rev 0x00
vga1 at pci0 dev 1 function 0 "Bochs VGA" rev 0x02
wsdisplay at vga1 not configured
ppb0 at pci0 dev 2 function 0 vendor "Red Hat", unknown product 0x000c rev 0x00: apic 0 int 22
pci1 at ppb0 bus 1
virtio0 at pci1 dev 0 function 0 "Qumranet Virtio 1.x Network" rev 0x01
vio0 at virtio0: address 02:f4:00:00:00:00
virtio0: msix shared
ppb1 at pci0 dev 2 function 1 vendor "Red Hat", unknown product 0x000c rev 0x00: apic 0 int 22
pci2 at ppb1 bus 2
virtio1 at pci2 dev 0 function 0 "Qumranet Virtio 1.x SCSI" rev 0x01
vioscsi0 at virtio1: qsize 256
scsibus1 at vioscsi0: 255 targets
virtio1: msix per-VQ
ppb2 at pci0 dev 2 function 2 vendor "Red Hat", unknown product 0x000c rev 0x00: apic 0 int 22
pci3 at ppb2 bus 3
virtio2 at pci3 dev 0 function 0 "Qumranet Virtio 1.x Console" rev 0x01
virtio2: no matching child driver; not configured
ppb3 at pci0 dev 2 function 3 vendor "Red Hat", unknown product 0x000c rev 0x00: apic 0 int 22
pci4 at ppb3 bus 4
virtio3 at pci4 dev 0 function 0 "Qumranet Virtio 1.x Storage" rev 0x01
vioblk0 at virtio3
scsibus2 at vioblk0: 1 targets
sd0 at scsibus2 targ 0 lun 0: <VirtIO, Block Device, >
sd0: 2048MB, 512 bytes/sector, 4194304 sectors
virtio3: msix per-VQ
ppb4 at pci0 dev 2 function 4 vendor "Red Hat", unknown product 0x000c rev 0x00: apic 0 int 22
pci5 at ppb4 bus 5
virtio4 at pci5 dev 0 function 0 "Qumranet Virtio 1.x Storage" rev 0x01
vioblk1 at virtio4
scsibus3 at vioblk1: 1 targets
sd1 at scsibus3 targ 0 lun 0: <VirtIO, Block Device, >
sd1: 1MB, 512 bytes/sector, 2048 sectors
virtio4: msix per-VQ
ppb5 at pci0 dev 2 function 5 vendor "Red Hat", unknown product 0x000c rev 0x00: apic 0 int 22
pci6 at ppb5 bus 6
virtio5 at pci6 dev 0 function 0 vendor "Qumranet", unknown product 0x1045 rev 0x01
viomb0 at virtio5
virtio5: apic 0 int 22
ppb6 at pci0 dev 2 function 6 vendor "Red Hat", unknown product 0x000c rev 0x00: apic 0 int 22
pci7 at ppb6 bus 7
virtio6 at pci7 dev 0 function 0 "Qumranet Virtio 1.x RNG" rev 0x01
viornd0 at virtio6
virtio6: apic 0 int 22
ppb7 at pci0 dev 2 function 7 vendor "Red Hat", unknown product 0x000c rev 0x00: apic 0 int 22
pci8 at ppb7 bus 8
pcib0 at pci0 dev 31 function 0 "Intel 82801IB LPC" rev 0x02
ahci0 at pci0 dev 31 function 2 "Intel 82801I AHCI" rev 0x02: msi, AHCI 1.0
scsibus4 at ahci0: 32 targets
ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x02: apic 0 int 16
iic0 at ichiic0
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0 mux 1
pms0 at pckbc0 (aux slot)
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
vmm0 at mainbus0: VMX/EPT (using slow L1TF mitigation)
vscsi0 at root
scsibus5 at vscsi0: 256 targets
softraid0 at root
scsibus6 at softraid0: 256 targets
root on sd0a (a46cc531a8dcc550.a) swap on sd0b dump on sd0b
Automatic boot in progress: starting file system checks.
/dev/sd0a (a46cc531a8dcc550.a): file system is clean; not checking
pf enabled
2021-12-03 14:17:09,518 - handlers.py[DEBUG]: start: init-local: searching for local datasources
2021-12-03 14:17:09,556 - util.py[WARNING]: Unable to read uptime using method: ctypes
2021-12-03 14:17:09,557 - util.py[DEBUG]: Unable to read uptime using method: ctypes
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1820, in uptime
    uptime_str = str(time.time() - boottime())
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1802, in boottime
    if libc.sysctlbyname(b"kern.boottime" + NULL_BYTES, ctypes.byref(buf),
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 386, in __getattr__
    func = self.__getitem__(name)
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 391, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: Unable to resolve symbol
2021-12-03 14:17:09,572 - util.py[DEBUG]: Attempting to remove /run/cloud-init/status.json
2021-12-03 14:17:09,574 - util.py[DEBUG]: Attempting to remove /run/cloud-init/result.json
2021-12-03 14:17:09,575 - util.py[DEBUG]: Attempting to remove /var/lib/cloud/data/status.json
2021-12-03 14:17:09,576 - util.py[DEBUG]: Attempting to remove /var/lib/cloud/data/result.json
2021-12-03 14:17:09,577 - atomic_helper.py[DEBUG]: Atomically writing to file /var/lib/cloud/data/status.json (via temporary file /var/lib/cloud/data/tmpq58j0fia) - w: [644] 469 bytes/chars
2021-12-03 14:17:09,579 - util.py[DEBUG]: Creating symbolic link from '/run/cloud-init/status.json' => '../../var/lib/cloud/data/status.json'
2021-12-03 14:17:09,619 - util.py[DEBUG]: Reading from /proc/1/environ (quiet=False)
2021-12-03 14:17:09,621 - util.py[DEBUG]: Reading from /proc/self/status (quiet=False)
2021-12-03 14:17:09,622 - util.py[DEBUG]: Reading from /proc/cmdline (quiet=False)
2021-12-03 14:17:09,628 - util.py[WARNING]: Unable to read uptime using method: ctypes
2021-12-03 14:17:09,629 - util.py[DEBUG]: Unable to read uptime using method: ctypes
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1820, in uptime
    uptime_str = str(time.time() - boottime())
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1802, in boottime
    if libc.sysctlbyname(b"kern.boottime" + NULL_BYTES, ctypes.byref(buf),
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 386, in __getattr__
    func = self.__getitem__(name)
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 391, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: Unable to resolve symbol
2021-12-03 14:17:09,637 - util.py[DEBUG]: Reading from /etc/cloud/cloud.cfg (quiet=False)
2021-12-03 14:17:09,640 - util.py[DEBUG]: Read 2068 bytes from /etc/cloud/cloud.cfg
2021-12-03 14:17:09,641 - util.py[DEBUG]: Attempting to load yaml from string of length 2068 with allowed root types (<class 'dict'>,)
2021-12-03 14:17:09,664 - util.py[DEBUG]: Reading from /etc/cloud/cloud.cfg.d/05_logging.cfg (quiet=False)
2021-12-03 14:17:09,665 - util.py[DEBUG]: Read 2070 bytes from /etc/cloud/cloud.cfg.d/05_logging.cfg
2021-12-03 14:17:09,667 - util.py[DEBUG]: Attempting to load yaml from string of length 2070 with allowed root types (<class 'dict'>,)
2021-12-03 14:17:09,683 - util.py[DEBUG]: Reading from /run/cloud-init/cloud.cfg (quiet=False)
2021-12-03 14:17:09,684 - util.py[DEBUG]: Attempting to load yaml from string of length 0 with allowed root types (<class 'dict'>,)
2021-12-03 14:17:09,687 - util.py[DEBUG]: loaded blob returned None, returning default.
2021-12-03 14:17:09,690 - util.py[DEBUG]: Redirecting <_io.TextIOWrapper name='<stdout>' mode='w' encoding='utf-8'> to | tee -a /var/log/cloud-init-output.log
2021-12-03 14:17:09,701 - util.py[DEBUG]: Redirecting <_io.TextIOWrapper name='<stderr>' mode='w' encoding='utf-8'> to | tee -a /var/log/cloud-init-output.log
2021-12-03 14:17:09,705 - main.py[DEBUG]: Logging being reset, this logger may no longer be active shortly
Cloud-init v. 21.2 running 'init-local' at Fri, 03 Dec 2021 14:17:09 +0000. Up ?? seconds.
2021-12-03 14:17:09,818 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:09,898 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:09,913 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:09,915 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:09,916 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:09,918 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:09,954 - util.py[WARNING]: Failed to parse /etc/resolv.conf, use new empty file
2021-12-03 14:17:09,973 - util.py[WARNING]: failed stage init-local
failed run of stage init-local
------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/cmd/main.py", line 322, in main_init
    init.fetch(existing=existing)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 363, in fetch
    return self._get_data_source(existing=existing)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 263, in _get_data_source
    (ds, dsname) = sources.find_source(self.cfg,
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/sources/__init__.py", line 817, in find_source
    raise DataSourceNotFoundException(msg)
cloudinit.sources.DataSourceNotFoundException: Did not find any data source, searched classes: (DataSourceNoCloud, DataSourceConfigDrive, DataSourceAzure, DataSourceOpenStackLocal, DataSourceEc2Local)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/cmd/main.py", line 652, in status_wrapper
    ret = functor(name, args)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/cmd/main.py", line 340, in main_init
    init.apply_network_config(bring_up=not args.local)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 824, in apply_network_config
    return self.distro.apply_network_config(
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/distros/__init__.py", line 210, in apply_network_config
    dev_names = self._write_network_config(netconfig)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/distros/bsd.py", line 124, in _write_network_config
    return self._supported_write_network_config(netconfig)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/distros/__init__.py", line 122, in _supported_write_network_config
    renderer.render_network_config(network_config)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/net/renderer.py", line 54, in render_network_config
    return self.render_network_state(
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/net/bsd.py", line 149, in render_network_state
    self.start_services(run=self._postcmds)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/net/openbsd.py", line 39, in start_services
    subp.subp(['pkill', 'dhclient'])
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/subp.py", line 293, in subp
    raise ProcessExecutionError(stdout=out, stderr=err,
cloudinit.subp.ProcessExecutionError: Unexpected error while running command.
Command: ['pkill', 'dhclient']
Exit code: 1
Reason: -
Stdout:
Stderr:
------------------------------------------------------------
starting network
WARNING: /etc/hostname.vio0 is insecure, fixing permissions.
vio0: no lease....got lease
vio0: 192.168.1.205 lease accepted from 192.168.1.1 (84:16:f9:7d:0d:4b)
dd: /var/db/host.random: No such file or directory
chmod: /var/db/host.random: No such file or directory
2021-12-03 14:17:13,977 - handlers.py[DEBUG]: start: init-network: searching for network datasources
2021-12-03 14:17:13,989 - util.py[WARNING]: Unable to read uptime using method: ctypes
2021-12-03 14:17:13,990 - util.py[DEBUG]: Unable to read uptime using method: ctypes
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1820, in uptime
    uptime_str = str(time.time() - boottime())
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1802, in boottime
    if libc.sysctlbyname(b"kern.boottime" + NULL_BYTES, ctypes.byref(buf),
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 386, in __getattr__
    func = self.__getitem__(name)
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 391, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: Unable to resolve symbol
2021-12-03 14:17:14,001 - util.py[DEBUG]: Reading from /var/lib/cloud/data/status.json (quiet=False)
2021-12-03 14:17:14,002 - util.py[DEBUG]: Read 602 bytes from /var/lib/cloud/data/status.json
2021-12-03 14:17:14,004 - atomic_helper.py[DEBUG]: Atomically writing to file /var/lib/cloud/data/status.json (via temporary file /var/lib/cloud/data/tmpo3k8epb_) - w: [644] 617 bytes/chars
2021-12-03 14:17:14,006 - util.py[DEBUG]: Creating symbolic link from '/run/cloud-init/status.json' => '../../var/lib/cloud/data/status.json'
2021-12-03 14:17:14,008 - util.py[DEBUG]: Attempting to remove /run/cloud-init/status.json
2021-12-03 14:17:14,042 - util.py[DEBUG]: Reading from /proc/1/environ (quiet=False)
2021-12-03 14:17:14,044 - util.py[DEBUG]: Reading from /proc/self/status (quiet=False)
2021-12-03 14:17:14,045 - util.py[DEBUG]: Reading from /proc/cmdline (quiet=False)
2021-12-03 14:17:14,051 - util.py[WARNING]: Unable to read uptime using method: ctypes
2021-12-03 14:17:14,052 - util.py[DEBUG]: Unable to read uptime using method: ctypes
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1820, in uptime
    uptime_str = str(time.time() - boottime())
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1802, in boottime
    if libc.sysctlbyname(b"kern.boottime" + NULL_BYTES, ctypes.byref(buf),
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 386, in __getattr__
    func = self.__getitem__(name)
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 391, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: Unable to resolve symbol
2021-12-03 14:17:14,061 - util.py[DEBUG]: Reading from /etc/cloud/cloud.cfg (quiet=False)
2021-12-03 14:17:14,062 - util.py[DEBUG]: Read 2068 bytes from /etc/cloud/cloud.cfg
2021-12-03 14:17:14,063 - util.py[DEBUG]: Attempting to load yaml from string of length 2068 with allowed root types (<class 'dict'>,)
2021-12-03 14:17:14,084 - util.py[DEBUG]: Reading from /etc/cloud/cloud.cfg.d/05_logging.cfg (quiet=False)
2021-12-03 14:17:14,086 - util.py[DEBUG]: Read 2070 bytes from /etc/cloud/cloud.cfg.d/05_logging.cfg
2021-12-03 14:17:14,087 - util.py[DEBUG]: Attempting to load yaml from string of length 2070 with allowed root types (<class 'dict'>,)
2021-12-03 14:17:14,100 - util.py[DEBUG]: Reading from /run/cloud-init/cloud.cfg (quiet=False)
2021-12-03 14:17:14,101 - util.py[DEBUG]: Attempting to load yaml from string of length 0 with allowed root types (<class 'dict'>,)
2021-12-03 14:17:14,103 - util.py[DEBUG]: loaded blob returned None, returning default.
2021-12-03 14:17:14,105 - util.py[DEBUG]: Redirecting <_io.TextIOWrapper name='<stdout>' mode='w' encoding='utf-8'> to | tee -a /var/log/cloud-init-output.log
2021-12-03 14:17:14,114 - util.py[DEBUG]: Redirecting <_io.TextIOWrapper name='<stderr>' mode='w' encoding='utf-8'> to | tee -a /var/log/cloud-init-output.log
2021-12-03 14:17:14,116 - main.py[DEBUG]: Logging being reset, this logger may no longer be active shortly
Cloud-init v. 21.2 running 'init' at Fri, 03 Dec 2021 14:17:14 +0000. Up ?? seconds.
ci-info: +++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++
ci-info: +--------+-------+----------------+------------+-------+------------+
ci-info: | Device |   Up  |    Address     |    Mask    | Scope | Hw-Address |
ci-info: +--------+-------+----------------+------------+-------+------------+
ci-info: |  enc0  | False |       .        |     .      |   .   |     .      |
ci-info: |  lo0   |  True |   127.0.0.1    | 0xff000000 |   .   |     .      |
ci-info: |  lo0   |  True |    ::1/128     |     .      |   .   |     .      |
ci-info: |  lo0   |  True | fe80::1%lo0/64 |     .      |  0x3  |     .      |
ci-info: |  vio0  |  True | 192.168.1.205  | 0xffffff00 |   .   |     .      |
ci-info: +--------+-------+----------------+------------+-------+------------+
ci-info:
2021-12-03 14:17:14,211 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:24,270 - util.py[WARNING]: No active metadata service found
2021-12-03 14:17:24,291 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:24,307 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:24,324 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command
2021-12-03 14:17:24,339 - dmi.py[WARNING]: did not find either path /sys/class/dmi/id or dmidecode command

You were disconnected from the console. This has one of the following reasons:
 - another user connected to the console of the target vm
 - network issues
websocket: close 1006 (abnormal closure): unexpected EOF

kmi  refactor-sysprep-on-host [$!?] 1m23s
❯ virtctl console -n kargo openbsd-br0
Successfully connected to openbsd-br0 console. The escape sequence is ^]

^CCloud-init 21.2 received SIGINT, exiting...
  Filename: /usr/local/lib/python3.8/site-packages/urllib3/util/connection.py
  Function: create_connection
  Line number: 86
    Filename: /usr/local/lib/python3.8/site-packages/urllib3/connection.py
    Function: _new_conn
    Line number: 169
      Filename: /usr/local/lib/python3.8/site-packages/urllib3/connection.py
      Function: connect
      Line number: 200
reordering libraries: done.
openssl: generating isakmpd/iked RSA keys... done.
ssh-keygen: generating new host keys: RSA DSA ECDSA ED25519
starting early daemons: syslogd pflogd ntpd.
starting RPC daemons:.
savecore: /dev/sd0b: Device not configured
checking quotas: done.
clearing /tmp
kern.securelevel: 0 -> 1
creating runtime link editor directory cache.
preserving editor files.
starting network daemons: sshd smtpd(failed) sndiod.
2021-12-03 14:19:08,916 - handlers.py[DEBUG]: start: modules-config: running modules for config
2021-12-03 14:19:08,928 - util.py[WARNING]: Unable to read uptime using method: ctypes
2021-12-03 14:19:08,929 - util.py[DEBUG]: Unable to read uptime using method: ctypes
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1820, in uptime
    uptime_str = str(time.time() - boottime())
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1802, in boottime
    if libc.sysctlbyname(b"kern.boottime" + NULL_BYTES, ctypes.byref(buf),
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 386, in __getattr__
    func = self.__getitem__(name)
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 391, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: Unable to resolve symbol
2021-12-03 14:19:08,939 - util.py[DEBUG]: Reading from /var/lib/cloud/data/status.json (quiet=False)
2021-12-03 14:19:08,940 - util.py[DEBUG]: Read 617 bytes from /var/lib/cloud/data/status.json
2021-12-03 14:19:08,942 - atomic_helper.py[DEBUG]: Atomically writing to file /var/lib/cloud/data/status.json (via temporary file /var/lib/cloud/data/tmp0iri0ksn) - w: [644] 641 bytes/chars
2021-12-03 14:19:08,944 - util.py[DEBUG]: Creating symbolic link from '/run/cloud-init/status.json' => '../../var/lib/cloud/data/status.json'
2021-12-03 14:19:08,946 - util.py[DEBUG]: Attempting to remove /run/cloud-init/status.json
2021-12-03 14:19:08,952 - util.py[WARNING]: Unable to read uptime using method: ctypes
2021-12-03 14:19:08,953 - util.py[DEBUG]: Unable to read uptime using method: ctypes
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1820, in uptime
    uptime_str = str(time.time() - boottime())
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1802, in boottime
    if libc.sysctlbyname(b"kern.boottime" + NULL_BYTES, ctypes.byref(buf),
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 386, in __getattr__
    func = self.__getitem__(name)
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 391, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: Unable to resolve symbol
2021-12-03 14:19:08,961 - util.py[DEBUG]: Reading from /etc/cloud/cloud.cfg (quiet=False)
2021-12-03 14:19:08,962 - util.py[DEBUG]: Read 2068 bytes from /etc/cloud/cloud.cfg
2021-12-03 14:19:08,963 - util.py[DEBUG]: Attempting to load yaml from string of length 2068 with allowed root types (<class 'dict'>,)
2021-12-03 14:19:08,983 - util.py[DEBUG]: Reading from /etc/cloud/cloud.cfg.d/05_logging.cfg (quiet=False)
2021-12-03 14:19:08,985 - util.py[DEBUG]: Read 2070 bytes from /etc/cloud/cloud.cfg.d/05_logging.cfg
2021-12-03 14:19:08,986 - util.py[DEBUG]: Attempting to load yaml from string of length 2070 with allowed root types (<class 'dict'>,)
2021-12-03 14:19:08,999 - util.py[DEBUG]: Reading from /run/cloud-init/cloud.cfg (quiet=False)
2021-12-03 14:19:09,028 - util.py[DEBUG]: Reading from /proc/1/environ (quiet=False)
2021-12-03 14:19:09,029 - util.py[DEBUG]: Reading from /proc/self/status (quiet=False)
2021-12-03 14:19:09,030 - util.py[DEBUG]: Reading from /proc/cmdline (quiet=False)
2021-12-03 14:19:09,031 - util.py[DEBUG]: Attempting to load yaml from string of length 0 with allowed root types (<class 'dict'>,)
2021-12-03 14:19:09,033 - util.py[DEBUG]: loaded blob returned None, returning default.
2021-12-03 14:19:09,035 - handlers.py[DEBUG]: start: modules-config/check-cache: attempting to read from cache [trust]
2021-12-03 14:19:09,036 - util.py[DEBUG]: Reading from /var/lib/cloud/instance/obj.pkl (quiet=False)
2021-12-03 14:19:09,037 - stages.py[DEBUG]: no cache found
2021-12-03 14:19:09,038 - handlers.py[DEBUG]: finish: modules-config/check-cache: SUCCESS: no cache found
2021-12-03 14:19:09,039 - util.py[DEBUG]: Attempting to remove /var/lib/cloud/instance
2021-12-03 14:19:09,047 - stages.py[DEBUG]: Using distro class <class 'cloudinit.distros.openbsd.Distro'>
2021-12-03 14:19:09,049 - __init__.py[DEBUG]: Looking for data source in: ['NoCloud', 'ConfigDrive', 'Azure', 'OpenStack', 'Ec2'], via packages ['', 'cloudinit.sources'] that matches dependencies []
2021-12-03 14:19:09,079 - __init__.py[DEBUG]: Searching for local data source in: []
2021-12-03 14:19:09,080 - util.py[WARNING]: Can not apply stage config, no datasource found! Likely bad things to come!
2021-12-03 14:19:09,081 - util.py[DEBUG]: Can not apply stage config, no datasource found! Likely bad things to come!
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/cmd/main.py", line 484, in main_modules
    init.fetch(existing="trust")
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 363, in fetch
    return self._get_data_source(existing=existing)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 263, in _get_data_source
    (ds, dsname) = sources.find_source(self.cfg,
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/sources/__init__.py", line 817, in find_source
    raise DataSourceNotFoundException(msg)
cloudinit.sources.DataSourceNotFoundException: Did not find any data source, searched classes: ()
Can not apply stage config, no datasource found! Likely bad things to come!
------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/cmd/main.py", line 484, in main_modules
    init.fetch(existing="trust")
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 363, in fetch
    return self._get_data_source(existing=existing)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 263, in _get_data_source
    (ds, dsname) = sources.find_source(self.cfg,
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/sources/__init__.py", line 817, in find_source
    raise DataSourceNotFoundException(msg)
cloudinit.sources.DataSourceNotFoundException: Did not find any data source, searched classes: ()
------------------------------------------------------------
2021-12-03 14:19:09,101 - atomic_helper.py[DEBUG]: Atomically writing to file /var/lib/cloud/data/status.json (via temporary file /var/lib/cloud/data/tmp_rgx2pk_) - w: [644] 728 bytes/chars
2021-12-03 14:19:09,103 - util.py[DEBUG]: cloud-init mode 'modules' took 0.185 seconds (N/A)
2021-12-03 14:19:09,104 - handlers.py[DEBUG]: finish: modules-config: SUCCESS: running modules for config
starting local daemons: cron.
2021-12-03 14:19:09,881 - handlers.py[DEBUG]: start: modules-final: running modules for final
2021-12-03 14:19:09,893 - util.py[WARNING]: Unable to read uptime using method: ctypes
2021-12-03 14:19:09,894 - util.py[DEBUG]: Unable to read uptime using method: ctypes
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1820, in uptime
    uptime_str = str(time.time() - boottime())
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1802, in boottime
    if libc.sysctlbyname(b"kern.boottime" + NULL_BYTES, ctypes.byref(buf),
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 386, in __getattr__
    func = self.__getitem__(name)
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 391, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: Unable to resolve symbol
2021-12-03 14:19:09,904 - util.py[DEBUG]: Reading from /var/lib/cloud/data/status.json (quiet=False)
2021-12-03 14:19:09,905 - util.py[DEBUG]: Read 728 bytes from /var/lib/cloud/data/status.json
2021-12-03 14:19:09,907 - atomic_helper.py[DEBUG]: Atomically writing to file /var/lib/cloud/data/status.json (via temporary file /var/lib/cloud/data/tmptd74we02) - w: [644] 753 bytes/chars
2021-12-03 14:19:09,909 - util.py[DEBUG]: Creating symbolic link from '/run/cloud-init/status.json' => '../../var/lib/cloud/data/status.json'
2021-12-03 14:19:09,911 - util.py[DEBUG]: Attempting to remove /run/cloud-init/status.json
2021-12-03 14:19:09,939 - util.py[WARNING]: Unable to read uptime using method: ctypes
2021-12-03 14:19:09,940 - util.py[DEBUG]: Unable to read uptime using method: ctypes
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1820, in uptime
    uptime_str = str(time.time() - boottime())
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/util.py", line 1802, in boottime
    if libc.sysctlbyname(b"kern.boottime" + NULL_BYTES, ctypes.byref(buf),
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 386, in __getattr__
    func = self.__getitem__(name)
  File "/usr/local/lib/python3.8/ctypes/__init__.py", line 391, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: Unable to resolve symbol
2021-12-03 14:19:09,949 - util.py[DEBUG]: Reading from /etc/cloud/cloud.cfg (quiet=False)
2021-12-03 14:19:09,950 - util.py[DEBUG]: Read 2068 bytes from /etc/cloud/cloud.cfg
2021-12-03 14:19:09,951 - util.py[DEBUG]: Attempting to load yaml from string of length 2068 with allowed root types (<class 'dict'>,)
2021-12-03 14:19:09,972 - util.py[DEBUG]: Reading from /etc/cloud/cloud.cfg.d/05_logging.cfg (quiet=False)
2021-12-03 14:19:09,973 - util.py[DEBUG]: Read 2070 bytes from /etc/cloud/cloud.cfg.d/05_logging.cfg
2021-12-03 14:19:09,974 - util.py[DEBUG]: Attempting to load yaml from string of length 2070 with allowed root types (<class 'dict'>,)
2021-12-03 14:19:09,987 - util.py[DEBUG]: Reading from /run/cloud-init/cloud.cfg (quiet=False)
2021-12-03 14:19:10,018 - util.py[DEBUG]: Reading from /proc/1/environ (quiet=False)
2021-12-03 14:19:10,019 - util.py[DEBUG]: Reading from /proc/self/status (quiet=False)
2021-12-03 14:19:10,020 - util.py[DEBUG]: Reading from /proc/cmdline (quiet=False)
2021-12-03 14:19:10,021 - util.py[DEBUG]: Attempting to load yaml from string of length 0 with allowed root types (<class 'dict'>,)
2021-12-03 14:19:10,022 - util.py[DEBUG]: loaded blob returned None, returning default.
2021-12-03 14:19:10,024 - handlers.py[DEBUG]: start: modules-final/check-cache: attempting to read from cache [trust]
2021-12-03 14:19:10,026 - util.py[DEBUG]: Reading from /var/lib/cloud/instance/obj.pkl (quiet=False)
2021-12-03 14:19:10,027 - stages.py[DEBUG]: no cache found
2021-12-03 14:19:10,028 - handlers.py[DEBUG]: finish: modules-final/check-cache: SUCCESS: no cache found
2021-12-03 14:19:10,029 - util.py[DEBUG]: Attempting to remove /var/lib/cloud/instance
2021-12-03 14:19:10,038 - stages.py[DEBUG]: Using distro class <class 'cloudinit.distros.openbsd.Distro'>
2021-12-03 14:19:10,040 - __init__.py[DEBUG]: Looking for data source in: ['NoCloud', 'ConfigDrive', 'Azure', 'OpenStack', 'Ec2'], via packages ['', 'cloudinit.sources'] that matches dependencies []
2021-12-03 14:19:10,068 - __init__.py[DEBUG]: Searching for local data source in: []
2021-12-03 14:19:10,069 - util.py[WARNING]: Can not apply stage final, no datasource found! Likely bad things to come!
2021-12-03 14:19:10,070 - util.py[DEBUG]: Can not apply stage final, no datasource found! Likely bad things to come!
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/cmd/main.py", line 484, in main_modules
    init.fetch(existing="trust")
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 363, in fetch
    return self._get_data_source(existing=existing)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 263, in _get_data_source
    (ds, dsname) = sources.find_source(self.cfg,
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/sources/__init__.py", line 817, in find_source
    raise DataSourceNotFoundException(msg)
cloudinit.sources.DataSourceNotFoundException: Did not find any data source, searched classes: ()
Can not apply stage final, no datasource found! Likely bad things to come!
------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/cmd/main.py", line 484, in main_modules
    init.fetch(existing="trust")
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 363, in fetch
    return self._get_data_source(existing=existing)
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/stages.py", line 263, in _get_data_source
    (ds, dsname) = sources.find_source(self.cfg,
  File "/usr/local/lib/python3.8/site-packages/cloud_init-21.2-py3.8.egg/cloudinit/sources/__init__.py", line 817, in find_source
    raise DataSourceNotFoundException(msg)
cloudinit.sources.DataSourceNotFoundException: Did not find any data source, searched classes: ()
------------------------------------------------------------
2021-12-03 14:19:10,095 - atomic_helper.py[DEBUG]: Atomically writing to file /var/lib/cloud/data/status.json (via temporary file /var/lib/cloud/data/tmpue88snr2) - w: [644] 840 bytes/chars
2021-12-03 14:19:10,097 - atomic_helper.py[DEBUG]: Atomically writing to file /var/lib/cloud/data/result.json (via temporary file /var/lib/cloud/data/tmp711pb4aq) - w: [644] 341 bytes/chars
2021-12-03 14:19:10,099 - util.py[DEBUG]: Creating symbolic link from '/run/cloud-init/result.json' => '../../var/lib/cloud/data/result.json'
2021-12-03 14:19:10,101 - util.py[DEBUG]: cloud-init mode 'modules' took 0.219 seconds (N/A)
2021-12-03 14:19:10,102 - handlers.py[DEBUG]: finish: modules-final: SUCCESS: running modules for final
Fri Dec  3 07:19:10 MST 2021

OpenBSD/amd64 (Amnesiac) (tty00)

login: kc2user
Password:
Login incorrect
login:

The image can be found at https://github.com/users/jbpratt/packages/container/package/openbsd

openbsd-br0.yml
---
# https://github.com/kubevirt/kubevirt/blob/master/docs/cloud-init.md
apiVersion: kubevirt.io/v1alpha3
kind: VirtualMachine
metadata:
  name: openbsd-br0
  namespace: kargo
  labels:
    app: kargo
spec:
  running: true
  template:
    spec:
      evictionStrategy: LiveMigrate
      nodeSelector:
        node-role.kubernetes.io/kubevirt: ""
      domain:
        clock:
          utc: {}
          timer: {}
        cpu:
          cores: 1
          sockets: 1
          threads: 2
          model: host-passthrough
          dedicatedCpuPlacement: false
        devices:
          rng: {}
          autoattachPodInterface: false
          autoattachSerialConsole: true
          autoattachGraphicsDevice: true
          networkInterfaceMultiqueue: false
          disks:
            - name: containerdisk
              bootOrder: 1
              disk:
                bus: virtio
            - name: cloudinitdisk
              disk:
                bus: virtio
          interfaces:
          - name: enp1s0
            model: virtio
            bridge: {}
        machine:
          type: q35
        resources:
          limits:
            memory: 4G
          requests:
            memory: 4G
            devices.kubevirt.io/kvm: "1"
      hostname: openbsd-br0
      networks:
      - name: enp1s0
        multus:
          networkName: kargo-net-attach-def-br0
      terminationGracePeriodSeconds: 0
      accessCredentials:
      - sshPublicKey:
          source:
            secret:
              secretName: kargo-sshpubkey-kc2user
          propagationMethod:
            qemuGuestAgent:
              users:
              - "kc2user"
      volumes:
        - name: containerdisk
          containerDisk:
            image: ghcr.io/jbpratt/openbsd:6.9-f8e31e3
            imagePullPolicy: Always
        - name: cloudinitdisk
          cloudInitNoCloud:
            networkData: |
              version: 2
              ethernets:
                enp1s0:
                  dhcp4: true
                  dhcp6: true
                  dhcp-identifier: mac
            userData: |
              #cloud-config
              hostname: openbsd-br0
              ssh_pwauth: true
              disable_root: true
              chpasswd:
                list: |
                   kc2user:kc2user
                expire: False
              users:
                - name: kc2user
                  shell: /bin/bash
                  lock_passwd: false
                  sudo: ['ALL=(ALL) NOPASSWD:ALL']
                  groups: sudo,wheel
              growpart:
                mode: auto
                devices: ['/']
                ignore_growroot_disabled: true
              package_upgrade: true
              packages:
                - vim
                - screenfetch
              runcmd:
                - "screenfetch"
@jbpratt jbpratt changed the title openbsd cloud-init fails to apply openbsd cloud-init fails to apply (could not find data source) Dec 3, 2021
@jbpratt jbpratt self-assigned this Dec 3, 2021
@goneri
Copy link

goneri commented Dec 3, 2021

Hi! How do you expose the meta-data? And do you have the serial console output?

@jbpratt
Copy link
Collaborator Author

jbpratt commented Dec 3, 2021

Hi @goneri ! First off, thank you for the awesome work with the bsd images, I'm excited to get this working and as well the quick reply.

My understanding of KubeVirt internals are going to be quite shallow, but we are using cloudInitNoCloud (https://github.com/kubevirt/kubevirt/blob/099be903803556bfe3a85075a7b55f0a711d9ca7/docs/cloud-init.md) in-line like so https://github.com/ContainerCraft/qubo/blob/main/examples/vms/microk8s-br0.yaml#L68-L119 (just an example). https://github.com/kubevirt/kubevirt/blob/099be903803556bfe3a85075a7b55f0a711d9ca7/docs/cloud-init.md#nocloud-implementation-details

Yes, in #12 (comment) the first collapsed section is the serial console output, sorry that was hidden. The second is the actual VMI file.

@goneri
Copy link

goneri commented Dec 3, 2021

Ok, thanks for the details, I will take a look later today.

@usrbinkat
Copy link
Member

I tried a couple different ways to get the cloud config into the vm:

Cloud Init Config Drive:

Cloud Init NoCloud:

@usrbinkat
Copy link
Member

This is a more complete log https://termbin.com/ekio

@usrbinkat
Copy link
Member

Kubevirt launcher pod including some qemu-guest-agent connection logs:
https://termbin.com/einnk

Libvirt XML:
https://termbin.com/d3ix

@usrbinkat
Copy link
Member

We're attaching the disks via virtio type.
I also tried with efi/uefi and basic bios boot with no change.

We do come to a final login prompt via serial console but the cloud-config user credentials are not active.
An ip is also acquired by the vm. SSH server does not seem to be running on the vm.

@usrbinkat
Copy link
Member

A sata based cloudInitConfigDrive vm

@goneri
Copy link

goneri commented Dec 3, 2021

UEFI won't work with the current image. I prepare a lab to reproduce the problem.

goneri added a commit to goneri/cloud-init that referenced this issue Dec 3, 2021
When the metadata is an ISO image and is exposed through a disk,
the device is called `/dev/sd?a` internally. For instance `/dev/sd1a`.

It can then be mounted with `mount_cd9660 /dev/sd1a /mnt`.

Metadata in the FAT32 format are exposed as `/dev/sd?i`.

With this change, we try to mount `/dev/sd?a` in addition to `/dev/sd?i`.

Closes: ContainerCraft/kmi#12
goneri added a commit to goneri/cloud-init that referenced this issue Dec 3, 2021
When the metadata is an ISO image and is exposed through a disk,
the device is called `/dev/sd?a` internally. For instance `/dev/sd1a`.

It can then be mounted with `mount_cd9660 /dev/sd1a /mnt`.

Metadata in the FAT32 format are exposed as `/dev/sd?i`.

With this change, we try to mount `/dev/sd?a` in addition to `/dev/sd?i`.

Closes: ContainerCraft/kmi#12
@usrbinkat
Copy link
Member

@goneri we Tested both NoCloud and ConfigDrive with no luck. Serial console was not enabled so I only have screenshots of the vnc console. If the image has a default username / password I can login and upload the cloud-init logs and block device info to a pastebin.

Screenshot ConfigDrive
Screenshot NoCloud

@goneri
Copy link

goneri commented Dec 6, 2021

Can you please share your metadata disk and the libvirt domain XML.

@usrbinkat
Copy link
Member

While the screen was scrolling, I saw a /dev/sd0b device not configured

cloud-init NoCloud userdata
          # full kubevirt vm definition @ https://termbin.com/s5ha
          cloudInitNoCloud:
            userData: |
              #cloud-config
              hostname: openbsd
              ssh_pwauth: false
              disable_root: false
              chpasswd:
                list: |
                  kc2user:kc2user
                expire: False
              users:
                - name: kc2user
                  shell: /bin/bash
                  lock_passwd: false
                  sudo: ['ALL=(ALL) NOPASSWD:ALL']
                  groups: sudo,wheel
              runcmd:
                - "echo hello"
Libvirt XML
<domain type="kvm" xmlns:qemu="http://libvirt.org/schemas/domain/qemu/1.0">
	<name>default_bsd</name>
	<memory unit="b">8000000000</memory>
	<os>
		<type arch="x86_64" machine="q35">hvm</type>
		<smbios mode="sysinfo"></smbios>
	</os>
	<sysinfo type="smbios">
		<system>
			<entry name="uuid">d3f9d048-e6ba-5304-9a4f-5c283153ea10</entry>
			<entry name="manufacturer">KubeVirt</entry>
			<entry name="family">KubeVirt</entry>
			<entry name="product">None</entry>
			<entry name="sku"></entry>
			<entry name="version"></entry>
		</system>
		<bios></bios>
		<baseBoard></baseBoard>
		<chassis></chassis>
	</sysinfo>
	<devices>
		<interface type="ethernet">
			<source></source>
			<target dev="tap1" managed="no"></target>
			<model type="virtio-non-transitional"></model>
			<mac address="02:42:66:00:00:09"></mac>
			<mtu size="1500"></mtu>
			<alias name="ua-enp1s0"></alias>
			<rom enabled="no"></rom>
		</interface>
		<channel type="unix">
			<target name="org.qemu.guest_agent.0" type="virtio"></target>
		</channel>
		<controller type="usb" index="0" model="none"></controller>
		<controller type="scsi" index="0" model="virtio-non-transitional"></controller>
		<controller type="virtio-serial" index="0" model="virtio-non-transitional"></controller>
		<video>
			<model type="vga" heads="1" vram="16384"></model>
		</video>
		<graphics type="vnc">
			<listen type="socket" socket="/var/run/kubevirt-private/7ef269fe-1661-4ebb-af13-0383108be274/virt-vnc"></listen>
		</graphics>
		<memballoon model="virtio-non-transitional">
			<stats period="10"></stats>
		</memballoon>
		<disk device="disk" type="file" model="virtio-non-transitional">
			<source file="/var/run/kubevirt-private/vmi-disks/openbsd-persistent-hostpath-disk-vda-root/disk.img"></source>
			<target bus="virtio" dev="vda"></target>
			<driver cache="none" error_policy="stop" name="qemu" type="raw" discard="unmap"></driver>
			<alias name="ua-openbsd-persistent-hostpath-disk-vda-root"></alias>
			<boot order="1"></boot>
		</disk>
		<disk device="disk" type="file" model="virtio-non-transitional">
			<source file="/var/run/kubevirt-ephemeral-disks/cloud-init-data/default/bsd/noCloud.iso"></source>
			<target bus="virtio" dev="vdb"></target>
			<driver cache="none" error_policy="stop" name="qemu" type="raw" discard="unmap"></driver>
			<alias name="ua-cloudinitdisk"></alias>
		</disk>
		<serial type="unix">
			<target port="0"></target>
			<source mode="bind" path="/var/run/kubevirt-private/7ef269fe-1661-4ebb-af13-0383108be274/virt-serial0"></source>
		</serial>
		<console type="pty">
			<target type="serial" port="0"></target>
		</console>
		<rng model="virtio-non-transitional">
			<backend model="random">/dev/urandom</backend>
		</rng>
	</devices>
	<clock offset="utc" adjustment="reset"></clock>
	<metadata>
		<kubevirt xmlns="http://kubevirt.io">
			<uid>7ef269fe-1661-4ebb-af13-0383108be274</uid>
			<graceperiod>
				<deletionGracePeriodSeconds>0</deletionGracePeriodSeconds>
			</graceperiod>
		</kubevirt>
	</metadata>
	<features>
		<acpi></acpi>
	</features>
	<cpu mode="host-passthrough">
		<topology sockets="1" cores="1" threads="8"></topology>
	</cpu>
	<vcpu placement="static">8</vcpu>
	<iothreads>1</iothreads>
</domain>

@goneri
Copy link

goneri commented Dec 6, 2021

I need the driver image actually. Because it's the source of the problem. It's not an ISO image exposed through a CDROM device, nor a disk with a partition. It's a mix of both.

@usrbinkat
Copy link
Member

I'm checking with the Kubevirt community kubernetes slack channel for advice on how to provide that to you.

@jbpratt
Copy link
Collaborator Author

jbpratt commented Dec 7, 2021

Hi @goneri, can you provide a password to get into the machine with? I'm not sure if there is a default password set and we are unable to set one through our usual means (virt-sysprep or cloud-init). Or if you have other recommended methods, that would be awesome. I think we can then better try to provide the data you are requesting.

Some virt-sysprep operations are supported on BSD flavors but I'm unable to inject my ssh key (or anything else) due to the disk layout it seems.

virt-sysprep ssh-inject output
sudo virt-sysprep -v --add image.qcow2 --ssh-inject openbsd:file:/home/bpratt/.ssh/id_rsa.pub
[   0.0] Examining the guest ...
libguestfs: launch: program=virt-sysprep
libguestfs: launch: version=1.46.0fedora=35,release=1.fc35,libvirt
libguestfs: launch: backend registered: direct
libguestfs: launch: backend registered: libvirt
libguestfs: launch: backend registered: uml
libguestfs: launch: backend registered: unix
libguestfs: launch: backend=libvirt
libguestfs: launch: tmpdir=/tmp/libguestfsNEXRYN
libguestfs: launch: umask=0022
libguestfs: launch: euid=0
libguestfs: libvirt version = 7006000 (7.6.0)
libguestfs: guest random name = guestfs-68w9hab81q5sla5h
libguestfs: connect to libvirt
libguestfs: opening libvirt handle: URI = qemu:///system, auth = default+wrapper, flags = 0
libguestfs: successfully opened libvirt handle: conn = 0x55d6f8f8b030
libguestfs: qemu version (reported by libvirt) = 6001000 (6.1.0)
libguestfs: get libvirt capabilities
libguestfs: parsing capabilities XML
libguestfs: parsing domcapabilities XML
libguestfs: build appliance
libguestfs: begin building supermin appliance
libguestfs: run supermin
libguestfs: command: run: /usr/bin/supermin
libguestfs: command: run: \ --build
libguestfs: command: run: \ --verbose
libguestfs: command: run: \ --if-newer
libguestfs: command: run: \ --lock /var/tmp/.guestfs-0/lock
libguestfs: command: run: \ --copy-kernel
libguestfs: command: run: \ -f ext2
libguestfs: command: run: \ --host-cpu x86_64
libguestfs: command: run: \ /usr/lib64/guestfs/supermin.d
libguestfs: command: run: \ -o /var/tmp/.guestfs-0/appliance.d
supermin: version: 5.3.1
supermin: rpm: detected RPM version 4.17
supermin: rpm: detected RPM architecture x86_64
supermin: package handler: fedora/rpm
supermin: acquiring lock on /var/tmp/.guestfs-0/lock
supermin: if-newer: output does not need rebuilding
libguestfs: finished building supermin appliance
libguestfs: command: run: qemu-img --help | grep -sqE -- '\binfo\b.*-U\b'
libguestfs: command: run: qemu-img
libguestfs: command: run: \ info
libguestfs: command: run: \ -U
libguestfs: command: run: \ --output json
libguestfs: command: run: \ /var/tmp/.guestfs-0/appliance.d/root
libguestfs: parse_json: qemu-img info JSON output:\n{\n    "virtual-size": 4294967296,\n    "filename": "/var/tmp/.guestfs-0/appliance.d/root",\n    "format": "raw",\n    "actual-size": 415055872,\n    "dirty-flag": false\n}\n\n
libguestfs: command: run: qemu-img
libguestfs: command: run: \ create
libguestfs: command: run: \ -f qcow2
libguestfs: command: run: \ -o backing_file=/var/tmp/.guestfs-0/appliance.d/root,backing_fmt=raw
libguestfs: command: run: \ /tmp/libguestfsNEXRYN/overlay1.qcow2
Formatting '/tmp/libguestfsNEXRYN/overlay1.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=4294967296 backing_file=/var/tmp/.guestfs-0/appliance.d/root backing_fmt=raw lazy_refcounts=off refcount_bits=16
libguestfs: create libvirt XML
libguestfs: command: run: qemu-img
libguestfs: command: run: \ info
libguestfs: command: run: \ -U
libguestfs: command: run: \ --output json
libguestfs: command: run: \ ./image.qcow2
libguestfs: parse_json: qemu-img info JSON output:\n{\n    "virtual-size": 2147483648,\n    "filename": "./image.qcow2",\n    "cluster-size": 65536,\n    "format": "qcow2",\n    "actual-size": 612581376,\n    "format-specific": {\n        "type": "qcow2",\n        "data": {\n            "compat": "1.1",\n            "compression-type": "zlib",\n            "lazy-refcounts": false,\n            "refcount-bits": 16,\n            "corrupt": false,\n            "extended-l2": false\n        }\n    },\n    "dirty-flag": false\n}\n\n
libguestfs: libvirt XML:\n<?xml version="1.0"?>\n<domain type="kvm" xmlns:qemu="http://libvirt.org/schemas/domain/qemu/1.0">\n  <name>guestfs-68w9hab81q5sla5h</name>\n  <memory unit="MiB">1280</memory>\n  <currentMemory unit="MiB">1280</currentMemory>\n  <cpu mode="maximum"/>\n  <vcpu>1</vcpu>\n  <clock offset="utc">\n    <timer name="rtc" tickpolicy="catchup"/>\n    <timer name="pit" tickpolicy="delay"/>\n    <timer name="hpet" present="no"/>\n  </clock>\n  <os>\n    <type>hvm</type>\n    <kernel>/var/tmp/.guestfs-0/appliance.d/kernel</kernel>\n    <initrd>/var/tmp/.guestfs-0/appliance.d/initrd</initrd>\n    <cmdline>panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color</cmdline>\n    <bios useserial="yes"/>\n  </os>\n  <seclabel type="none"/>\n  <on_reboot>destroy</on_reboot>\n  <devices>\n    <emulator>/usr/bin/qemu-kvm</emulator>\n    <rng model="virtio">\n      <backend model="random">/dev/urandom</backend>\n    </rng>\n    <controller type="scsi" index="0" model="virtio-scsi"/>\n    <disk device="disk" type="file">\n      <source file="/tmp/tmp.EFhafqIhig/image.qcow2"/>\n      <target dev="sda" bus="scsi"/>\n      <driver name="qemu" type="qcow2" cache="writeback" discard="unmap"/>\n      <address type="drive" controller="0" bus="0" target="0" unit="0"/>\n    </disk>\n    <disk type="file" device="disk">\n      <source file="/tmp/libguestfsNEXRYN/overlay1.qcow2"/>\n      <target dev="sdb" bus="scsi"/>\n      <driver name="qemu" type="qcow2" cache="unsafe"/>\n      <address type="drive" controller="0" bus="0" target="1" unit="0"/>\n    </disk>\n    <serial type="unix">\n      <source mode="connect" path="/tmp/libguestfsfiDy0R/console.sock"/>\n      <target port="0"/>\n    </serial>\n    <channel type="unix">\n      <source mode="connect" path="/tmp/libguestfsfiDy0R/guestfsd.sock"/>\n      <target type="virtio" name="org.libguestfs.channel.0"/>\n    </channel>\n    <controller type="usb" model="none"/>\n    <memballoon model="none"/>\n  </devices>\n  <qemu:commandline>\n    <qemu:env name="TMPDIR" value="/var/tmp"/>\n  </qemu:commandline>\n</domain>\n
libguestfs: command: run: ls
libguestfs: command: run: \ -a
libguestfs: command: run: \ -l
libguestfs: command: run: \ -R
libguestfs: command: run: \ -Z /var/tmp/.guestfs-0
libguestfs: /var/tmp/.guestfs-0:
libguestfs: total 0
libguestfs: drwxr-xr-x. 1 root root unconfined_u:object_r:user_tmp_t:s0   30 Dec  7 06:05 .
libguestfs: drwxrwxrwt. 1 root root system_u:object_r:tmp_t:s0          1984 Dec  7 06:05 ..
libguestfs: drwxr-xr-x. 1 root root unconfined_u:object_r:user_tmp_t:s0   32 Dec  7 05:50 appliance.d
libguestfs: -rw-r--r--. 1 root root unconfined_u:object_r:user_tmp_t:s0    0 Nov 16 16:53 lock
libguestfs:
libguestfs: /var/tmp/.guestfs-0/appliance.d:
libguestfs: total 419932
libguestfs: drwxr-xr-x. 1 root   root unconfined_u:object_r:user_tmp_t:s0         32 Dec  7 05:50 .
libguestfs: drwxr-xr-x. 1 root   root unconfined_u:object_r:user_tmp_t:s0         30 Dec  7 06:05 ..
libguestfs: -rw-r--r--. 1 root   root unconfined_u:object_r:user_tmp_t:s0    3784704 Dec  7 06:05 initrd
libguestfs: -rwxr-xr-x. 1 root   root unconfined_u:object_r:user_tmp_t:s0   11167408 Dec  7 06:05 kernel
libguestfs: -rw-r--r--. 1 bpratt qemu unconfined_u:object_r:user_tmp_t:s0 4294967296 Dec  7 06:05 root
libguestfs: command: run: ls
libguestfs: command: run: \ -a
libguestfs: command: run: \ -l
libguestfs: command: run: \ -Z /tmp/libguestfsfiDy0R
libguestfs: total 0
libguestfs: drwxr-xr-x.  2 root root unconfined_u:object_r:user_tmp_t:s0   80 Dec  7 06:05 .
libguestfs: drwxrwxrwt. 30 root root system_u:object_r:tmp_t:s0          1060 Dec  7 06:05 ..
libguestfs: srw-rw----.  1 root qemu unconfined_u:object_r:user_tmp_t:s0    0 Dec  7 06:05 console.sock
libguestfs: srw-rw----.  1 root qemu unconfined_u:object_r:user_tmp_t:s0    0 Dec  7 06:05 guestfsd.sock
libguestfs: launch libvirt guest
libguestfs: responding to serial console Device Status Report
\x1b[1;256r\x1b[256;256H\x1b[6n
Google, Inc.
Serial Graphics Adapter 07/23/21
SGABIOS $Id$ (mockbuild@) Fri Jul 23 21:20:21 UTC 2021
Term: 80x24
4 0
SeaBIOS (version 1.14.0-6.fc35)
Machine UUID ca459f7d-c932-4296-ab2e-1d9dcd90aeb3
Booting from ROM...
\x1b[2J[    0.000000] Linux version 5.15.6-200.fc35.x86_64 (mockbuild@bkernel01.iad2.fedoraproject.org) (gcc (GCC) 11.2.1 20210728 (Red Hat 11.2.1-1), GNU ld version 2.37-10.fc35) #1 SMP Wed Dec 1 13:41:10 UTC 2021
[    0.000000] Command line: panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x010: 'MPX CSR'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: xstate_offset[3]:  832, xstate_sizes[3]:   64
[    0.000000] x86/fpu: xstate_offset[4]:  896, xstate_sizes[4]:   64
[    0.000000] x86/fpu: Enabled xstate features 0x1f, context size is 960 bytes, using 'compacted' format.
[    0.000000] signal: max sigframe size: 2032
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009f7ff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009f800-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000004fffcfff] usable
[    0.000000] BIOS-e820: [mem 0x000000004fffd000-0x000000004fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.14.0-6.fc35 04/01/2014
[    0.000000] Hypervisor detected: KVM
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 46c01001, primary cpu clock
[    0.000002] kvm-clock: using sched offset of 134447601 cycles
[    0.000008] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000016] tsc: Detected 2111.996 MHz processor
[    0.000303] last_pfn = 0x4fffd max_arch_pfn = 0x400000000
[    0.000344] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT
[    0.008773] found SMP MP-table at [mem 0x000f5c30-0x000f5c3f]
[    0.008880] Using GB pages for direct mapping
[    0.009065] RAMDISK: [mem 0x4fc54000-0x4ffeffff]
[    0.009089] ACPI: Early table checksum verification disabled
[    0.009223] ACPI BIOS Error (bug): A valid RSDP was not found (20210730/tbxfroot-210)
[    0.009483] No NUMA configuration found
[    0.009484] Faking a node at [mem 0x0000000000000000-0x000000004fffcfff]
[    0.009496] NODE_DATA(0) allocated [mem 0x4fc29000-0x4fc53fff]
[    0.011998] Zone ranges:
[    0.012002]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.012004]   DMA32    [mem 0x0000000001000000-0x000000004fffcfff]
[    0.012006]   Normal   empty
[    0.012007]   Device   empty
[    0.012008] Movable zone start for each node
[    0.012010] Early memory node ranges
[    0.012011]   node   0: [mem 0x0000000000001000-0x000000000009efff]
[    0.012013]   node   0: [mem 0x0000000000100000-0x000000004fffcfff]
[    0.012017] Initmem setup node 0 [mem 0x0000000000001000-0x000000004fffcfff]
[    0.012026] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.012060] On node 0, zone DMA: 97 pages in unavailable ranges
[    0.013578] On node 0, zone DMA32: 3 pages in unavailable ranges
[    0.013959] Intel MultiProcessor Specification v1.4
[    0.013962] MPTABLE: OEM ID: BOCHSCPU
[    0.013963] MPTABLE: Product ID: 0.1
[    0.013964] MPTABLE: APIC at: 0xFEE00000
[    0.013987] Processor #0 (Bootup-CPU)
[    0.014024] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.014027] Processors: 1
[    0.014028] TSC deadline timer available
[    0.014035] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.014092] kvm-guest: KVM setup pv remote TLB flush
[    0.014095] kvm-guest: setup PV sched yield
[    0.014112] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.014114] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.014115] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff]
[    0.014116] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[    0.014117] [mem 0x50000000-0xfeffbfff] available for PCI devices
[    0.014118] Booting paravirtualized kernel on KVM
[    0.014129] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.019001] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1
[    0.019221] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u2097152
[    0.019255] kvm-guest: setup async PF for cpu 0
[    0.019259] kvm-guest: stealtime: cpu 0, msr 4e633080
[    0.019262] kvm-guest: PV spinlocks disabled, single CPU
[    0.019273] Built 1 zonelists, mobility grouping on.  Total pages: 322301
[    0.019275] Policy zone: DMA32
[    0.019276] Kernel command line: panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color
[    0.019444] cgroup: Disabling memory control group subsystem
[    0.019495] Unknown kernel command line parameters "edd=off udevtimeout=6000 guestfs_verbose=1", will be passed to user space.
[    0.019640] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.019664] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.019706] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.023474] Memory: 1226328K/1310316K available (16394K kernel code, 3561K rwdata, 10528K rodata, 2904K init, 4796K bss, 83728K reserved, 0K cma-reserved)
[    0.023487] random: get_random_u64 called from __kmem_cache_create+0x2a/0x500 with crng_init=0
[    0.023604] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.023621] Kernel/User page tables isolation: enabled
[    0.023642] ftrace: allocating 47361 entries in 186 pages
[    0.038626] ftrace: allocated 186 pages with 5 groups
[    0.038809] rcu: Hierarchical RCU implementation.
[    0.038810] rcu: \tRCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=1.
[    0.038812] \tTrampoline variant of Tasks RCU enabled.
[    0.038812] \tRude variant of Tasks RCU enabled.
[    0.038813] \tTracing variant of Tasks RCU enabled.
[    0.038814] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.038814] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[    0.042005] NR_IRQS: 524544, nr_irqs: 256, preallocated irqs: 16
[    0.042285] random: crng done (trusting CPU's manufacturer)
[    0.042389] Console: colour *CGA 80x25
[    0.110094] printk: console [ttyS0] enabled
[    0.110561] APIC: Switch to symmetric I/O mode setup
[    0.111275] x2apic enabled
[    0.111773] Switched APIC routing to physical x2apic.
[    0.112302] kvm-guest: setup PV IPIs
[    0.113457] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x1e717485a72, max_idle_ns: 440795205496 ns
[    0.114536] Calibrating delay loop (skipped) preset value.. 4223.99 BogoMIPS (lpj=2111996)
[    0.115391] pid_max: default: 32768 minimum: 301
[    0.115533] LSM: Security Framework initializing
[    0.115533] Yama: becoming mindful.
[    0.115533] LSM support for eBPF active
[    0.115533] landlock: Up and running.
[    0.115533] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.115533] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.115533] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    0.115533] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.115533] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.115533] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.115533] Spectre V2 : Mitigation: Full generic retpoline
[    0.115533] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.115533] Spectre V2 : Enabling Restricted Speculation for firmware calls
[    0.115533] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.115533] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.115533] SRBDS: Unknown: Dependent on hypervisor status
[    0.115533] MDS: Mitigation: Clear CPU buffers
[    0.115533] Freeing SMP alternatives memory: 44K
[    0.115533] smpboot: CPU0: Intel(R) Core(TM) i7-8650U CPU @ 1.90GHz (family: 0x6, model: 0x8e, stepping: 0xa)
[    0.115665] Performance Events: Skylake events, full-width counters, Intel PMU driver.
[    0.116515] ... version:                2
[    0.116535] ... bit width:              48
[    0.116979] ... generic registers:      4
[    0.117395] ... value mask:             0000ffffffffffff
[    0.117535] ... max period:             00007fffffffffff
[    0.118085] ... fixed-purpose events:   3
[    0.118503] ... event mask:             000000070000000f
[    0.118629] rcu: Hierarchical SRCU implementation.
[    0.119458] smp: Bringing up secondary CPUs ...
[    0.119537] smp: Brought up 1 node, 1 CPU
[    0.119960] smpboot: Max logical packages: 1
[    0.120409] smpboot: Total of 1 processors activated (4223.99 BogoMIPS)
[    0.120680] devtmpfs: initialized
[    0.121092] x86/mm: Memory block size: 128MB
[    0.121769] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.122541] futex hash table entries: 256 (order: 2, 16384 bytes, linear)
[    0.123286] pinctrl core: initialized pinctrl subsystem
[    0.123650] PM: RTC time: 12:05:18, date: 2021-12-07
[    0.124262] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.124618] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations
[    0.125359] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.125540] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.126365] audit: initializing netlink subsys (disabled)
[    0.126627] thermal_sys: Registered thermal governor 'fair_share'
[    0.126627] thermal_sys: Registered thermal governor 'bang_bang'
[    0.127263] thermal_sys: Registered thermal governor 'step_wise'
[    0.127535] thermal_sys: Registered thermal governor 'user_space'
[    0.128159] cpuidle: using governor menu
[    0.129099] PCI: Using configuration type 1 for base access
[    0.130473] Kprobes globally optimized
[    0.130541] audit: type=2000 audit(1638878718.755:1): state=initialized audit_enabled=0 res=1
[    0.131480] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.131537] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.132318] alg: self-tests disabled
[    0.132764] cryptd: max_cpu_qlen set to 1000
[    0.133614] raid6: skip pq benchmark and using algorithm avx2x4
[    0.134237] raid6: using avx2x2 recovery algorithm
[    0.134558] ACPI: Interpreter disabled.
[    0.135000] iommu: Default domain type: Translated
[    0.135511] iommu: DMA domain TLB invalidation policy: lazy mode
[    0.135584] vgaarb: loaded
[    0.135930] SCSI subsystem initialized
[    0.136362] usbcore: USB support disabled
[    0.136559] pps_core: LinuxPPS API ver. 1 registered
[    0.137080] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.137537] PTP clock support registered
[    0.137976] EDAC MC: Ver: 3.0.0
[    0.138441] NetLabel: Initializing
[    0.138537] NetLabel:  domain hash size = 128
[    0.138990] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.139547] NetLabel:  unlabeled traffic allowed by default
[    0.140129] PCI: Probing PCI hardware
[    0.140529] PCI host bridge to bus 0000:00
[    0.140536] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
[    0.141177] pci_bus 0000:00: root bus resource [mem 0x00000000-0x7fffffffff]
[    0.141538] pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff]
[    0.142382] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
[    0.142844] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
[    0.143868] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
[    0.145536] pci 0000:00:01.1: reg 0x20: [io  0xc0a0-0xc0af]
[    0.146553] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.147296] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.147535] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.148275] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.148737] pci 0000:00:02.0: [1af4:1004] type 00 class 0x010000
[    0.149863] pci 0000:00:02.0: reg 0x10: [io  0xc000-0xc03f]
[    0.150853] pci 0000:00:02.0: reg 0x14: [mem 0xfebfe000-0xfebfefff]
[    0.152864] pci 0000:00:02.0: reg 0x20: [mem 0xfebf0000-0xfebf3fff 64bit pref]
[    0.154446] pci 0000:00:03.0: [1af4:1003] type 00 class 0x078000
[    0.155059] pci 0000:00:03.0: reg 0x10: [io  0xc040-0xc07f]
[    0.155955] pci 0000:00:03.0: reg 0x14: [mem 0xfebff000-0xfebfffff]
[    0.157731] pci 0000:00:03.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref]
[    0.159232] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00
[    0.159928] pci 0000:00:04.0: reg 0x10: [io  0xc080-0xc09f]
[    0.162202] pci 0000:00:04.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref]
[    0.163279] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 00
[    0.163557] pci 0000:00:01.0: PIIX/ICH IRQ router [8086:7000]
[    0.164367] clocksource: Switched to clocksource kvm-clock
[    0.170947] VFS: Disk quotas dquot_6.6.0
[    0.171413] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.172188] pnp: PnP ACPI: disabled
[    0.173286] NET: Registered PF_INET protocol family
[    0.173840] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.180972] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)
[    0.181887] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.182726] TCP bind hash table entries: 16384 (order: 6, 262144 bytes, linear)
[    0.183496] TCP: Hash tables configured (established 16384 bind 16384)
[    0.184215] MPTCP token hash table entries: 2048 (order: 3, 49152 bytes, linear)
[    0.184999] UDP hash table entries: 1024 (order: 3, 32768 bytes, linear)
[    0.185706] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes, linear)
[    0.186471] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.187071] NET: Registered PF_XDP protocol family
[    0.187588] pci_bus 0000:00: resource 4 [io  0x0000-0xffff]
[    0.188168] pci_bus 0000:00: resource 5 [mem 0x00000000-0x7fffffffff]
[    0.188846] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.189460] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.190088] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    0.190753] PCI: CLS 0 bytes, default 64
[    0.191197] Trying to unpack rootfs image as initramfs...
[    0.192972] Freeing initrd memory: 3696K
[    0.193495] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1e717485a72, max_idle_ns: 440795205496 ns
[    0.194574] platform rtc_cmos: registered platform RTC device (no PNP device found)
[    0.195680] Initialise system trusted keyrings
[    0.196170] Key type blacklist registered
[    0.196617] workingset: timestamp_bits=36 max_order=19 bucket_order=0
[    0.198138] zbud: loaded
[    0.198710] integrity: Platform Keyring initialized
[    0.205013] NET: Registered PF_ALG protocol family
[    0.205521] xor: automatically using best checksumming function   avx
[    0.206268] Key type asymmetric registered
[    0.206708] Asymmetric key parser 'x509' registered
[    0.207240] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    0.208050] io scheduler mq-deadline registered
[    0.208530] io scheduler kyber registered
[    0.208978] io scheduler bfq registered
[    0.209562] atomic64_test: passed for x86-64 platform with CX8 and with SSE
[    0.210478] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    0.211420] virtio-pci 0000:00:02.0: PCI->APIC IRQ transform: INT A -> IRQ 10
[    0.212874] virtio-pci 0000:00:03.0: PCI->APIC IRQ transform: INT A -> IRQ 11
[    0.214307] virtio-pci 0000:00:04.0: PCI->APIC IRQ transform: INT A -> IRQ 11
[    0.215681] Serial: 8250/16550 driver, 1 ports, IRQ sharing enabled
[    0.216909] serial8250: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.217826] Non-volatile memory driver v1.3
[    0.218491] Linux agpgart interface v0.103
[    0.219495] scsi host0: ata_piix
[    0.219979] scsi host1: ata_piix
[    0.220392] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0a0 irq 14
[    0.221105] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0a8 irq 15
[    0.222164] libphy: Fixed MDIO Bus: probed
[    0.222679] usbserial: usb_serial_init - registering generic driver failed
[    0.223398] usbserial: usb_serial_init - returning with error -19
[    0.224040] i8042: PNP: No PS/2 controller found.
[    0.224529] i8042: Probing ports directly.
[    0.225494] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.226202] serio: i8042 AUX port at 0x60,0x64 irq 12
[    0.226794] mousedev: PS/2 mouse device common for all mice
[    0.227577] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[    0.228952] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[    0.229984] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input2
[    0.231145] rtc_cmos rtc_cmos: registered as rtc0
[    0.231690] rtc_cmos rtc_cmos: setting system clock to 2021-12-07T12:05:18 UTC (1638878718)
[    0.232564] rtc_cmos rtc_cmos: alarms up to one day, 114 bytes nvram
[    0.233233] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[    0.234498] device-mapper: uevent: version 1.0.3
[    0.235025] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com
[    0.235939] intel_pstate: CPU model not supported
[    0.236474] hid: raw HID events driver (C) Jiri Kosina
[    0.237072] intel_pmc_core intel_pmc_core.0:  initialized
[    0.237669] drop_monitor: Initializing network drop monitor service
[    0.238367] Initializing XFRM netlink socket
[    0.238878] NET: Registered PF_INET6 protocol family
[    0.239731] Segment Routing with IPv6
[    0.240125] RPL Segment Routing with IPv6
[    0.240553] In-situ OAM (IOAM) with IPv6
[    0.240974] mip6: Mobile IPv6
[    0.241290] NET: Registered PF_PACKET protocol family
[    0.241934] IPI shorthand broadcast: enabled
[    0.242389] AVX2 version of gcm_enc/dec engaged.
[    0.242897] AES CTR mode by8 optimization enabled
[    0.243572] sched_clock: Marking stable (171128770, 72407254)->(281974364, -38438340)
[    0.244436] registered taskstats version 1
[    0.244901] Loading compiled-in X.509 certificates
[    0.245858] Loaded X.509 cert 'Fedora kernel signing key: 783c86212ace97f6862148dd2d91648eb8a1c2da'
[    0.246834] zswap: loaded using pool lzo/zbud
[    0.247335] page_owner is disabled
[    0.247726] Key type ._fscrypt registered
[    0.248151] Key type .fscrypt registered
[    0.248572] Key type fscrypt-provisioning registered
[    0.249282] Btrfs loaded, crc32c=crc32c-generic, zoned=yes, fsverity=yes
[    0.250005] Key type big_key registered
[    0.250489] Key type encrypted registered
[    0.250924] ima: No TPM chip found, activating TPM-bypass!
[    0.251507] Loading compiled-in module X.509 certificates
[    0.252475] Loaded X.509 cert 'Fedora kernel signing key: 783c86212ace97f6862148dd2d91648eb8a1c2da'
[    0.253420] ima: Allocated hash algorithm: sha256
[    0.253936] ima: No architecture policies found
[    0.254428] evm: Initialising EVM extended attributes:
[    0.254973] evm: security.selinux
[    0.255328] evm: security.SMACK64 (disabled)
[    0.255774] evm: security.SMACK64EXEC (disabled)
[    0.256258] evm: security.SMACK64TRANSMUTE (disabled)
[    0.256784] evm: security.SMACK64MMAP (disabled)
[    0.257270] evm: security.apparmor (disabled)
[    0.257734] evm: security.ima
[    0.258052] evm: security.capability
[    0.258429] evm: HMAC attrs: 0x1
[    0.258923] PM:   Magic number: 1:348:76
[    0.259376] RAS: Correctable Errors collector initialized.
[    0.381239] Freeing unused decrypted memory: 2036K
[    0.383440] Freeing unused kernel image (initmem) memory: 2904K
[    0.384914] Write protecting the kernel read-only data: 30720k
[    0.388401] Freeing unused kernel image (text/rodata gap) memory: 2036K
[    0.391042] Freeing unused kernel image (rodata/data gap) memory: 1760K
[    0.437849] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    0.438562] rodata_test: all tests were successful
[    0.439071] x86/mm: Checking user space page tables
[    0.477900] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    0.478593] Run /init as init process
supermin: mounting /proc
supermin: ext2 mini initrd starting up: 5.3.1 dietlibc
supermin: cmdline: panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color
supermin: uptime: 0.40 0.11
supermin: mounting /sys
supermin: internal insmod crc32-pclmul.ko
supermin: internal insmod crc32c-intel.ko
supermin: internal insmod crct10dif-pclmul.ko
supermin: internal insmod crc32_generic.ko
supermin: internal insmod libnvdimm.ko
supermin: internal insmod nfit.ko
insmod: init_module: nfit.ko: No such device
supermin: internal insmod virtio_blk.ko
supermin: internal insmod ecdh_generic.ko
supermin: internal insmod rfkill.ko
supermin: internal insmod bluetooth.ko
[    0.509643] Bluetooth: Core ver 2.22
[    0.510065] NET: Registered PF_BLUETOOTH protocol family
[    0.510629] Bluetooth: HCI device and connection manager initialized
[    0.511306] Bluetooth: HCI socket layer initialized
[    0.511827] Bluetooth: L2CAP socket layer initialized
[    0.512369] Bluetooth: SCO socket layer initialized
supermin: internal insmod virtio_bt.ko
supermin: internal insmod virtio_console.ko
supermin: internal insmod crypto_engine.ko
supermin: internal insmod virtio_crypto.ko
supermin: internal insmod failover.ko
supermin: internal insmod net_failover.ko
supermin: internal insmod virtio_net.ko
supermin: internal insmod nd_btt.ko
supermin: internal insmod nd_pmem.ko
supermin: internal insmod virtio_scsi.ko
[    0.538980] scsi host2: Virtio SCSI HBA
[    0.539955] scsi 2:0:0:0: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
[    0.541100] scsi 2:0:1:0: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
[    0.550338] sd 2:0:0:0: Power-on or device reset occurred
[    0.550995] sd 2:0:0:0: Attached scsi generic sg0 type 0
[    0.551799] sd 2:0:1:0: Power-on or device reset occurred
[    0.552402] sd 2:0:1:0: Attached scsi generic sg1 type 0
[    0.553025] sd 2:0:0:0: [sda] 4194304 512-byte logical blocks: (2.15 GB/2.00 GiB)
[    0.553927] sd 2:0:0:0: [sda] Write Protect is off
[    0.554568] sd 2:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    0.555635] sd 2:0:1:0: [sdb] 8388608 512-byte logical blocks: (4.29 GB/4.00 GiB)
[    0.556498] sd 2:0:1:0: [sdb] Write Protect is off
[    0.557111] sd 2:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    0.561986]  sda: sda4
[    0.561986]  sda4: <openbsd: sda5 >
[    0.564991] sd 2:0:1:0: [sdb] Attached SCSI disk
[    0.565771] sd 2:0:0:0: [sda] Attached SCSI disk
supermin: internal insmod virtio_balloon.ko
supermin: internal insmod virtio_dma_buf.ko
supermin: internal insmod virtio_input.ko
supermin: internal insmod virtio_mem.ko
supermin: internal insmod virtio_mmio.ko
supermin: internal insmod vdpa.ko
supermin: internal insmod virtio_vdpa.ko
supermin: internal insmod fuse.ko
[    0.578109] fuse: init (API version 7.34)
supermin: internal insmod virtiofs.ko
supermin: internal insmod crc-itu-t.ko
supermin: internal insmod crc4.ko
supermin: internal insmod crc64.ko
supermin: internal insmod crc7.ko
supermin: internal insmod crc8.ko
supermin: internal insmod soundcore.ko
supermin: internal insmod snd.ko
supermin: internal insmod snd-timer.ko
supermin: internal insmod snd-pcm.ko
supermin: internal insmod virtio_snd.ko
supermin: picked 8:16 as root device
supermin: creating /dev/root as block special 8:16
supermin: mounting new root on /root
[    0.596668] EXT4-fs (sdb): mounting ext2 file system using the ext4 subsystem
[    0.598486] EXT4-fs (sdb): mounted filesystem without journal. Opts: . Quota mode: none.
supermin: deleting initramfs files
supermin: chroot
Starting /init script ...
+ [[ panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color == *guestfs_network=1* ]]
+ [[ panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color == *guestfs_rescue=1* ]]
+ [[ panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color == *guestfs_noreboot=1* ]]
+ [[ panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color == *guestfs_boot_analysis=1* ]]
+ mkdir -p /dev/pts /dev/shm
+ mount -t devpts /dev/pts /dev/pts
+ mount -t tmpfs -o mode=1777 shmfs /dev/shm
+ mkdir -p /sysroot
+ mkdir -p /run
+ mount -t tmpfs -o nosuid,size=20%,mode=0755 tmpfs /run
+ mkdir -p /run/lock
+ ln -s ../run/lock /var/lock
+ [[ panic=1 console=ttyS0 edd=off udevtimeout=6000 udev.event-timeout=6000 no_timer_check printk.time=1 cgroup_disable=memory usbcore.nousb cryptomgr.notests tsc=reliable 8250.nr_uarts=1 root=UUID=59d489e9-11ba-4773-80e6-80c7b36cc2d9 selinux=0 guestfs_verbose=1 TERM=xterm-256color == *selinux=1* ]]
+ test -e /etc/mtab
+ ln -s /proc/mounts /etc/mtab
+ mkdir -p /run/tmpfiles.d
+ kmod static-nodes --format=tmpfiles --output=/run/tmpfiles.d/kmod.conf
++ od -x -A n
++ dd if=/dev/urandom bs=16 count=1 status=none
+ machine_id=' 2e4c 4d28 4c43 a3cd fff6 cd80 64a9 b1ad'
+ echo 2e4c4d284c43a3cdfff6cd8064a9b1ad
+ systemd-tmpfiles --prefix=/dev --prefix=/run --prefix=/var/run --create --boot
\x1b[0;1;31m/usr/lib/tmpfiles.d/static-nodes-permissions.conf:17: Failed to resolve group 'kvm'.\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/static-nodes-permissions.conf:18: Failed to resolve group 'kvm'.\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/static-nodes-permissions.conf:19: Failed to resolve group 'kvm'.\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/systemd.conf:11: Failed to resolve group 'utmp'.\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/systemd.conf:19: Failed to resolve user 'systemd-network': No such process\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/systemd.conf:20: Failed to resolve user 'systemd-network': No such process\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/systemd.conf:21: Failed to resolve user 'systemd-network': No such process\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/systemd.conf:22: Failed to resolve user 'systemd-network': No such process\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/systemd.conf:26: Failed to resolve group 'systemd-journal'.\x1b[0m
\x1b[0;1;31m/usr/lib/tmpfiles.d/systemd.conf:27: Failed to resolve group 'systemd-journal'.\x1b[0m
+ for f in /lib/systemd/systemd-udevd /usr/lib/systemd/systemd-udevd /sbin/udevd /lib/udev/udevd /usr/lib/udev/udevd
+ '[' -x /lib/systemd/systemd-udevd ']'
+ UDEVD=/lib/systemd/systemd-udevd
+ break
+ '[' -z /lib/systemd/systemd-udevd ']'
+ /lib/systemd/systemd-udevd --daemon
Starting version v249.7-2.fc35
+ udevadm trigger
+ udevadm settle --timeout=600
+ shopt -s nullglob
+ for f in /sys/block/sd*/device/timeout
+ echo 300
+ for f in /sys/block/sd*/device/timeout
+ echo 300
+ for f in /sys/block/{h,s,ub,v}d*/queue/scheduler
+ echo noop
/init: line 111: echo: write error: Invalid argument
+ for f in /sys/block/{h,s,ub,v}d*/queue/scheduler
+ echo noop
/init: line 111: echo: write error: Invalid argument
+ shopt -u nullglob
+ ip addr add 127.0.0.1/8 brd + dev lo scope host
+ ip link set dev lo up
+ test '' = 1
+ mdadm -As --auto=yes --no-degraded
mdadm: No arrays found in config file or automatically
+ mkdir -p /tmp/lvm
+ touch /tmp/lvm/lvm.conf
+ LVM_SYSTEM_DIR=/tmp/lvm
+ export LVM_SYSTEM_DIR
+ lvmetad
/init: line 139: lvmetad: command not found
+ modprobe dm_mod
+ lvm pvscan --cache --activate ay
+ mdadm -As --auto=yes --run
mdadm: No arrays found in config file or automatically
+ ldmtool create all
/init: line 149: ldmtool: command not found
+ test 1 = 1
+ test '' '!=' 1
+ uname -a
Linux (none) 5.15.6-200.fc35.x86_64 #1 SMP Wed Dec 1 13:41:10 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
+ ls -lR /dev
/dev:
total 0
crw-r--r-- 1 root root  10, 235 Dec  7 12:05 autofs
drwxr-xr-x 2 root root      120 Dec  7 12:05 block
drwxr-xr-x 2 root root       80 Dec  7 12:05 bsg
crw------- 1 root root  10, 234 Dec  7 12:05 btrfs-control
drwxr-xr-x 2 root root     2260 Dec  7 12:05 char
crw------- 1 root root   5,   1 Dec  7 12:05 console
drwxr-xr-x 3 root root       60 Dec  7 12:05 cpu
crw------- 1 root root  10, 125 Dec  7 12:05 cpu_dma_latency
crw------- 1 root root  10, 203 Dec  7 12:05 cuse
drwxr-xr-x 5 root root      100 Dec  7 12:05 disk
drwxr-xr-x 2 root root       60 Dec  7 12:05 dma_heap
lrwxrwxrwx 1 root root       13 Dec  7 12:05 fd -> /proc/self/fd
crw-rw-rw- 1 root root   1,   7 Dec  7 12:05 full
crw-rw-rw- 1 root root  10, 229 Dec  7 12:05 fuse
crw------- 1 root root  10, 183 Dec  7 12:05 hwrng
drwxr-xr-x 3 root root      180 Dec  7 12:05 input
crw-r--r-- 1 root root   1,  11 Dec  7 12:05 kmsg
crw-rw---- 1 root disk  10, 237 Dec  7 12:05 loop-control
drwxr-xr-x 2 root root       60 Dec  7 12:05 mapper
crw------- 1 root root  10, 227 Dec  7 12:05 mcelog
crw------- 1 root root   1,   1 Dec  7 12:05 mem
drwxr-xr-x 2 root root       60 Dec  7 12:05 net
crw-rw-rw- 1 root root   1,   3 Dec  7 12:05 null
crw------- 1 root root  10, 144 Dec  7 12:05 nvram
crw------- 1 root root   1,   4 Dec  7 12:05 port
crw------- 1 root root 108,   0 Dec  7 12:05 ppp
crw-rw-rw- 1 root root   5,   2 Dec  7 12:05 ptmx
drwxr-xr-x 2 root root        0 Dec  7 12:05 pts
crw-rw-rw- 1 root root   1,   8 Dec  7 12:05 random
crw------- 1 root root  10, 242 Dec  7 12:05 rfkill
lrwxrwxrwx 1 root root        4 Dec  7 12:05 rtc -> rtc0
crw------- 1 root root 250,   0 Dec  7 12:05 rtc0
brw------- 1 root root   8,   0 Dec  7 12:05 sda
brw------- 1 root root   8,   4 Dec  7 12:05 sda4
brw------- 1 root root   8,   5 Dec  7 12:05 sda5
brw------- 1 root root   8,  16 Dec  7 12:05 sdb
crw------- 1 root root  21,   0 Dec  7 12:05 sg0
crw------- 1 root root  21,   1 Dec  7 12:05 sg1
drwxrwxrwt 2 root root       40 Dec  7 12:05 shm
crw------- 1 root root  10, 231 Dec  7 12:05 snapshot
drwxr-xr-x 2 root root       80 Dec  7 12:05 snd
crw-rw-rw- 1 root root   5,   0 Dec  7 12:05 tty
crw------- 1 root root   4,   0 Dec  7 12:05 tty0
crw------- 1 root root   4,   1 Dec  7 12:05 tty1
crw------- 1 root root   4,  10 Dec  7 12:05 tty10
crw------- 1 root root   4,  11 Dec  7 12:05 tty11
crw------- 1 root root   4,  12 Dec  7 12:05 tty12
crw------- 1 root root   4,  13 Dec  7 12:05 tty13
crw------- 1 root root   4,  14 Dec  7 12:05 tty14
crw------- 1 root root   4,  15 Dec  7 12:05 tty15
crw------- 1 root root   4,  16 Dec  7 12:05 tty16
crw------- 1 root root   4,  17 Dec  7 12:05 tty17
crw------- 1 root root   4,  18 Dec  7 12:05 tty18
crw------- 1 root root   4,  19 Dec  7 12:05 tty19
crw------- 1 root root   4,   2 Dec  7 12:05 tty2
crw------- 1 root root   4,  20 Dec  7 12:05 tty20
crw------- 1 root root   4,  21 Dec  7 12:05 tty21
crw------- 1 root root   4,  22 Dec  7 12:05 tty22
crw------- 1 root root   4,  23 Dec  7 12:05 tty23
crw------- 1 root root   4,  24 Dec  7 12:05 tty24
crw------- 1 root root   4,  25 Dec  7 12:05 tty25
crw------- 1 root root   4,  26 Dec  7 12:05 tty26
crw------- 1 root root   4,  27 Dec  7 12:05 tty27
crw------- 1 root root   4,  28 Dec  7 12:05 tty28
crw------- 1 root root   4,  29 Dec  7 12:05 tty29
crw------- 1 root root   4,   3 Dec  7 12:05 tty3
crw------- 1 root root   4,  30 Dec  7 12:05 tty30
crw------- 1 root root   4,  31 Dec  7 12:05 tty31
crw------- 1 root root   4,  32 Dec  7 12:05 tty32
crw------- 1 root root   4,  33 Dec  7 12:05 tty33
crw------- 1 root root   4,  34 Dec  7 12:05 tty34
crw------- 1 root root   4,  35 Dec  7 12:05 tty35
crw------- 1 root root   4,  36 Dec  7 12:05 tty36
crw------- 1 root root   4,  37 Dec  7 12:05 tty37
crw------- 1 root root   4,  38 Dec  7 12:05 tty38
crw------- 1 root root   4,  39 Dec  7 12:05 tty39
crw------- 1 root root   4,   4 Dec  7 12:05 tty4
crw------- 1 root root   4,  40 Dec  7 12:05 tty40
crw------- 1 root root   4,  41 Dec  7 12:05 tty41
crw------- 1 root root   4,  42 Dec  7 12:05 tty42
crw------- 1 root root   4,  43 Dec  7 12:05 tty43
crw------- 1 root root   4,  44 Dec  7 12:05 tty44
crw------- 1 root root   4,  45 Dec  7 12:05 tty45
crw------- 1 root root   4,  46 Dec  7 12:05 tty46
crw------- 1 root root   4,  47 Dec  7 12:05 tty47
crw------- 1 root root   4,  48 Dec  7 12:05 tty48
crw------- 1 root root   4,  49 Dec  7 12:05 tty49
crw------- 1 root root   4,   5 Dec  7 12:05 tty5
crw------- 1 root root   4,  50 Dec  7 12:05 tty50
crw------- 1 root root   4,  51 Dec  7 12:05 tty51
crw------- 1 root root   4,  52 Dec  7 12:05 tty52
crw------- 1 root root   4,  53 Dec  7 12:05 tty53
crw------- 1 root root   4,  54 Dec  7 12:05 tty54
crw------- 1 root root   4,  55 Dec  7 12:05 tty55
crw------- 1 root root   4,  56 Dec  7 12:05 tty56
crw------- 1 root root   4,  57 Dec  7 12:05 tty57
crw------- 1 root root   4,  58 Dec  7 12:05 tty58
crw------- 1 root root   4,  59 Dec  7 12:05 tty59
crw------- 1 root root   4,   6 Dec  7 12:05 tty6
crw------- 1 root root   4,  60 Dec  7 12:05 tty60
crw------- 1 root root   4,  61 Dec  7 12:05 tty61
crw------- 1 root root   4,  62 Dec  7 12:05 tty62
crw------- 1 root root   4,  63 Dec  7 12:05 tty63
crw------- 1 root root   4,   7 Dec  7 12:05 tty7
crw------- 1 root root   4,   8 Dec  7 12:05 tty8
crw------- 1 root root   4,   9 Dec  7 12:05 tty9
crw------- 1 root root   4,  64 Dec  7 12:05 ttyS0
crw------- 1 root root  10, 126 Dec  7 12:05 udmabuf
crw------- 1 root root  10, 239 Dec  7 12:05 uhid
crw------- 1 root root  10, 223 Dec  7 12:05 uinput
crw-rw-rw- 1 root root   1,   9 Dec  7 12:05 urandom
crw------- 1 root root 242,   0 Dec  7 12:05 usbmon0
crw------- 1 root root   7,   0 Dec  7 12:05 vcs
crw------- 1 root root   7,   1 Dec  7 12:05 vcs1
crw------- 1 root root   7, 128 Dec  7 12:05 vcsa
crw------- 1 root root   7, 129 Dec  7 12:05 vcsa1
crw------- 1 root root   7,  64 Dec  7 12:05 vcsu
crw------- 1 root root   7,  65 Dec  7 12:05 vcsu1
drwxr-xr-x 2 root root       60 Dec  7 12:05 vfio
crw------- 1 root root  10, 127 Dec  7 12:05 vga_arbiter
crw------- 1 root root  10, 137 Dec  7 12:05 vhci
crw-rw-rw- 1 root root  10, 238 Dec  7 12:05 vhost-net
crw-rw-rw- 1 root root  10, 241 Dec  7 12:05 vhost-vsock
drwxr-xr-x 2 root root       60 Dec  7 12:05 virtio-ports
crw------- 1 root root 237,   1 Dec  7 12:05 vport1p1
crw-rw-rw- 1 root root   1,   5 Dec  7 12:05 zero

/dev/block:
total 0
lrwxrwxrwx 1 root root 6 Dec  7 12:05 8:0 -> ../sda
lrwxrwxrwx 1 root root 6 Dec  7 12:05 8:16 -> ../sdb
lrwxrwxrwx 1 root root 7 Dec  7 12:05 8:4 -> ../sda4
lrwxrwxrwx 1 root root 7 Dec  7 12:05 8:5 -> ../sda5

/dev/bsg:
total 0
crw------- 1 root root 245, 0 Dec  7 12:05 2:0:0:0
crw------- 1 root root 245, 1 Dec  7 12:05 2:0:1:0

/dev/char:
total 0
lrwxrwxrwx 1 root root 18 Dec  7 12:05 10:125 -> ../cpu_dma_latency
lrwxrwxrwx 1 root root 10 Dec  7 12:05 10:126 -> ../udmabuf
lrwxrwxrwx 1 root root 14 Dec  7 12:05 10:127 -> ../vga_arbiter
lrwxrwxrwx 1 root root  8 Dec  7 12:05 10:144 -> ../nvram
lrwxrwxrwx 1 root root  8 Dec  7 12:05 10:183 -> ../hwrng
lrwxrwxrwx 1 root root  9 Dec  7 12:05 10:227 -> ../mcelog
lrwxrwxrwx 1 root root  7 Dec  7 12:05 10:229 -> ../fuse
lrwxrwxrwx 1 root root 11 Dec  7 12:05 10:231 -> ../snapshot
lrwxrwxrwx 1 root root 16 Dec  7 12:05 10:234 -> ../btrfs-control
lrwxrwxrwx 1 root root  9 Dec  7 12:05 10:235 -> ../autofs
lrwxrwxrwx 1 root root 17 Dec  7 12:05 10:236 -> ../mapper/control
lrwxrwxrwx 1 root root  9 Dec  7 12:05 10:242 -> ../rfkill
lrwxrwxrwx 1 root root 12 Dec  7 12:05 116:33 -> ../snd/timer
lrwxrwxrwx 1 root root 15 Dec  7 12:05 13:32 -> ../input/mouse0
lrwxrwxrwx 1 root root 15 Dec  7 12:05 13:33 -> ../input/mouse1
lrwxrwxrwx 1 root root 13 Dec  7 12:05 13:63 -> ../input/mice
lrwxrwxrwx 1 root root 15 Dec  7 12:05 13:64 -> ../input/event0
lrwxrwxrwx 1 root root 15 Dec  7 12:05 13:65 -> ../input/event1
lrwxrwxrwx 1 root root 15 Dec  7 12:05 13:66 -> ../input/event2
lrwxrwxrwx 1 root root  6 Dec  7 12:05 1:1 -> ../mem
lrwxrwxrwx 1 root root  7 Dec  7 12:05 1:11 -> ../kmsg
lrwxrwxrwx 1 root root  7 Dec  7 12:05 1:3 -> ../null
lrwxrwxrwx 1 root root  7 Dec  7 12:05 1:4 -> ../port
lrwxrwxrwx 1 root root  7 Dec  7 12:05 1:5 -> ../zero
lrwxrwxrwx 1 root root  7 Dec  7 12:05 1:7 -> ../full
lrwxrwxrwx 1 root root  9 Dec  7 12:05 1:8 -> ../random
lrwxrwxrwx 1 root root 10 Dec  7 12:05 1:9 -> ../urandom
lrwxrwxrwx 1 root root 12 Dec  7 12:05 202:0 -> ../cpu/0/msr
lrwxrwxrwx 1 root root 14 Dec  7 12:05 203:0 -> ../cpu/0/cpuid
lrwxrwxrwx 1 root root  6 Dec  7 12:05 21:0 -> ../sg0
lrwxrwxrwx 1 root root  6 Dec  7 12:05 21:1 -> ../sg1
lrwxrwxrwx 1 root root 11 Dec  7 12:05 237:1 -> ../vport1p1
lrwxrwxrwx 1 root root 10 Dec  7 12:05 242:0 -> ../usbmon0
lrwxrwxrwx 1 root root 14 Dec  7 12:05 245:0 -> ../bsg/2:0:0:0
lrwxrwxrwx 1 root root 14 Dec  7 12:05 245:1 -> ../bsg/2:0:1:0
lrwxrwxrwx 1 root root  7 Dec  7 12:05 250:0 -> ../rtc0
lrwxrwxrwx 1 root root 18 Dec  7 12:05 251:0 -> ../dma_heap/system
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:0 -> ../tty0
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:1 -> ../tty1
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:10 -> ../tty10
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:11 -> ../tty11
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:12 -> ../tty12
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:13 -> ../tty13
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:14 -> ../tty14
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:15 -> ../tty15
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:16 -> ../tty16
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:17 -> ../tty17
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:18 -> ../tty18
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:19 -> ../tty19
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:2 -> ../tty2
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:20 -> ../tty20
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:21 -> ../tty21
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:22 -> ../tty22
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:23 -> ../tty23
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:24 -> ../tty24
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:25 -> ../tty25
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:26 -> ../tty26
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:27 -> ../tty27
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:28 -> ../tty28
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:29 -> ../tty29
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:3 -> ../tty3
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:30 -> ../tty30
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:31 -> ../tty31
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:32 -> ../tty32
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:33 -> ../tty33
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:34 -> ../tty34
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:35 -> ../tty35
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:36 -> ../tty36
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:37 -> ../tty37
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:38 -> ../tty38
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:39 -> ../tty39
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:4 -> ../tty4
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:40 -> ../tty40
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:41 -> ../tty41
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:42 -> ../tty42
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:43 -> ../tty43
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:44 -> ../tty44
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:45 -> ../tty45
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:46 -> ../tty46
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:47 -> ../tty47
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:48 -> ../tty48
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:49 -> ../tty49
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:5 -> ../tty5
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:50 -> ../tty50
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:51 -> ../tty51
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:52 -> ../tty52
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:53 -> ../tty53
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:54 -> ../tty54
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:55 -> ../tty55
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:56 -> ../tty56
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:57 -> ../tty57
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:58 -> ../tty58
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:59 -> ../tty59
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:6 -> ../tty6
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:60 -> ../tty60
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:61 -> ../tty61
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:62 -> ../tty62
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:63 -> ../tty63
lrwxrwxrwx 1 root root  8 Dec  7 12:05 4:64 -> ../ttyS0
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:7 -> ../tty7
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:8 -> ../tty8
lrwxrwxrwx 1 root root  7 Dec  7 12:05 4:9 -> ../tty9
lrwxrwxrwx 1 root root  6 Dec  7 12:05 5:0 -> ../tty
lrwxrwxrwx 1 root root 10 Dec  7 12:05 5:1 -> ../console
lrwxrwxrwx 1 root root  7 Dec  7 12:05 5:2 -> ../ptmx
lrwxrwxrwx 1 root root  6 Dec  7 12:05 7:0 -> ../vcs
lrwxrwxrwx 1 root root  7 Dec  7 12:05 7:1 -> ../vcs1
lrwxrwxrwx 1 root root  7 Dec  7 12:05 7:128 -> ../vcsa
lrwxrwxrwx 1 root root  8 Dec  7 12:05 7:129 -> ../vcsa1
lrwxrwxrwx 1 root root  7 Dec  7 12:05 7:64 -> ../vcsu
lrwxrwxrwx 1 root root  8 Dec  7 12:05 7:65 -> ../vcsu1

/dev/cpu:
total 0
drwxr-xr-x 2 root root 80 Dec  7 12:05 0

/dev/cpu/0:
total 0
crw------- 1 root root 203, 0 Dec  7 12:05 cpuid
crw------- 1 root root 202, 0 Dec  7 12:05 msr

/dev/disk:
total 0
drwxr-xr-x 2 root root 120 Dec  7 12:05 by-id
drwxr-xr-x 2 root root 120 Dec  7 12:05 by-path
drwxr-xr-x 2 root root  80 Dec  7 12:05 by-uuid

/dev/disk/by-id:
total 0
lrwxrwxrwx 1 root root  9 Dec  7 12:05 scsi-0QEMU_QEMU_HARDDISK_drive-scsi0-0-0-0 -> ../../sda
lrwxrwxrwx 1 root root 10 Dec  7 12:05 scsi-0QEMU_QEMU_HARDDISK_drive-scsi0-0-0-0-part4 -> ../../sda4
lrwxrwxrwx 1 root root 10 Dec  7 12:05 scsi-0QEMU_QEMU_HARDDISK_drive-scsi0-0-0-0-part5 -> ../../sda5
lrwxrwxrwx 1 root root  9 Dec  7 12:05 scsi-0QEMU_QEMU_HARDDISK_drive-scsi0-0-1-0 -> ../../sdb

/dev/disk/by-path:
total 0
lrwxrwxrwx 1 root root  9 Dec  7 12:05 pci-0000:00:02.0-scsi-0:0:0:0 -> ../../sda
lrwxrwxrwx 1 root root 10 Dec  7 12:05 pci-0000:00:02.0-scsi-0:0:0:0-part4 -> ../../sda4
lrwxrwxrwx 1 root root 10 Dec  7 12:05 pci-0000:00:02.0-scsi-0:0:0:0-part5 -> ../../sda5
lrwxrwxrwx 1 root root  9 Dec  7 12:05 pci-0000:00:02.0-scsi-0:0:1:0 -> ../../sdb

/dev/disk/by-uuid:
total 0
lrwxrwxrwx 1 root root  9 Dec  7 12:05 59d489e9-11ba-4773-80e6-80c7b36cc2d9 -> ../../sdb
lrwxrwxrwx 1 root root 10 Dec  7 12:05 61ace01e43044aa4 -> ../../sda4

/dev/dma_heap:
total 0
crw------- 1 root root 251, 0 Dec  7 12:05 system

/dev/input:
total 0
drwxr-xr-x 2 root root    100 Dec  7 12:05 by-path
crw------- 1 root root 13, 64 Dec  7 12:05 event0
crw------- 1 root root 13, 65 Dec  7 12:05 event1
crw------- 1 root root 13, 66 Dec  7 12:05 event2
crw------- 1 root root 13, 63 Dec  7 12:05 mice
crw------- 1 root root 13, 32 Dec  7 12:05 mouse0
crw------- 1 root root 13, 33 Dec  7 12:05 mouse1

/dev/input/by-path:
total 0
lrwxrwxrwx 1 root root 9 Dec  7 12:05 platform-i8042-serio-0-event-kbd -> ../event0
lrwxrwxrwx 1 root root 9 Dec  7 12:05 platform-i8042-serio-1-event-mouse -> ../event1
lrwxrwxrwx 1 root root 9 Dec  7 12:05 platform-i8042-serio-1-mouse -> ../mouse0

/dev/mapper:
total 0
crw------- 1 root root 10, 236 Dec  7 12:05 control

/dev/net:
total 0
crw-rw-rw- 1 root root 10, 200 Dec  7 12:05 tun

/dev/pts:
total 0
c--------- 1 root root 5, 2 Dec  7 12:05 ptmx

/dev/shm:
total 0

/dev/snd:
total 0
crw-rw---- 1 root audio 116,  1 Dec  7 12:05 seq
crw-rw---- 1 root audio 116, 33 Dec  7 12:05 timer

/dev/vfio:
total 0
crw-rw-rw- 1 root root 10, 196 Dec  7 12:05 vfio

/dev/virtio-ports:
total 0
lrwxrwxrwx 1 root root 11 Dec  7 12:05 org.libguestfs.channel.0 -> ../vport1p1
+ cat /proc/mounts
/dev/root / ext2 rw,noatime 0 0
/proc /proc proc rw,relatime 0 0
/sys /sys sysfs rw,relatime 0 0
/dev /dev devtmpfs rw,relatime,size=613316k,nr_inodes=153329,mode=755,inode64 0 0
/dev/pts /dev/pts devpts rw,relatime,mode=600,ptmxmode=000 0 0
shmfs /dev/shm tmpfs rw,relatime,inode64 0 0
tmpfs /run tmpfs rw,nosuid,relatime,size=247816k,mode=755,inode64 0 0
+ cat /proc/mdstat
Personalities :
unused devices: <none>
+ lvm config
+ lvm pvs
+ lvm vgs
+ lvm lvs
+ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 brd 127.255.255.255 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
+ ip r
+ cat /etc/resolv.conf
cat: /etc/resolv.conf: No such file or directory
+ lsmod
Module                  Size  Used by
virtio_snd             36864  0
snd_pcm               139264  1 virtio_snd
snd_timer              49152  1 snd_pcm
snd                   114688  3 virtio_snd,snd_timer,snd_pcm
soundcore              16384  1 snd
crc8                   16384  0
crc7                   16384  0
crc64                  16384  0
crc4                   16384  0
crc_itu_t              16384  0
virtiofs               32768  0
fuse                  167936  1 virtiofs
virtio_vdpa            16384  0
vdpa                   20480  1 virtio_vdpa
virtio_mmio            16384  0
virtio_mem             36864  0
virtio_input           16384  0
virtio_dma_buf         16384  0
virtio_balloon         28672  0
virtio_scsi            28672  1
nd_pmem                24576  0
nd_btt                 32768  1 nd_pmem
virtio_net             65536  0
net_failover           24576  1 virtio_net
failover               16384  1 net_failover
virtio_crypto          28672  0
crypto_engine          16384  1 virtio_crypto
virtio_console         40960  0
virtio_bt              16384  0
bluetooth             671744  1 virtio_bt
rfkill                 36864  1 bluetooth
ecdh_generic           16384  1 bluetooth
virtio_blk             20480  0
libnvdimm             204800  2 nd_btt,nd_pmem
crc32_generic          16384  0
crct10dif_pclmul       16384  1
crc32c_intel           24576  1
crc32_pclmul           16384  0
+ date
Tue Dec  7 12:05:19 UTC 2021
+ echo -n 'clocksource: '
clocksource: + cat /sys/devices/system/clocksource/clocksource0/current_clocksource
kvm-clock
+ echo -n 'uptime: '
uptime: + cat /proc/uptime
1.00 0.14
+ cmd=guestfsd
++ grep -Eo 'guestfs_channel=[^[:space:]]+' /proc/cmdline
+ eval
+ test x '!=' x
+ test 1 = 1
+ cmd='guestfsd --verbose'
+ test '' = 1
+ false
+ test '' = 1
+ echo guestfsd --verbose
guestfsd --verbose
+ guestfsd --verbose
lvm_system_dir = /tmp/lvm
OCaml daemon loaded
commandrvf: stdout=y stderr=y flags=0x0
commandrvf: ls -1v /dev/disk/by-path
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sda
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sdb
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
trying to open virtio-serial channel '/dev/virtio-ports/org.libguestfs.channel.0'
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
libguestfs: recv_from_daemon: received GUESTFS_LAUNCH_FLAG
libguestfs: appliance is up
guestfsd: <= list_partitions (0x8) request length 40 bytes
command: ls '-1v' '/dev/disk/by-path'
command: ls returned 0
command: ls: stdout:
pci-0000:00:02.0-scsi-0:0:0:0
pci-0000:00:02.0-scsi-0:0:0:0-part4
pci-0000:00:02.0-scsi-0:0:0:0-part5
pci-0000:00:02.0-scsi-0:0:1:0
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sda
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sdb
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
guestfsd: => list_partitions (0x8) took 0.02 secs
guestfsd: <= vfs_type (0xc6) request length 56 bytes
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sda4
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: blkid '-c' '/dev/null' '-o' 'value' '-s' 'TYPE' '/dev/sda4'
command: blkid returned 0
command: blkid: stdout:
ufs
guestfsd: => vfs_type (0xc6) took 0.01 secs
guestfsd: <= vfs_type (0xc6) request length 56 bytes
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sda5
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: blkid '-c' '/dev/null' '-o' 'value' '-s' 'TYPE' '/dev/sda5'
command: blkid returned 0
command: blkid: stdout:
ufs
guestfsd: => vfs_type (0xc6) took 0.01 secs
guestfsd: <= inspect_os (0x1e0) request length 40 bytes
command: ls '-1v' '/dev/disk/by-path'
command: ls returned 0
command: ls: stdout:
pci-0000:00:02.0-scsi-0:0:0:0
pci-0000:00:02.0-scsi-0:0:0:0-part4
pci-0000:00:02.0-scsi-0:0:0:0-part5
pci-0000:00:02.0-scsi-0:0:1:0
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sda
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sdb
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: ls '-1v' '/dev/disk/by-path'
command: ls returned 0
command: ls: stdout:
pci-0000:00:02.0-scsi-0:0:0:0
pci-0000:00:02.0-scsi-0:0:0:0-part4
pci-0000:00:02.0-scsi-0:0:0:0-part5
pci-0000:00:02.0-scsi-0:0:1:0
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sda
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sdb
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: parted '-m' '-s' '--' '/dev/sda' 'unit' 'b' 'print'
command: parted returned 0
command: parted: stdout:
BYT;
/dev/sda:2147483648B:scsi:512:512:msdos:QEMU QEMU HARDDISK:;
4:65536B:2147481599B:2147416064B:::boot;
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
[    1.260295]  sda: sda4
[    1.260295]  sda4: <openbsd: sda5 >
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: parted '-m' '-s' '--' '/dev/sda' 'unit' 'b' 'print'
command: parted returned 0
command: parted: stdout:
BYT;
/dev/sda:2147483648B:scsi:512:512:msdos:QEMU QEMU HARDDISK:;
4:65536B:2147481599B:2147416064B:::boot;
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
[    1.319464]  sda: sda4
[    1.319464]  sda4: <openbsd: sda5 >
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: sfdisk '--help'
command: sfdisk returned 0
command: sfdisk: stdout:

Usage:
 sfdisk [options] <dev> [[-N] <part>]
 sfdisk [options] <command>

Display or manipulate a disk partition table.

Commands:
 -A, --activate <dev> [<part> ...] list or set bootable (P)MBR partitions
 -d, --dump <dev>                  dump partition table (usable for later input)
 -J, --json <dev>                  dump partition table in JSON format
 -g, --show-geometry [<dev> ...]   list geometry of all or specified devices
 -l, --list [<dev> ...]            list partitions of each device
 -F, --list-free [<dev> ...]       list unpartitioned free areas of each device
 -r, --reorder <dev>               fix partitions order (by start offset)
 -s, --show-size [<dev> ...]       list sizes of all or specified devices
 -T, --list-types                  print the recognized types (see -X)
 -V, --verify [<dev> ...]          test whether partitions seem correct
     --delete <dev> [<part> ...]   delete all or specified partitions

 --part-label <dev> <part> [<str>] print or change partition label
 --part-type <dev> <part> [<type>] print or change partition type
 --part-uuid <dev> <part> [<uuid>] print or change partition uuid
 --part-attrs <dev> <part> [<str>] print or change partition attributes

 --disk-id <dev> [<str>]           print or change disk label ID (UUID)
 --relocate <oper> <dev>           move partition header

Arguments:
 <dev>                     device (usually disk) path
 <part>                    partition number
 <type>                    partition type, GUID for GPT, hex for MBR

Options:
 -a, --append              append partitions to existing partition table
 -b, --backup              backup partition table sectors (see -O)
     --bytes               print SIZE in bytes rather than in human readable format
     --move-data[=<typescript>] move partition data after relocation (requires -N)
     --move-use-fsync      use fsync after each write when move data
 -f, --force               disable all consistency checking
     --color[=<when>]      colorize output (auto, always or never)
                             colors are enabled by default
     --lock[=<mode>]       use exclusive device lock (yes, no or nonblock)
 -N, --partno <num>        specify partition number
 -n, --no-act              do everything except write to device
     --no-reread           do not check whether the device is in use
     --no-tell-kernel      do not tell kernel about changes
 -O, --backup-file <path>  override default backup file name
 -o, --output <list>       output columns
 -q, --quiet               suppress extra info messages
 -w, --wipe <mode>         wipe signatures (auto, always or never)
 -W, --wipe-partitions <mode>  wipe signatures from new partitions (auto, always or never)
 -X, --label <name>        specify label type (dos, gpt, ...)
 -Y, --label-nested <name> specify nested label type (dos, bsd)

 -G, --show-pt-geometry    deprecated, alias to --show-geometry
 -L, --Linux               deprecated, only for backward compatibility
 -u, --unit S              deprecated, only sector unit is supported

 -h, --help                display this help
 -v, --version             display version

Available output columns:
 gpt: Device Start End Sectors Size Type Type-UUID Attrs Name UUID
 dos: Device Start End Sectors Cylinders Size Type Id Attrs Boot End-C/H/S
      Start-C/H/S
 bsd: Slice Start End Sectors Cylinders Size Type Bsize Cpg Fsize
 sgi: Device Start End Sectors Cylinders Size Type Id Attrs
 sun: Device Start End Sectors Cylinders Size Type Id Flags

For more details see sfdisk(8).
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: sfdisk '--part-type' '/dev/sda' '4'
command: sfdisk returned 0
command: sfdisk: stdout:
a6
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: fold-stdout-on-stderr sgdisk '/dev/sda' '-i' '4'
[    1.417876]  sda: sda4
[    1.417876]  sda4: <openbsd: sda5 >
command: sgdisk returned 0
command: sgdisk: stderr:

***************************************************************
Found invalid GPT and valid MBR; converting MBR to GPT format
in memory.
***************************************************************


Warning! Secondary partition table overlaps the last partition by
29 blocks!
Try reducing the partition table size by 116 entries.
(Use the 's' item on the experts' menu.)
Partition GUID code: 824CC7A0-36A8-11E3-890A-952519AD3F61 (OpenBSD disklabel)
Partition unique GUID: C22A7ACF-6086-440D-A81D-1A548D89A7E7
First sector: 128 (at 64.0 KiB)
Last sector: 4194299 (at 2.0 GiB)
Partition size: 4194172 sectors (2.0 GiB)
Attribute flags: 0000000000000000
Partition name: 'OpenBSD disklabel'
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: parted '-m' '-s' '--' '/dev/sda' 'unit' 'b' 'print'
command: parted returned 0
command: parted: stdout:
BYT;
/dev/sda:2147483648B:scsi:512:512:msdos:QEMU QEMU HARDDISK:;
4:65536B:2147481599B:2147416064B:::boot;
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
[    1.475427]  sda: sda4
[    1.475427]  sda4: <openbsd: sda5 >
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: parted '-m' '-s' '--' '/dev/sda' 'unit' 'b' 'print'
command: parted returned 0
command: parted: stdout:
BYT;
/dev/sda:2147483648B:scsi:512:512:msdos:QEMU QEMU HARDDISK:;
4:65536B:2147481599B:2147416064B:::boot;
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
[    1.523383]  sda: sda4
[    1.523383]  sda4: <openbsd: sda5 >
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
command: sfdisk '--part-type' '/dev/sda' '5'
command: sfdisk returned 1
command: sfdisk: stderr:
sfdisk: /dev/sda: partition 5: partition table contains only 4 partitions
ocaml_exn: 'inspect_os' raised 'Failure' exception
guestfsd: error: sfdisk exited with status 1: sfdisk: /dev/sda: partition 5: partition table contains only 4 partitions
guestfsd: => inspect_os (0x1e0) took 0.37 secs
virt-sysprep: error: libguestfs error: inspect_os: sfdisk exited with
status 1: sfdisk: /dev/sda: partition 5: partition table contains only 4
partitions

If reporting bugs, run virt-sysprep with debugging enabled and include the
complete output:

  virt-sysprep -v -x [...]
libguestfs: closing guestfs handle 0x55d6f8f85800 (state 2)
guestfsd: <= internal_autosync (0x11a) request length 40 bytes
umount-all: /proc/mounts: fsname=/dev/root dir=/ type=ext2 opts=rw,noatime freq=0 passno=0
umount-all: /proc/mounts: fsname=/proc dir=/proc type=proc opts=rw,relatime freq=0 passno=0
umount-all: /proc/mounts: fsname=/sys dir=/sys type=sysfs opts=rw,relatime freq=0 passno=0
umount-all: /proc/mounts: fsname=/dev dir=/dev type=devtmpfs opts=rw,relatime,size=613316k,nr_inodes=153329,mode=755,inode64 freq=0 passno=0
umount-all: /proc/mounts: fsname=/dev/pts dir=/dev/pts type=devpts opts=rw,relatime,mode=600,ptmxmode=000 freq=0 passno=0
umount-all: /proc/mounts: fsname=shmfs dir=/dev/shm type=tmpfs opts=rw,relatime,inode64 freq=0 passno=0
umount-all: /proc/mounts: fsname=tmpfs dir=/run type=tmpfs opts=rw,nosuid,relatime,size=247816k,mode=755,inode64 freq=0 passno=0
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sdb
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
commandrvf: stdout=n stderr=y flags=0x0
commandrvf: udevadm --debug settle -E /dev/sda
SELinux enabled state cached to: disabled
No filesystem is currently mounted on /sys/fs/cgroup.
Failed to determine unit we run in, ignoring: No data available
fsync /dev/sda
guestfsd: => internal_autosync (0x11a) took 0.02 secs
libguestfs: calling virDomainDestroy flags=0
libguestfs: command: run: rm
libguestfs: command: run: \ -rf /tmp/libguestfsNEXRYN
libguestfs: command: run: rm
libguestfs: command: run: \ -rf /tmp/libguestfsfiDy0R

@goneri
Copy link

goneri commented Dec 7, 2021

Yes, the GuestFS tools don't work properly with BSD system. @jbpratt you can try https://object-storage.public.mtl1.vexxhost.net/swift/v1/1dbafeefbd4f4c80864414a441e72dd2/bsd-cloud-image.org/openbsd-7.0-root-root.qcow2 login/pw are root/root .

We need to figure out why the meta-data disk is not mounted. It should be something like mount_cd9660 /dev/sd1a /mnt. sysctl hw.disknames will give you the list of the volume disks.

goneri added a commit to goneri/cloud-init that referenced this issue Dec 7, 2021
When the metadata is an ISO image and is exposed through a disk,
the device is called `/dev/sd?a` internally. For instance `/dev/sd1a`.

It can then be mounted with `mount_cd9660 /dev/sd1a /mnt`.

Metadata in the FAT32 format are exposed as `/dev/sd?i`.

With this change, we try to mount `/dev/sd?a` in addition to `/dev/sd?i`.

Closes: ContainerCraft/kmi#12
@jbpratt
Copy link
Collaborator Author

jbpratt commented Dec 7, 2021

Thank you, here is the output

# ls /mnt
# mount_cd9660 /dev/sd1a /mnt
# sysctl hw.disknames
hw.disknames=sd0:da4d7a4ffdb53171,sd1:
# ls /mnt
meta-data      network-config user-data

@goneri
Copy link

goneri commented Dec 7, 2021

Thanks! So my fix makes sense but I've also probably missed something else.

@goneri
Copy link

goneri commented Dec 7, 2021

Can you attach the logs? /var/log/cloud-init-output.log /var/log/cloud-init.log and the content of these files (meta-data, network-onfig and user-data).

@jbpratt
Copy link
Collaborator Author

jbpratt commented Dec 7, 2021

cloud-init.log https://termbin.com/bjxr
cloud-init-output.log https://termbin.com/ax2x

# cat /mnt/network-config
version: 2
ethernets:
  enp1s0:
    dhcp4: true
    dhcp6: true
    dhcp-identifier: mac
# cat /mnt/user-data
#cloud-config
hostname: openbsd-br0
ssh_pwauth: true
disable_root: true
chpasswd:
  list: |
     kc2user:kc2user
  expire: False
users:
  - name: kc2user
    shell: /bin/bash
    lock_passwd: false
    sudo: ['ALL=(ALL) NOPASSWD:ALL']
    groups: sudo,wheel
growpart:
  mode: auto
  devices: ['/']
  ignore_growroot_disabled: true
package_upgrade: true
packages:
  - vim
  - screenfetch
runcmd:
  - "screenfetch"
# cat /mnt/meta-data
{"instance-id":"openbsd-br0.kargo","local-hostname":"openbsd-br0"

goneri added a commit to goneri/cloud-init that referenced this issue Dec 9, 2021
When the metadata is an ISO image and is exposed through a disk,
the device is called `/dev/sd?a` internally. For instance `/dev/sd1a`.

It can then be mounted with `mount_cd9660 /dev/sd1a /mnt`.

Metadata in the FAT32 format are exposed as `/dev/sd?i`.

With this change, we try to mount `/dev/sd?a` in addition to `/dev/sd?i`.

Closes: ContainerCraft/kmi#12
goneri added a commit to goneri/cloud-init that referenced this issue Dec 9, 2021
When the metadata is an ISO image and is exposed through a disk,
the device is called `/dev/sd?a` internally. For instance `/dev/sd1a`.

It can then be mounted with `mount_cd9660 /dev/sd1a /mnt`.

Metadata in the FAT32 format are exposed as `/dev/sd?i`.

With this change, we try to mount `/dev/sd?a` in addition to `/dev/sd?i`.

Closes: ContainerCraft/kmi#12
TheRealFalcon pushed a commit to canonical/cloud-init that referenced this issue Dec 9, 2021
When the metadata is an ISO image and is exposed through a disk,
the device is called `/dev/sd?a` internally. For instance `/dev/sd1a`.

It can then be mounted with `mount_cd9660 /dev/sd1a /mnt`.

Metadata in the FAT32 format are exposed as `/dev/sd?i`.

With this change, we try to mount `/dev/sd?a` in addition to `/dev/sd?i`.

Closes: ContainerCraft/kmi#12
@jbpratt
Copy link
Collaborator Author

jbpratt commented Dec 11, 2021

latest PRs result in cloud-init successfully applying on boot. Thanks to @goneri for the effort.

@jbpratt
Copy link
Collaborator Author

jbpratt commented Dec 13, 2021

This can be closed once canonical/cloud-init#1149 is merged

@goneri
Copy link

goneri commented Dec 13, 2021

FYI, I've pushed an OpenBSD 7.0 image on https://bsd-cloud-image.org/ that include the patch.

@jbpratt
Copy link
Collaborator Author

jbpratt commented Dec 13, 2021

In that case, we can go ahead and close this. Thank you @goneri! 🎉

@jbpratt jbpratt closed this as completed Dec 13, 2021
balabit-sync pushed a commit to balabit-deps/balabit-os-9-cloud-init that referenced this issue Nov 15, 2022
cloud-init (22.3.4-0ubuntu1~22.04.1) jammy; urgency=medium

  * New upstream bugfix release. (LP: #1987318)
    + Release 22.3.4 (LP: #1986703)
    + Fix Oracle DS primary interface when using IMDS (#1757)
      (LP: #1989686)

cloud-init (22.3.3-0ubuntu1~22.04.1) jammy; urgency=medium

  * New upstream bugfix release. (LP: #1987318)
    + Release 22.3.3
    + Fix Oracle DS not setting subnet when using IMDS (#1735)
    + azure: define new attribute for pre-22.3 pickles (#1725)
    + sources/azure: ensure instance id is always correct (#1727)
      [Chris Patterson]

cloud-init (22.3-13-g70ce6442-0ubuntu1~22.04.1) jammy; urgency=medium

  * d/control: add python3-debconf to Depends and Build-Depends
  * d/cloud-init.lintian-overrides: lintian fixes:
    + Fix systemd-service-file-refers-to-unusual-wantedby-target format.
  * d/cloud-init.postinst
    + Lintian: Fix command-with-path-in-maintainer-script for grub-install.
  * d/source/lintian-overrides: lintian fixes:
    + silence binary-nmu-debian-revision-in-source bug:
      https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1014584
  * d/p/expire-on-hashed-users.patch:
    Add patch to ensure password expire doesn't apply to hashed users
  * drop the following cherry-picks now included:
    + cpick-a2e62738-Fix-cc_phone_home-requiring-tries-1500
  * New upstream snapshot. (LP: #1987318)
    + Fix v2 interface matching when no MAC
    + test: reduce number of network dependencies in flaky test (#1702)
    + docs: publish cc_ubuntu_autoinstall docs to rtd (#1696)
    + net: Fix EphemeraIPNetwork (#1697)
    + test: make ansible test work across older versions (#1691)
    + Networkd multi-address support/fix (#1685) [Teodor Garzdin]
    + make: drop broken targets (#1688)
    + net: Passthough v2 netconfigs in netplan systems (#1650)
    + NM ipv6 connection does not work on Azure and Openstack (#1616)
      [Emanuele Giuseppe Esposito]
    + Fix check_format_tip (#1679)
    + DataSourceVMware: fix var use before init (#1674) [Andrew Kutz]
    + rpm/copr: ensure RPM represents new clean.d dir artifacts (#1680)
    + test: avoid centos leaked check of /etc/yum.repos.d/epel-testing.repo
      (#1676)
    + Release 22.3 (#1662)
    + sources: obj.pkl cache should be written anyime get_data is run
      (#1669)
    + schema: drop release number from version file (#1664)
    + pycloudlib: bump to quiet azure HTTP info logs (#1668)
    + test: fix wireguard integration tests (#1666)
    + Github is deprecating the 18.04 runner starting 12.1 (#1665)
    + integration tests: Ensure one setup for all tests (#1661)
    + tests: ansible test fixes (#1660)
    + Prevent concurrency issue in test_webhook_hander.py (#1658)
    + Workaround net_setup_link race with udev (#1655)
    + test: drop erroneous lxd assertion, verify command succeeded (#1657)
    + Fix Chrony usage on Centos Stream (#1648) [Sven Haardiek]
    + sources/azure: handle network unreachable errors for saveable PPS
      (#1642) [Chris Patterson]
    + Return cc_set_hostname to PER_INSTANCE frequency (#1651)
    + test: Collect integration test time by default (#1638)
    + test: Drop forced package install hack in lxd integration test
      (#1649)
    + schema: Resolve user-data if --system given (#1644)
      [Alberto Contreras]
    + test: use fake filesystem to avoid file removal (#1647)
      [Alberto Contreras]
    + tox: Fix tip-flake8 and tip-mypy (#1635) [Alberto Contreras]
    + config: Add wireguard config module (#1570)
      [Fabian Lichtenegger-Lukas]
    + tests: can run without azure-cli, tests expect inactive ansible
      (#1643)
    + typing: Type UrlResponse.contents (#1633) [Alberto Contreras]
    + testing: fix references to `DEPRECATED.` (#1641)
      [Alberto Contreras]
    + ssh_util: Handle sshd_config.d folder [Alberto Contreras]
    + schema: Enable deprecations in cc_update_etc_hosts (#1631)
      [Alberto Contreras]
    + Add Ansible Config Module (#1579)
    + util: Support Idle process state in get_proc_ppid() (#1637)
    + schema: Enable deprecations in cc_growpart (#1628)
      [Alberto Contreras]
    + schema: Enable deprecations in cc_users_groups (#1627)
      [Alberto Contreras]
    + util: Fix error path and parsing in get_proc_ppid()
    + main: avoid downloading full contents cmdline urls (#1606)
    + schema: Enable deprecations in cc_scripts_vendor (#1629)
      [Alberto Contreras]
    + schema: Enable deprecations in cc_set_passwords (#1630)
      [Alberto Contreras]
    + sources/azure: add experimental support for preprovisioned os disks
      (#1622) [Chris Patterson]
    + Remove configobj a_to_u calls (#1632) [Stefano Rivera]
    + cc_debug: Drop this module (#1614) [Alberto Contreras]
    + schema: add aggregate descriptions in anyOf/oneOf (#1636)
    + testing: migrate test_sshutil to pytest (#1617) [Alberto Contreras]
    + testing: Fix test_ca_certs integration test (#1626)
      [Alberto Contreras]
    + testing: add support for pycloudlib's pro images (#1604)
      [Alberto Contreras]
    + testing: migrate test_cc_set_passwords to pytest (#1615)
      [Alberto Contreras]
    + network: add system_info network activator cloud.cfg overrides
      (#1619)
    + docs: Align git remotes with uss-tableflip setup (#1624)
      [Alberto Contreras]
    + testing: cover active config module checks (#1609)
      [Alberto Contreras]
    + lxd: lvm avoid thinpool when kernel module absent
    + lxd: enable MTU configuration in cloud-init
    + doc: pin doc8 to last passing version
    + cc_set_passwords fixes (#1590)
    + Modernise importer.py and type ModuleDetails (#1605)
      [Alberto Contreras]
    + config: Def activate_by_schema_keys for t-z (#1613)
      [Alberto Contreras]
    + config: define activate_by_schema_keys for p-r mods (#1611)
      [Alberto Contreras]
    + clean: add param to remove /etc/machine-id for golden image
      creation
    + config: define `activate_by_schema_keys` for a-f mods (#1608)
      [Alberto Contreras]
    + config: define activate_by_schema_keys for s mods (#1612)
      [Alberto Contreras]
    + sources/azure: reorganize tests for network config (#1586)
      [Chris Patterson]
    + config: Define activate_by_schema_keys for g-n mods (#1610)
      [Alberto Contreras]
    + meta-schema: add infra to skip inapplicable modules
      [Alberto Contreras]
    + sources/azure: don't set cfg["password"] for default user pw
      (#1592) [Chris Patterson]
    + schema: activate grub-dpkg deprecations (#1600) [Alberto Contreras]
    + docs: clarify user password purposes (#1593)
    + cc_lxd: Add btrfs and lvm lxd storage options (SC-1026) (#1585)
    + archlinux: Fix distro naming[1] (#1601) [Kristian Klausen]
    + cc_ubuntu_autoinstall: support live-installer autoinstall config
    + clean: allow third party cleanup scripts in /etc/cloud/clean.d
      (#1581)
    + sources/azure: refactor chassis asset tag handling (#1574)
      [Chris Patterson]
    + Add "netcho" as contributor (#1591) [Kaloyan Kotlarski]
    + testing: drop impish support (#1596) [Alberto Contreras]
    + black: fix missed formatting issue which landed in main (#1594)
    + bsd: Don't assume that root user is in root group (#1587)
    + docs: Fix comment typo regarding use of packages (#1582)
      [Peter Mescalchin]
    + Update govc command in VMWare walkthrough (#1576) [manioo8]
    + Update .github-cla-signers (#1588) [Daniel Mullins]
    + Rename the openmandriva user to omv (#1575)
      [Bernhard Rosenkraenzer]
    + sources/azure: increase read-timeout to 60 seconds for wireserver
      (#1571) [Chris Patterson]
    + Resource leak cleanup (#1556)
    + testing: remove appereances of FakeCloud (#1584)
      [Alberto Contreras]
    + Fix expire passwords for hashed passwords (#1577)
      [Sadegh Hayeri]
    + mounts: fix suggested_swapsize for > 64GB hosts (#1569)
      [Steven Stallion]
    + Update chpasswd schema to deprecate password parsing (#1517)
    + tox: Remove entries from default envlist (#1578)
    + tests: add test for parsing static dns for existing devices (#1557)
      [Jonas Konrad]
    + testing: port cc_ubuntu_advantage test to pytest (#1559)
      [Alberto Contreras]
    + Schema deprecation handling (#1549) [Alberto Contreras]
    + Enable pytest to run in parallel (#1568)
    + sources/azure: refactor ovf-env.xml parsing (#1550)
      [Chris Patterson]
    + schema: Force stricter validation (#1547)
    + ubuntu advantage config: http_proxy, https_proxy (#1512)
      [Fabian Lichtenegger-Lukas]
    + travis: Upgrade dist to focal [Alberto Contreras]
    + net: fix interface matching support (#1552)
    + Fuzz testing jsonchema (#1499) [Alberto Contreras]
    + testing: Wait for changed boot-id in test_status.py (#1548)
    + CI: Fix GH pinned-format jobs (#1558) [Alberto Contreras]
    + Typo fix (#1560) [Jaime Hablutzel]
    + tests: mock dns lookup that causes long timeouts (#1555)
    + tox: add unpinned env for do_format and check_format (#1554)
    + cc_ssh_import_id: Substitute deprecated warn (#1553)
      [Alberto Contreras]
    + Remove schema errors from log (#1551)
    + Update WebHookHandler to run as background thread (SC-456) (#1491)
    + testing: Don't run custom cloud dir test on Bionic (#1542)
    + bash completion: update schema command (#1543)
    + CI: add non-blocking run against the linters tip versions (#1531)
      [Paride Legovini]
    + Change groups within the users schema to support lists and strings
      (#1545) [RedKrieg]
    + make it clear which username should go in the contributing doc
      (#1546)
    + Pin setuptools for Travis (SC-1136) (#1540)
    + Fix LXD datasource crawl when BOOT enabled (#1537)
    + testing: Fix wrong path in dual stack test (#1538)
    + cloud-config: honor cloud_dir setting (#1523)
      [Alberto Contreras]
    + Add python3-debconf to pkg-deps.json Build-Depends (#1535)
      [Alberto Contreras]
    + redhat spec: udev/rules.d lives under /usr/lib on rhel-based
      systems (#1536)
    + tests/azure: add test coverage for DisableSshPasswordAuthentication
      (#1534) [Chris Patterson]
    + summary: Add david-caro to the cla signers (#1527) [David Caro]
    + Add support for OpenMandriva (https://openmandriva.org/) (#1520)
      [Bernhard Rosenkraenzer]
    + tests/azure: refactor ovf creation (#1533) [Chris Patterson]
    + Improve DataSourceOVF error reporting when script disabled (#1525)
      [rong]
    + tox: integration-tests-jenkins: softfail if only some test failed
      (#1528) [Paride Legovini]
    + CI: drop linters from Travis CI (moved to GH Actions) (#1530)
      [Paride Legovini]
    + sources/azure: remove unused encoding support for customdata
      (#1526) [Chris Patterson]
    + sources/azure: remove unused metadata captured when parsing ovf
      (#1524) [Chris Patterson]
    + sources/azure: remove dscfg parsing from ovf-env.xml (#1522)
      [Chris Patterson]
    + Remove extra space from ec2 dual stack crawl message (#1521)
    + tests/azure: use namespaces in generated ovf-env.xml documents
      (#1519) [Chris Patterson]
    + setup.py: adjust udev/rules default path (#1513)
      [Emanuele Giuseppe Esposito]
    + Add python3-deconf dependency (#1506) [Alberto Contreras]
    + Change match macadress param for network v2 config (#1518)
      [Henrique Caricatti Capozzi]
    + sources/azure: remove unused userdata property from ovf (#1516)
      [Chris Patterson]
    + sources/azure: minor refactoring to network config generation
      (#1497) [Chris Patterson]
    + net: Implement link-local ephemeral ipv6
    + Rename function to avoid confusion (#1501)
    + Fix cc_phone_home requiring 'tries' (#1500)
    + datasources: replace networking functions with stdlib and
      cloudinit.net code
    + Remove xenial references (#1472) [Alberto Contreras]
    + Oracle ds changes (#1474)
    + improve runcmd docs (#1498)
    + add 3.11-dev to Travis CI (#1493)
    + Only run github actions on pull request (#1496)
    + Fix integration test client creation (#1494) [Alberto Contreras]
    + tox: add link checker environment, fix links (#1480)
    + cc_ubuntu_advantage: Fix doc (#1487) [Alberto Contreras]
    + cc_yum_add_repo: Fix repo id canonicalization (#1489)
      [Alberto Contreras]
    + Add linitio as contributor in the project (#1488) [Kevin Allioli]
    + net-convert: use yaml.dump for debugging python NetworkState obj
      (#1484)
    + test_schema: no relative $ref URLs, replace $ref with local path
      (#1486)
    + cc_set_hostname: do not write "localhost" when no hostname is given
      (#1453) [Emanuele Giuseppe Esposito]
    + Update .github-cla-signers (#1478) [rong]
    + schema: write_files defaults, versions $ref full URL and add vscode
      (#1479)
    + docs: fix external links, add one more to the list (#1477)
    + doc: Document how to change module frequency (#1481)
    + tests: bump pycloudlib (#1482)
    + tests: bump pycloudlib pinned commit for kinetic Azure (#1476)
    + testing: fix test_status.py (#1475)
    + integration tests: If KEEP_INSTANCE = True, log IP (#1473)
    + Drop mypy excluded files (#1454) [Alberto Contreras]
    + Docs additions (#1470)
    + Add "formatting tests" to Github Actions
    + Remove unused arguments in function signature (#1471)
    + Changelog: correct errant classification of LP issues as GH (#1464)
    + Use Network-Manager and Netplan as default renderers for RHEL and
      Fedora (#1465) [Emanuele Giuseppe Esposito]

cloud-init (22.2-0ubuntu1~22.04.3) jammy; urgency=medium

  * d/cloud-init.postinst: redact previously leaked schema errors from logs
  * Remove schema errors from log (LP: #1978422) (CVE-2022-2084)

cloud-init (22.2-0ubuntu1~22.04.2) jammy; urgency=medium

  * cherry-pick a2e62738: Fix cc_phone_home requiring 'tries' (#1500)
    (LP: #1977952)

cloud-init (22.2-0ubuntu1~22.04.1) jammy; urgency=medium

  * d/control:
    - Build-Depends: add python3-responses and python3-pytest-mock for unittests
    - Suggests: add openssh-server and ssh-import-id
  * New upstream release. (LP: #1974235)
    - Release 22.2 (#1462)
    - Fix test due to caplog incompatibility (#1461) [Alberto Contreras]
    - Align rhel custom files with upstream (#1431)
      [Emanuele Giuseppe Esposito]
    - cc_write_files: Improve schema. (#1460) [Alberto Contreras]
    - cli: Redact files with permission errors in commands (#1440)
      [Alberto Contreras]
    - Improve cc_set_passwords. (#1456) [Alberto Contreras]
    - testing: make fake cloud-init wait actually wait (#1459)
    - Scaleway: Fix network configuration for netplan 0.102 and later (#1455)
      [Maxime Corbin]
    - Fix 'ephmeral' typos in disk names(#1452) [Mike Hucka]
    - schema: version schema-cloud-config-v1.json (#1424)
    - cc_modules: set default meta frequency value when no config available
      (#1457)
    - Log generic warning on non-systemd systems. (#1450) [Alberto Contreras]
    - cc_snap.maybe_install_squashfuse no longer needed in Bionic++. (#1448)
      [Alberto Contreras]
    - Drop support of *-sk keys in cc_ssh (#1451) [Alberto Contreras]
    - testing: Fix console_log tests (#1437)
    - tests: cc_set_passoword update for systemd, non-systemd distros  (#1449)
    - Fix bug in url_helper/dual_stack() logging (#1426)
    - schema: render schema paths from _CustomSafeLoaderWithMarks (#1391)
    - testing: Make integration tests kinetic friendly (#1441)
    - Handle error if SSH service no present. (#1422) [Alberto Contreras]
    - Fix network-manager activator availability and order (#1438)
    - sources/azure: remove reprovisioning marker (#1414) [Chris Patterson]
    - upstart: drop vestigial support for upstart (#1421)
    - testing: Ensure NoCloud detected in test (#1439)
    - Update .github-cla-signers kallioli [Kevin Allioli]
    - Consistently strip top-level network key (#1417)
    - testing: Fix LXD VM metadata test (#1430)
    - testing: Add NoCloud setup for NoCloud test (#1425)
    - Update linters and adapt code for compatibility (#1434) [Paride Legovini]
    - run-container: add support for LXD VMs (#1428) [Paride Legovini]
    - integration-reqs: bump pycloudlib pinned commit (#1427) [Paride Legovini]
    - Fix NoCloud docs (#1423)
    - Docs fixes (#1406)
    - docs: Add docs for module creation (#1415)
    - Remove cheetah from templater (#1416)
    - tests: verify_ordered_items fallback to re.escape if needed (#1420)
    - Misc module cleanup (#1418)
    - docs: Fix doc warnings and enable errors (#1419) [Alberto Contreras]
    - Refactor cloudinit.sources.NetworkConfigSource to enum (#1413)
      [Alberto Contreras]
    - Don't fail if IB and Ethernet devices 'collide' (#1411)
    - Use cc_* module meta definition over hardcoded vars (SC-888) (#1385)
    - Fix cc_rsyslog.py initialization (#1404) [Alberto Contreras]
    - Promote cloud-init schema from devel to top level subcommand (#1402)
    - mypy: disable missing imports warning for httpretty (#1412)
      [Chris Patterson]
    - users: error when home should not be created AND ssh keys provided
      [Jeffrey 'jf' Lim]
    - Allow growpart to resize encrypted partitions (#1316)
    - Fix typo in integration_test.rst (#1405) [Alberto Contreras]
    - cloudinit.net refactor: apply_network_config_names (#1388)
      [Alberto Contreras]
    - tests/azure: add fixtures for hardcoded paths (markers and data_dir)
      (#1399) [Chris Patterson]
    - testing: Add responses workaround for focal/impish (#1403)
    - cc_ssh_import_id: fix is_key_in_nested_dict to avoid early False
    - Fix ds-identify not detecting NoCloud seed in config (#1381)
    - sources/azure: retry dhcp for failed processes (#1401) [Chris Patterson]
    - Move notes about refactorization out of CONTRIBUTING.rst (#1389)
    - Shave ~8ms off generator runtime (#1387)
    - Fix provisioning dhcp timeout to 20 minutes (#1394) [Chris Patterson]
    - schema: module example strict testing fix seed_random
    - cc_set_hostname: examples small typo (perserve vs preserve)
      [Wouter Schoot]
    - sources/azure: refactor http_with_retries to remove **kwargs (#1392)
      [Chris Patterson]
    - declare dependency on ssh-import-id (#1334)
    - drop references to old dependencies and old centos script
    - sources/azure: only wait for primary nic to be attached during restore
      (#1378) [Anh Vo]
    - cc_ntp: migrated legacy schema to cloud-init-schema.json (#1384)
    - Network functions refactor and bugfixes (#1383)
    - schema: add JSON defs for modules cc_users_groups (#1379)
    - Fix doc typo (#1382) [Alberto Contreras]
    - Add support for dual stack IPv6/IPv4 IMDS to Ec2 (#1160)
    - Fix KeyError when rendering sysconfig IPv6 routes (#1380)
    - Return a namedtuple from subp() (#1376)
    - Mypy stubs and other tox maintenance (SC-920) (#1374)
    - Distro Compatibility Fixes (#1375)
    - Pull in Gentoo patches (#1372)
    - schema: add json defs for modules U-Z (#1360)
    - util: atomically update sym links to avoid Suppress FileNotFoundError
      when reading status (#1298) [Adam Collard]
    - schema: add json defs for modules scripts-timezone (SC-801) (#1365)
    - docs: Add first tutorial (SC-900) (#1368)
    - BUG 1473527: module ssh-authkey-fingerprints fails Input/output error…
      (#1340) [Andrew Lee]
    - add arch hosts template (#1371)
    - ds-identify: detect LXD for VMs launched from host with > 5.10 kernel
      (#1370)
    - Support EC2 tags in instance metadata (#1309) [Eduardo Dobay]
    - schema: add json defs for modules e-install (SC-651) (#1366)
    - Improve "(no_create_home|system): true" test (#1367) [Jeffrey 'jf' Lim]
    - Expose https_proxy env variable to ssh-import-id cmd (#1333)
      [Michael Rommel]
    - sources/azure: remove bind/unbind logic for hot attached nic (#1332)
      [Chris Patterson]
    - tox: add types-* packages to check_format env (#1362)
    - tests: python 3.10 is showing up in cloudimages (#1364)
    - testing: add additional mocks to test_net tests (#1356) [yangzz-97]
    - schema: add JSON schema for mcollective, migrator and mounts modules
      (#1358)
    - Honor system locale for RHEL (#1355) [Wei Shi]
    - doc: Fix typo in cloud-config-run-cmds.txt example (#1359) [Ali Shirvani]
    - ds-identify: also discover LXD by presence from DMI board_name = LXD
      (#1311)
    - black: bump pinned version to 22.3.0 to avoid click dependency issues
      (#1357)
    - Various doc fixes (#1330)
    - testing: Add missing is_FreeBSD mock to networking test (#1353)
    - Add --no-update to add-apt-repostory call (SC-880) (#1337)
    - schema: add json defs for modules K-L (#1321)
    - docs: Re-order readthedocs install (#1354)
    - Stop cc_ssh_authkey_fingerprints from ALWAYS creating home (#1343)
      [Jeffrey 'jf' Lim]
    - docs: add jinja2 pin (#1352)
    - Vultr: Use find_candidate_nics, use ipv6 dns (#1344) [eb3095]
    - sources/azure: move get_ip_from_lease_value out of shim (#1324)
      [Chris Patterson]
    - Fix cloud-init status --wait when no datasource found (#1349)
    - schema: add JSON defs for modules resize-salt (SC-654) (#1341)
    - Add myself as a future contributor (#1345) [Neal Gompa (ニール・ゴンパ)]
    - Update .github-cla-signers (#1342) [Jeffrey 'jf' Lim]
    - add Requires=cloud-init-hotplugd.socket in cloud-init-hotplugd.service
      file (#1335) [yangzz-97]
    - Fix sysconfig render when set-name is missing (#1327)
      [Andrew Kutz]
    - Refactoring helper funcs out of NetworkState (#1336) [Andrew Kutz]
    - url_helper: add tuple support for readurl timeout (#1328)
      [Chris Patterson]
    - Make fs labels match for ds-identify and docs (#1329)
    - Work around bug in LXD VM detection (#1325)
    - Remove redundant generator logs (#1318)
    - tox: set verbose flags for integration tests (#1323) [Chris Patterson]
    - net: introduce find_candidate_nics() (#1313) [Chris Patterson]
    - Revert "Ensure system_cfg read before ds net config on Oracle (#1174)"
      (#1326)
    - Add vendor_data2 support for ConfigDrive source (#1307) [cvstealth]
    - Make VMWare data source test host independent and expand testing (#1308)
      [Robert Schweikert]
    - Add json schemas for modules starting with P
    - sources/azure: remove lease file parsing (#1302) [Chris Patterson]
    - remove flaky test from ci (#1322)
    - ci: Switch to python 3.10 in Travis CI (#1320)
    - Better interface handling for Vultr, expect unexpected DHCP servers
      (#1297) [eb3095]
    - Remove unused init local artifact (#1315)
    - Doc cleanups (#1317)
    - docs improvements (#1312)
    - add support for jinja do statements, add unit test (#1314)
      [Paul Bruno]
    - sources/azure: prevent tight loops for DHCP retries (#1285)
      [Chris Patterson]
    - net/dhcp: surface type of DHCP lease failure to caller (#1276)
      [Chris Patterson]
    - Stop hardcoding systemctl location (#1278) [Robert Schweikert]
    - Remove python2 syntax from docs (#1310)
    - [tools/migrate-lp-user-to-github] Rename master branch to main (#1301)
      [Adam Collard]
    - redhat: Depend on "hostname" package (#1288) [Lubomir Rintel]
    - Add native NetworkManager support (#1224) [Lubomir Rintel]
    - Fix link in CLA check to point to contribution guide. (#1299)
      [Adam Collard]

cloud-init (22.1-14-g2e17a0d6-0ubuntu1~22.04.5) jammy; urgency=medium

  * d/p/cpick-be9389c6-Work-around-bug-in-LXD-VM-detection-1325:
    cherry-pick be9389c6: Work around bug in LXD VM detection (#1325)
  * d/p/cpick-30ccd51a-ds-identify-also-discover-LXD-by-presence-from-DMI:
    cherry-pick 30ccd51a: ds-identify: also discover LXD by presence
    from DMI
  * d/p/pick-e3307e4d-ds-identify-detect-LXD-for-VMs-launched-from-host-with:
    cherry-pick e3307e4d: ds-identify: detect LXD for VMs launched from
    host with > 5.10 kernel (LP: #1968085)

cloud-init (22.1-14-g2e17a0d6-0ubuntu1~22.04.4) jammy; urgency=medium

  * d/p/cpick-eee60329-Fix-cloud-init-status-wait-when-no-datasource-found:
    cherry-pick eee60329: Fix cloud-init status --wait when no datasource
    found (#1349)

cloud-init (22.1-14-g2e17a0d6-0ubuntu1~22.04.3) jammy; urgency=medium

  * d/patches: include the missing quilt patch from v. 22.04.2 upload
    - cpick-5e347d25-Revert-Ensure-system_cfg-read-before-ds-net-config-on

cloud-init (22.1-14-g2e17a0d6-0ubuntu1~22.04.2) jammy; urgency=medium

  * cherry-pick 156b927e: Revert "Ensure system_cfg read before ds
    net config on Oracle (#1174)" (#1326)

cloud-init (22.1-14-g2e17a0d6-0ubuntu1~22.04.1) jammy; urgency=medium

  * debian/apport-launcher.py: Fix string and whitespace formatting
  * New upstream snapshot.
    - check for existing symlink while force creating symlink (#1281)
      [Shreenidhi Shedi]
    - Do not silently ignore integer uid (#1280) (LP: #1875772)
    - tests: create a IPv4/IPv6 VPC in Ec2 integration tests (#1291)
    - Integration test fix ppa  (#1296)
    - tests: on official EC2. cloud-id actually startswith aws not ec2 (#1289)
    - test_ppa_source: accept both http and https URLs (#1292)
      [Paride Legovini]
    - Fix apt test on azure
    - add "lkundrak" as contributor [Lubomir Rintel]
    - Holmanb/integration test fix ppa (#1287)
    - Include missing subcommand in manpage (#1279)
    - Clean up artifacts from pytest, packaging, release with make clean
      (#1277)
    - sources/azure: ensure retries on IMDS request failure (#1271)
      [Chris Patterson]
    - sources/azure: removed unused saveable PPS paths (#1268)
      [Chris Patterson]

cloud-init (22.1-1-gb3d9acdd-0ubuntu1~22.04.1) jammy; urgency=medium

  * New upstream snapshot.
    - integration tests: fix Azure failures (#1269)
    - Release 22.1 (#1267) (LP: #1960939)
    - sources/azure: report ready in local phase (#1265) [Chris Patterson]
    - sources/azure: validate IMDS network configuration metadata (#1257)
      [Chris Patterson]
    - docs: Add more details to runcmd docs (#1266)
    - use PEP 589 syntax for TypeDict (#1253)
    - mypy: introduce type checking (#1254) [Chris Patterson]
    - Fix extra ipv6 issues, code reduction and simplification (#1243) [eb3095]
    - tests: when generating crypted password, generate in target env (#1252)
    - sources/azure: address mypy/pyright typing complaints (#1245)
      [Chris Patterson]
    - Docs for x-shellscript* userdata (#1260)
    - test_apt_security: azure platform has specific security URL overrides
      (#1263)

cloud-init (21.4-119-gdeb3ae82-0ubuntu1~22.04.1) jammy; urgency=medium

  * d/cloud-init.templates: Move LXD to back of datasource_list
  * New upstream snapshot.
    - tests: lsblk --json output changes mountpoint key to mountpoinst []
      (#1261)
    - mounts: fix mount opts string for ephemeral disk (#1250)
      [Chris Patterson]
    - Shell script handlers by freq (#1166) [Chris Lalos]
    - minor improvements to documentation (#1259) [Mark Esler]
    - cloud-id: publish /run/cloud-init/cloud-id-<cloud-type> files (#1244)
    - add "eslerm" as contributor (#1258) [Mark Esler]
    - sources/azure: refactor ssh key handling (#1248) [Chris Patterson]
    - bump pycloudlib (#1256)
    - sources/hetzner: Use EphemeralDHCPv4 instead of static configuration
      (#1251) [Markus Schade]
    - bump pycloudlib version (#1255) [Brett Holman]
    - Fix IPv6 netmask format for sysconfig (#1215) [Harald] (LP: #1959148)
    - sources/azure: drop debug print (#1249) [Chris Patterson]
    - tests: do not check instance.pull_file().ok() (#1246)
    - sources/azure: consolidate ephemeral DHCP configuration (#1229)
      [Chris Patterson]
    - cc_salt_minion freebsd fix for rc.conf (#1236) [Brett Holman]
    - sources/azure: fix metadata check in _check_if_nic_is_primary() (#1232)
      [Chris Patterson]
    - Add _netdev option to mount Azure ephemeral disk (#1213) [Eduardo Otubo]
    - testing: stop universally overwriting /etc/cloud/cloud.cfg.d (#1237)
    - Integration test changes (#1240)
    - Fix Gentoo Locales (#1205) [Brett Holman]
    - Add "slingamn" as contributor (#1235) [Shivaram Lingamneni]
    - integration: do not LXD bind mount /etc/cloud/cloud.cfg.d (#1234)
    - Integration testing docs and refactor (#1231)
    - vultr: Return metadata immediately when found (#1233) [eb3095]
    - spell check docs with spellintian (#1223) [Brett Holman]
    - docs: include upstream python version info (#1230)
    - Schema a d (#1211)
    - Move LXD to end ds-identify DSLIST (#1228) (LP: #1959118)
    - fix parallel tox execution (#1214) [Brett Holman]
    - sources/azure: refactor _report_ready_if_needed and _poll_imds (#1222)
      [Chris Patterson]
    - Do not support setting up archive.canonical.com as a source (#1219)
      [Steve Langasek] (LP: #1959343)
    - Vultr: Fix lo being used for DHCP, try next on cmd fail (#1208) [eb3095]
    - sources/azure: refactor _should_reprovision[_after_nic_attach]() logic
      (#1206) [Chris Patterson]
    - update ssh logs to show ssh private key gens pub and simplify code
      (#1221) [Steve Weber]
    - Remove mitechie from stale PR github action (#1217)
    - Include POST format in cc_phone_home docs (#1218) (LP: #1959149)
    - Add json parsing of ip addr show (SC-723) (#1210)
    - cc_rsyslog: fix typo in docstring (#1207) [Louis Sautier]
    - Update .github-cla-signers (#1204) [Chris Lalos]
    - sources/azure: drop unused case in _report_failure() (#1200)
      [Chris Patterson]
    - sources/azure: always initialize _ephemeral_dhcp_ctx on unpickle (#1199)
      [Chris Patterson]
    - Add support for gentoo templates and cloud.cfg (#1179) [vteratipally]
    - sources/azure: unpack ret tuple in crawl_metadata() (#1194)
      [Chris Patterson]
    - tests: focal caplog has whitespace indentation for multi-line logs
      (#1201)
    - Seek interfaces, skip dummy interface, fix region codes (#1192) [eb3095]
    - integration: test against the Ubuntu daily images (#1198)
      [Paride Legovini]
    - cmd: status and cloud-id avoid change in behavior for 'not run' (#1197)
    - tox: pass PYCLOUDLIB_* env vars into integration tests when present
      (#1196)
    - sources/azure: set ovf_is_accessible when OVF is read successfully
      (#1193) [Chris Patterson]
    - Enable OVF environment transport via ISO in example (#1195) [Megian]
    - sources/azure: consolidate DHCP variants to EphemeralDHCPv4WithReporting
      (#1190) [Chris Patterson]
    - Single JSON schema validation in early boot (#1175)
    - Add DatasourceOVF network-config propery to Ubuntu OVF example (#1184)
      [Megian]
    - testing: support pycloudlib config file (#1189)
    - Ensure system_cfg read before ds net config on Oracle (SC-720) (#1174)
      (LP: #1956788)
    - Test Optimization Proposal (SC-736) (#1188) [Brett Holman]
    - cli: cloud-id report not-run or disabled state as cloud-id (#1162)
    - Remove distutils usage (#1177) [Shreenidhi Shedi]
    - add .python-version to gitignore (#1186) [Brett Holman]
    - print error if datasource import fails (#1170)
      [Emanuele Giuseppe Esposito]
    - Add new config module to set keyboard layout (#1176)
      [maxnet] (LP: #1951593)
    - sources/azure: rename metadata_type -> MetadataType (#1181)
      [Chris Patterson]
    - Remove 3.5 and xenial support (SC-711) (#1167)
    - tests: mock LXD datasource detection in ds-identify on LXD containers
      (#1178)
    - pylint: silence errors on compat code for old jsonschema (#1172)
      [Paride Legovini]
    - testing: Add 3.10 Test Coverage (#1173) [Brett Holman]
    - Remove unittests from integration test job in travis (#1141)
      [Brett Holman]
    - Don't throw exceptions for empty cloud config (#1130) [Brett Holman]
    - bsd/resolv.d/ avoid duplicated entries (#1163) [Gonéri Le Bouder]
    - sources/azure: do not persist failed_desired_api_version flag (#1159)
      [Chris Patterson]
    - Update cc_ubuntu_advantage calls to assume-yes (#1158)
      [John Chittum] (LP: #1954842)
    - openbsd: properly restart the network on 7.0 (#1150) [Gonéri Le Bouder]
    - Add .git-blame-ignore-revs (#1161)
    - Adopt Black and isort (SC-700) (#1157)
    - Include dpkg frontend lock in APT_LOCK_FILES (#1153)
    - tests/cmd/query: fix test run as root and add coverage for defaults
      (#1156) [Chris Patterson] (LP: #1825027)
    - Schema processing changes (SC-676) (#1144)
    - Add dependency workaround for impish in bddeb (#1148) [Brett Holman]
    - netbsd: install new dep packages (#1151) [Gonéri Le Bouder]
    - find_devs_with_openbsd: ensure we return the last entry (#1149)
      [Gonéri Le Bouder]
    - sources/azure: remove unnecessary hostname bounce (#1143)
      [Chris Patterson]
    - find_devs/openbsd: accept ISO on disk (#1132)
      [Gonéri Le Bouder] (GH:
      https://github.com/ContainerCraft/kmi/issues/12)
    - Improve error log message when mount failed (#1140) [Ksenija Stanojevic]
    - add KsenijaS as a contributor (#1145) [Ksenija Stanojevic]
    - travis - don't run integration tests if no deb (#1139) [Brett Holman]
    - factor out function for getting top level directory of cloudinit (#1136)
      [Brett Holman]
    - testing: Add deterministic test id (#1138) [Brett Holman]
    - mock sleep() in azure test (#1137) [Brett Holman]
    - Add miraclelinux support (#1128) [Haruki TSURUMOTO]
    - docs: Make MACs lowercase in network config (#1135) (GH: #1876941)
    - Add Strict Metaschema Validation (#1101) [Brett Holman]
    - update dead link (#1133) [Brett Holman]
    - cloudinit/net: handle two different routes for the same ip (#1124)
      [Emanuele Giuseppe Esposito]
    - docs: pin mistune dependency (#1134)

cloud-init (21.4-25-g039c40f9-0ubuntu1~22.04.1) jammy; urgency=medium

  * New upstream snapshot.
    - Reorganize unit test locations under tests/unittests (#1126)
      [Brett Holman]
    - Fix exception when no activator found (#1129) (LP: #1948681)
    - jinja: provide and document jinja-safe key aliases in instance-data
      (SC-622) (#1123)
    - testing: Remove date from final_message test (SC-638) (#1127)
    - Move GCE metadata fetch to init-local (SC-502) (#1122)
    - Fix missing metadata routes for vultr (#1125) [eb3095]
    - cc_ssh_authkey_fingerprints.py: prevent duplicate messages on console
      (#1081) [dermotbradley]
    - sources/azure: remove unused remnants related to agent command (#1119)
      [Chris Patterson]
    - github: update PR template's contributing URL (#1120) [Chris Patterson]
    - docs: Rename HACKING.rst to CONTRIBUTING.rst (#1118)
    - testing: monkeypatch system_info call in unit tests (SC-533) (#1117)
    - Fix Vultr timeout and wait values (#1113) [eb3095]
    - lxd: add preference for LXD cloud-init.* config keys over user keys
      (#1108)
    - VMware: source /etc/network/interfaces.d/* on Debian
      [chengcheng-chcheng] (LP: #1950136)
    - Add cjp256 as contributor (#1109) [Chris Patterson]
    - integration_tests: Ensure log directory exists before symlinking to it
      (#1110)
    - testing: add growpart integration test (#1104) [Brett Holman]
    - integration_test: Speed up CI run time (#1111)
    - Some miscellaneous integration test fixes (SC-606) (#1103)
    - tests: specialize lxd_discovery test for lxd_vm vendordata (#1106)
    - Add convenience symlink to integration test output (#1105) [Brett Holman]
    - Fix for set-name bug in networkd renderer (#1100)
      [Andrew Kutz] (LP: #1949407)
    - Wait for apt lock (#1034) (LP: #1944611)
    - testing: stop chef test from running on openstack (#1102)
    - alpine.py: add options to the apk upgrade command (#1089) [dermotbradley]

cloud-init (21.4-0ubuntu1~22.04.1) jammy; urgency=medium

  * d/upstream/metadata: Change contact to James Falcon
  * d/cloud-init.templates: Add LXD to default datasource_list with
    translations
  * drop the following cherry-picks now included:
    + cpick-28e56d99-Azure-Retry-dhcp-on-timeouts-when-polling
    + cpick-e69a8874-Set-Azure-to-only-update-metadata-on-BOOT_NEW_INSTANCE
    + cpick-612e3908-Add-connectivity_url-to-Oracle-s-EphemeralDHCPv4-988
    + cpick-dc227869-Set-Azure-to-apply-networking-config-every-BOOT-1023
    + cpick-9c147e83-Allow-disabling-of-network-activation-SC-307-1048
  * New upstream release.
    - Release 21.4 (#1091) (LP: #1949405)
    - Azure: fallback nic needs to be reevaluated during reprovisioning
      (#1094) [Anh Vo]
    - azure: pps imds (#1093) [Anh Vo]
    - testing: Remove calls to 'install_new_cloud_init' (#1092)
    - Add LXD datasource (#1040)
    - Fix unhandled apt_configure case. (#1065) [Brett Holman]
    - Allow libexec for hotplug (#1088)
    - Add necessary mocks to test_ovf unit tests (#1087)
    - Remove (deprecated) apt-key (#1068) [Brett Holman] (LP: #1836336)
    - distros: Remove a completed "TODO" comment (#1086)
    - cc_ssh.py: Add configuration for controlling ssh-keygen output (#1083)
      [dermotbradley]
    - Add "install hotplug" module (SC-476) (#1069) (LP: #1946003)
    - hosts.alpine.tmpl: rearrange the order of short and long hostnames
      (#1084) [dermotbradley]
    - Add max version to docutils
    - cloudinit/dmi.py: Change warning to debug to prevent console display
      (#1082) [dermotbradley]
    - remove unnecessary EOF string in
      disable-sshd-keygen-if-cloud-init-active.conf (#1075) [Emanuele
      Giuseppe Esposito]
    - Add module 'write-files-deferred' executed in stage 'final' (#916)
      [Lucendio]
    - Bump pycloudlib to fix CI (#1080)
    - Remove pin in dependencies for jsonschema (#1078)
    - Add "Google" as possible system-product-name (#1077) [vteratipally]
    - Update Debian security suite for bullseye (#1076) [Johann Queuniet]
    - Leave the details of service management to the distro (#1074)
      [Andy Fiddaman]
    - Fix typos in setup.py (#1059) [Christian Clauss]
    - Update Azure _unpickle (SC-500) (#1067) (LP: #1946644)
    - cc_ssh.py: fix private key group owner and permissions (#1070)
      [Emanuele Giuseppe Esposito]
    - VMware: read network-config from ISO (#1066) [Thomas Weißschuh]
    - testing: mock sleep in gce unit tests (#1072)
    - CloudStack: fix data-server DNS resolution (#1004)
      [Olivier Lemasle] (LP: #1942232)
    - Fix unit test broken by pyyaml upgrade (#1071)
    - testing: add get_cloud function (SC-461) (#1038)
    - Inhibit sshd-keygen@.service if cloud-init is active (#1028)
      [Ryan Harper]
    - VMWARE: search the deployPkg plugin in multiarch dir (#1061)
      [xiaofengw-vmware] (LP: #1944946)
    - Fix set-name/interface DNS bug (#1058) [Andrew Kutz] (LP: #1946493)
    - Use specified tmp location for growpart (#1046) [jshen28]
    - .gitignore: ignore tags file for ctags users (#1057) [Brett Holman]
    - Allow comments in runcmd and report failed commands correctly (#1049)
      [Brett Holman] (LP: #1853146)
    - tox integration: pass the *_proxy, GOOGLE_*, GCP_* env vars (#1050)
      [Paride Legovini]
    - Allow disabling of network activation (SC-307) (#1048) (LP: #1938299)
    - renderer: convert relative imports to absolute (#1052) [Paride Legovini]
    - Support ETHx_IP6_GATEWAY, SET_HOSTNAME on OpenNebula (#1045)
      [Vlastimil Holer]
    - integration-requirements: bump the pycloudlib commit (#1047)
      [Paride Legovini]
    - Allow Vultr to set MTU and use as-is configs (#1037) [eb3095]
    - pin jsonschema in requirements.txt (#1043)
    - testing: remove cloud_tests (#1020)
    - Add andgein as contributor (#1042) [Andrew Gein]
    - Make wording for module frequency consistent (#1039) [Nicolas Bock]
    - Use ascii code for growpart (#1036) [jshen28]
    - Add jshen28 as contributor (#1035) [jshen28]
    - Skip test_cache_purged_on_version_change on Azure (#1033)
    - Remove invalid ssh_import_id from examples (#1031)
    - Cleanup Vultr support (#987) [eb3095]
    - docs: update cc_disk_setup for fs to raw disk (#1017)
    - HACKING.rst: change contact info to James Falcon (#1030)
    - tox: bump the pinned flake8 and pylint version (#1029)
      [Paride Legovini] (LP: #1944414)
    - Add retries to DataSourceGCE.py when connecting to GCE (#1005)
      [vteratipally]
    - Set Azure to apply networking config every BOOT (#1023)
    - Add connectivity_url to Oracle's EphemeralDHCPv4 (#988) (LP: #1939603)
    - docs: fix typo and include sudo for report bugs commands (#1022)
      [Renan Rodrigo] (LP: #1940236)
    - VMware: Fix typo introduced in #947 and add test (#1019) [PengpengSun]
    - Update IPv6 entries in /etc/hosts (#1021) [Richard Hansen] (LP: #1943798)
    - Integration test upgrades for the 21.3-1 SRU (#1001)
    - Add Jille to tools/.github-cla-signers (#1016) [Jille Timmermans]
    - Improve ug_util.py (#1013) [Shreenidhi Shedi]
    - Support openEuler OS (#1012) [zhuzaifangxuele]
    - ssh_utils.py: ignore when sshd_config options are not key/value pairs
      (#1007) [Emanuele Giuseppe Esposito]
    - Set Azure to only update metadata on BOOT_NEW_INSTANCE (#1006)
    - cc_update_etc_hosts: Use the distribution-defined path for the hosts
      file (#983) [Andy Fiddaman]
    - Add CloudLinux OS support (#1003) [Alexandr Kravchenko]
    - puppet config: add the start_agent option (#1002) [Andrew Bogott]
    - Fix `make style-check` errors (#1000) [Shreenidhi Shedi]
    - Make cloud-id copyright year (#991) [Andrii Podanenko]
    - Add support to accept-ra in networkd renderer (#999) [Shreenidhi Shedi]
    - Update ds-identify to pass shellcheck (#979) [Andrew Kutz]
    - Azure: Retry dhcp on timeouts when polling reprovisiondata (#998)
      [aswinrajamannar]

cloud-init (21.3-1-g6803368d-0ubuntu3) impish; urgency=medium

  * cherry-pick 9c147e83: Allow disabling of network activation (SC-307)
    (#1048) (LP: #1938299)
  * cherry-pick 612e3908: Add connectivity_url to Oracle's
    EphemeralDHCPv4 (#988) (LP: #1939603)
  * cherry-pick dc227869: Set Azure to apply networking config every BOOT
    (#1023)

cloud-init (21.3-1-g6803368d-0ubuntu2) impish; urgency=medium

  * cherry-pick 28e56d99: Azure: Retry dhcp on timeouts when polling
    reprovisiondata
  * cherry-pick e69a8874: Set Azure to only update metadata on
    BOOT_NEW_INSTANCE

cloud-init (21.3-1-g6803368d-0ubuntu1) impish; urgency=medium

  * New upstream snapshot.
    - testing: Fix ssh keys integration test (#992)
    - Release 21.3 (#993) (LP: #1940839)
    - Azure: During primary nic detection, check interface status continuously
      before rebinding again (#990) [aswinrajamannar]
    - Fix home permissions modified by ssh module (SC-338) (#984)
      (LP: #1940233)
    - Add integration test for sensitive jinja substitution (#986)
    - Ignore hotplug socket when collecting logs (#985) (LP: #1940235)
    - testing: Add missing mocks to test_vmware.py (#982)
    - add Zadara Edge Cloud Platform to the supported clouds list (#963)
      [sarahwzadara]
    - testing: skip upgrade tests on LXD VMs (#980)

cloud-init (21.2-69-g65607405-0ubuntu1) impish; urgency=medium

  * d/cloud-init.templates: Add VMware to default datasource_list
  * d/control: Add dependencies on python3-netifaces for vmware ds
  * New upstream snapshot.
    - Only invoke hotplug socket when functionality is enabled (#952)
    - Revert unnecesary lcase in ds-identify (#978) [Andrew Kutz]
    - cc_resolv_conf: fix typos (#969) [Shreenidhi Shedi]
    - Replace broken httpretty tests with mock (SC-324) (#973)
    - Azure: Check if interface is up after sleep when trying to bring it up
      (#972) [aswinrajamannar]
    - Update dscheck_VMware's rpctool check (#970) [Shreenidhi Shedi]
    - Azure: Logging the detected interfaces (#968) [Moustafa Moustafa]
    - Change netifaces dependency to 0.10.4 (#965) [Andrew Kutz]
    - Azure: Limit polling network metadata on connection errors (#961)
      [aswinrajamannar]
    - Update inconsistent indentation (#962) [Andrew Kutz]
    - cc_puppet: support AIO installations and more (#960) [Gabriel Nagy]
    - Add Puppet contributors to CLA signers (#964) [Noah Fontes]
    - Datasource for VMware (#953) [Andrew Kutz]
    - photon: refactor hostname handling and add networkd activator (#958)
      [sshedi]
    - Stop copying ssh system keys and check folder permissions (#956)
      [Emanuele Giuseppe Esposito]
    - testing: port remaining cloud tests to integration testing framework
      (SC-191) (#955)
    - generate contents for ovf-env.xml when provisioning via IMDS (#959)
      [Anh Vo]
    - Add support for EuroLinux 7 && EuroLinux 8 (#957) [Aleksander Baranowski]
    - Implementing device_aliases as described in docs (#945)
      [Mal Graty] (LP: #1867532)
    - testing: fix test_ssh_import_id.py (#954)
    - Add ability to manage fallback network config on PhotonOS (#941) [sshedi]
    - Add VZLinux support (#951) [eb3095]
    - VMware: add network-config support in ovf-env.xml (#947) [PengpengSun]
    - Update pylint to v2.9.3 and fix the new issues it spots (#946)
      [Paride Legovini]
    - Azure: mount default provisioning iso before try device listing (#870)
      [Anh Vo]
    - Document known hotplug limitations (#950)

cloud-init (21.2-43-g184c836a-0ubuntu1) impish; urgency=medium

  * New upstream snapshot.
    - Initial hotplug support (#936)
    - Fix MIME policy failure on python version upgrade (#934)
    - run-container: fixup the centos repos baseurls when using http_proxy
      (#944) [Paride Legovini]
    - tools: add support for building rpms on rocky linux (#940)
    - ssh-util: allow cloudinit to merge all ssh keys into a custom user
      file, defined in AuthorizedKeysFile (#937) [Emanuele Giuseppe Esposito]
      (LP: #1911680)
    - VMware: new "allow_raw_data" switch (#939) [xiaofengw-vmware]
    - bump pycloudlib version (#935)
    - add renanrodrigo as a contributor (#938) [Renan Rodrigo]
    - testing: simplify test_upgrade.py (#932)
    - freebsd/net_v1 format: read MTU from root (#930) [Gonéri Le Bouder]
    - Add new network activators to bring up interfaces (#919)
    - Detect a Python version change and clear the cache (#857)
      [Robert Schweikert]
    - cloud_tests: fix the Impish release name (#931) [Paride Legovini]
    - Removed distro specific network code from Photon (#929) [sshedi]
    - Add support for VMware PhotonOS (#909) [sshedi]
    - cloud_tests: add impish release definition (#927) [Paride Legovini]
    - docs: fix stale links rename master branch to main (#926)
    - Fix DNS in NetworkState (SC-133) (#923)
    - tests: Add 'adhoc' mark for integration tests (#925)
    - Fix the spelling of "DigitalOcean" (#924) [Mark Mercado]
    - Small Doc Update for ReportEventStack and Test (#920) [Mike Russell]
    - Replace deprecated collections.Iterable with abc replacement (#922)
      (LP: #1932048)
    - testing: OCI availability domain is now required (SC-59) (#910)
    - add DragonFlyBSD support (#904) [Gonéri Le Bouder]
    - Use instance-data-sensitive.json in jinja templates (SC-117) (#917)
      (LP: #1931392)
    - doc: Update NoCloud docs stating required files (#918) (LP: #1931577)
    - build-on-netbsd: don't pin a specific py3 version (#913)
      [Gonéri Le Bouder]
    - - Create the log file with 640 permissions (#858) [Robert Schweikert]
    - Allow braces to appear in dhclient output (#911) [eb3095]
    - Docs: Replace all freenode references with libera (#912)
    - openbsd/net: flush the route table on net restart (#908)
      [Gonéri Le Bouder]
    - Add Rocky Linux support to cloud-init (#906) [Louis Abel]
    - Add "esposem" as contributor (#907) [Emanuele Giuseppe Esposito]
    - Add integration test for #868 (#901)
    - Added support for importing keys via primary/security mirror clauses
      (#882) [Paul Goins] (LP: #1925395)
    - [examples] config-user-groups expire in the future (#902)
      [Geert Stappers]
    - BSD: static network, set the mtu (#894) [Gonéri Le Bouder]
    - Add integration test for lp-1920939 (#891)
    - Fix unit tests breaking from new httpretty version (#903)
    - Allow user control over update events (#834)

cloud-init (21.2-3-g899bfaa9-0ubuntu2) impish; urgency=medium

  * d/po/templates.pot: refresh with debconf-updatepo

cloud-init (21.2-3-g899bfaa9-0ubuntu1) impish; urgency=medium

  * drop the following cherry-picks now included:
    + cpick-83f6bbfb-Fix-unpickle-for-source-paths-missing-run_dir-863
    + cpick-d132356c-fix-error-on-upgrade-caused-by-new-vendordata2
  * New upstream snapshot.
    - Update test characters in substitution unit test (#893)
    - cc_disk_setup.py: remove UDEVADM_CMD definition as not used (#886)
      [dermotbradley]
    - Add AlmaLinux OS support (#872) [Andrew Lukoshko]
    - Release 21.2 (#890) (LP: #1927254)
    - Add \r\n check for SSH keys in Azure (#889)
    - Revert "Add support to resize rootfs if using LVM (#721)" (#887)
      (LP: #1922742)
    - Add Vultaire as contributor (#881) [Paul Goins]
    - Azure: adding support for consuming userdata from IMDS (#884) [Anh Vo]
    - test_upgrade: modify test_upgrade_package to run for more sources (#883)
    - Fix chef module run failure when chef_license is set (#868) [Ben Hughes]
    - Azure: Retry net metadata during nic attach for non-timeout errs (#878)
      [aswinrajamannar]
    - Azure: Retrieve username and hostname from IMDS (#865) [Thomas Stringer]
    - Azure: eject the provisioning iso before reporting ready (#861) [Anh Vo]
    - Use `partprobe` to re-read partition table if available (#856)
      [Nicolas Bock] (LP: #1920939)
    - fix error on upgrade caused by new vendordata2 attributes (#869)
      (LP: #1922739)
    - add prefer_fqdn_over_hostname config option (#859)
      [hamalq] (LP: #1921004)
    - Emit dots on travis to avoid timeout (#867)
    - doc: Replace remaining references to user-scripts as a config module
      (#866) [Ryan Harper]
    - azure: Removing ability to invoke walinuxagent (#799) [Anh Vo]
    - Add Vultr support (#827) [David Dymko]
    - Fix unpickle for source paths missing run_dir (#863)
      [lucasmoura] (LP: #1899299)
    - sysconfig: use BONDING_MODULE_OPTS on SUSE (#831) [Jens Sandmann]
    - bringup_static_routes: fix gateway check (#850) [Petr Fedchenkov]
    - add hamalq user (#860) [hamalq]
    - Add support to resize rootfs if using LVM (#721)
      [Eduardo Otubo] (LP: #1799953)
    - Fix mis-detecting network configuration in initramfs cmdline (#844)
      (LP: #1919188)
    - tools/write-ssh-key-fingerprints: do not display empty header/footer
      (#817) [dermotbradley]
    - Azure helper: Ensure Azure http handler sleeps between retries (#842)
      [Johnson Shi]
    - Fix chef apt source example (#826) [timothegenzmer]

cloud-init (21.1-19-gbad84ad4-0ubuntu3) hirsute; urgency=medium

  * cherry-pick 83f6bbfb: Fix unpickle for source paths missing run_dir
    (#863) (LP: #1899299)
  * cherry-pick d132356c: fix error on upgrade caused by new vendordata2
    attributes (LP: #1922739)

cloud-init (21.1-19-gbad84ad4-0ubuntu2) hirsute; urgency=medium

  * debian/cloud-init.templates: enable UpCloud by default

cloud-init (21.1-19-gbad84ad4-0ubuntu1) hirsute; urgency=medium

  * d/cloud-init.postinst: Change output log permissions on upgrade
    (LP: #1918303)
  * New upstream snapshot.
    - .travis.yml: generate an SSH key before running tests (#848)
    - write passwords only to serial console, lock down cloud-init-output.log
      (#847) (LP: #1918303)
    - Fix apt default integration test (#845)
    - integration_tests: bump pycloudlib dependency (#846)
    - commit f35181fa970453ba6c7c14575b12185533391b97 [eb3095]
    - archlinux: Fix broken locale logic (#841)
      [Kristian Klausen] (LP: #1402406)
    - Integration test for #783 (#832)
    - integration_tests: mount more paths IN_PLACE (#838)
    - Fix requiring device-number on EC2 derivatives (#836) (LP: #1917875)
    - Remove the vi comment from the part-handler example (#835)
    - net: exclude OVS internal interfaces in get_interfaces (#829)
      (LP: #1912844)
    - tox.ini: pass OS_* environment variables to integration tests (#830)
    - integration_tests: add OpenStack as a platform (#804)
    - Add flexibility to IMDS api-version (#793) [Thomas Stringer]
    - Fix the TestApt tests using apt-key on Xenial and Hirsute (#823)
      [Paride Legovini] (LP: #1916629)
    - doc: remove duplicate "it" from nocloud.rst (#825) [V.I. Wood]
    - archlinux: Use hostnamectl to set the transient hostname (#797)
      [Kristian Klausen]
    - cc_keys_to_console.py: Add documentation for recently added config key
      (#824) [dermotbradley]
    - Update cc_set_hostname documentation (#818) [Toshi Aoyama]

cloud-init (21.1-0ubuntu1) hirsute; urgency=medium

  * New upstream release.
    - Release 21.1 (#820) (LP: #1916540)
    - Azure: Support for VMs without ephemeral resource disks. (#800)
      [Johnson Shi] (LP: #1901011)
    - cc_keys_to_console: add option to disable key emission (#811)
      [Michael Hudson-Doyle] (LP: #1915460)
    - integration_tests: introduce lxd_use_exec mark (#802)
    - azure: case-insensitive UUID to avoid new IID during kernel upgrade
      (#798) (LP: #1835584)
    - stale.yml: don't ask submitters to reopen PRs (#816)
    - integration_tests: fix use of SSH agent within tox (#815)
    - integration_tests: add UPGRADE CloudInitSource (#812)
    - integration_tests: use unique MAC addresses for tests (#813)
    - Update .gitignore (#814)
    - Port apt cloud_tests to integration tests (#808)
    - integration_tests: fix test_gh626 on LXD VMs (#809)
    - Fix attempting to decode binary data in test_seed_random_data test (#806)
    - Remove wait argument from tests with session_cloud calls (#805)
    - Datasource for UpCloud (#743) [Antti Myyrä]
    - test_gh668: fix failure on LXD VMs (#801)
    - openstack: read the dynamic metadata group vendor_data2.json (#777)
      [Andrew Bogott] (LP: #1841104)
    - includedir in suoders can be prefixed by "arroba" (#783)
      [Jordi Massaguer Pla]

cloud-init (20.4.1-79-g71564dce-0ubuntu1) hirsute; urgency=medium

  * New upstream snapshot.
    - Release 20.4.1 (LP: #1911680)
    - [VMware] change default max wait time to 15s (#774) [xiaofengw-vmware]
    - Revert integration test associated with reverted #586 (#784)
    - Add jordimassaguerpla as contributor (#787) [Jordi Massaguer Pla]
    - Add Rick Harding to CLA signers (#792) [Rick Harding]
    - HACKING.rst: add clarifying note to LP CLA process section (#789)
    - Stop linting cloud_tests (#791)
    - cloud-tests: update cryptography requirement (#790) [Joshua Powers]
    - Remove 'remove-raise-on-failure' calls from integration_tests (#788)
    - Use more cloud defaults in integration tests (#757)
    - Adding self to cla signers (#776) [Andrew Bogott]
    - doc: avoid two warnings (#781) [Dan Kenigsberg]
    - Use proper spelling for Red Hat (#778) [Dan Kenigsberg]

cloud-init (20.4-66-gad23441d-0ubuntu1) hirsute; urgency=medium

  * New upstream snapshot.
    - Add antonyc to .github-cla-signers (#747) [Anton Chaporgin]
    - integration_tests: log image serial if available (#772)
    - Revert "ssh_util: handle non-default AuthorizedKeysFile config (#586)"
      (#775) (LP: #1911680)
    - [VMware] Support cloudinit raw data feature (#691) [xiaofengw-vmware]
    - net: Fix static routes to host in eni renderer (#668) [Pavel Abalikhin]
    - .travis.yml: don't run cloud_tests in CI (#756)
    - test_upgrade: add some missing commas (#769)
    - cc_seed_random: update documentation and fix integration test (#771)
      (LP: #1911227)
    - Fix test gh-632 test to only run on NoCloud (#770) (LP: #1911230)
    - archlinux: fix package upgrade command handling (#768) [Bao Trinh]
    - integration_tests: add integration test for LP: #1910835 (#761)

cloud-init (20.4-55-g4f62ae8d-0ubuntu1) hirsute; urgency=medium

  * New upstream snapshot.
    - Fix regression with handling of IMDS ssh keys (#760) [Thomas Stringer]
    - integration_tests: log cloud-init version in SUT (#758)
    - Add ajmyyra as contributor (#742) [Antti Myyrä]
    - net_convert: add some missing help text (#755)
    - Missing IPV6_AUTOCONF=no to render sysconfig dhcp6 stateful on RHEL
      (#753) [Eduardo Otubo]
    - doc: document missing IPv6 subnet types (#744) [Antti Myyrä]
    - Add example configuration for datasource `AliYun` (#751) [Xiaoyu Zhong]
    - integration_tests: add SSH key selection settings (#754)
    - fix a typo in man page cloud-init.1 (#752) [Amy Chen]
    - network-config-format-v2.rst: add Netplan Passthrough section (#750)
    - stale: re-enable post holidays (#749)
    - integration_tests: port ca_certs tests from cloud_tests (#732)
    - Azure: Add telemetry for poll IMDS (#741) [Johnson Shi]
    - doc: move testing section from HACKING to its own doc (#739)
    - No longer allow integration test failures on travis (#738)
    - stale: fix error in definition (#740)
    - integration_tests: set log-cli-level to INFO by default (#737)
    - PULL_REQUEST_TEMPLATE.md: use backticks around commit message (#736)
    - stale: disable check for holiday break (#735)
    - integration_tests: log the path we collect logs into (#733)
    - .travis.yml: add (most) supported Python versions to CI (#734)
    - integration_tests: fix IN_PLACE CLOUD_INIT_SOURCE (#731)
    - cc_ca_certs: add RHEL support (#633) [cawamata]
    - Azure: only generate config for NICs with addresses (#709)
      [Thomas Stringer]
    - doc: fix CloudStack configuration example (#707) [Olivier Lemasle]
    - integration_tests: restrict test_lxd_bridge appropriately (#730)
    - Add integration tests for CLI functionality (#729)
    - Integration test for gh-626 (#728)
    - Some test_upgrade fixes (#726)
    - Ensure overriding test vars with env vars works for booleans (#727)
    - integration_tests: port lxd_bridge test from cloud_tests (#718)
    - Integration test for gh-632. (#725)
    - Integration test for gh-671 (#724)
    - integration-requirements.txt: bump pycloudlib commit (#723)
    - Drop unnecessary shebang from cmd/main.py (#722) [Eduardo Otubo]
    - Integration test for LP: #1813396 and #669 (#719)
    - integration_tests: include timestamp in log output (#720)
    - integration_tests: add test for LP: #1898997 (#713)
    - Add integration test for power_state_change module (#717)
    - Update documentation for network-config-format-v2 (#701) [ggiesen]
    - sandbox CA Cert tests to not require ca-certificates (#715)
      [Eduardo Otubo]
    - Add upgrade integration test (#693)
    - Integration test for 570 (#712)
    - Add ability to keep snapshotted images in integration tests (#711)
    - Integration test for pull #586 (#706)
    - integration_tests: introduce skipping of tests by OS (#702)
    - integration_tests: introduce IntegrationInstance.restart (#708)
    - Add lxd-vm to list of valid integration test platforms (#705)
    - Adding BOOTPROTO = dhcp to render sysconfig dhcp6 stateful on RHEL
      (#685) [Eduardo Otubo]
    - Delete image snapshots created for integration tests (#682)
    - Parametrize ssh_keys_provided integration test (#700) [lucasmoura]
    - Drop use_sudo attribute on IntegrationInstance (#694) [lucasmoura]
    - cc_apt_configure: add riscv64 as a ports arch (#687)
      [Dimitri John Ledkov]
    - cla: add xnox (#692) [Dimitri John Ledkov]
    - Collect logs from integration test runs (#675)

cloud-init (20.4-0ubuntu2) hirsute; urgency=medium

  * d/cloud-init.manpages: include upstream manpages in package (LP: #1908548)

cloud-init (20.4-0ubuntu1) hirsute; urgency=medium

  * d/control: add gnupg to Recommends as cc_apt_configure requires it to be
    installed for some operations.
  * New upstream release.
    - Release 20.4 (#686) [James Falcon] (LP: #1905440)
    - tox: avoid tox testenv subsvars for xenial support (#684)
    - Ensure proper root permissions in integration tests (#664) [James Falcon]
    - LXD VM support in integration tests (#678) [James Falcon]
    - Integration test for fallocate falling back to dd (#681) [James Falcon]
    - .travis.yml: correctly integration test the built .deb (#683)
    - Ability to hot-attach NICs to preprovisioned VMs before reprovisioning
      (#613) [aswinrajamannar]
    - Support configuring SSH host certificates. (#660) [Jonathan Lung]
    - add integration test for LP: #1900837 (#679)
    - cc_resizefs on FreeBSD: Fix _can_skip_ufs_resize (#655)
      [Mina Galić] (LP: #1901958, #1901958)
    - DataSourceAzure: push dmesg log to KVP (#670) [Anh Vo]
    - Make mount in place for tests work (#667) [James Falcon]
    - integration_tests: restore emission of settings to log (#657)
    - DataSourceAzure: update password for defuser if exists (#671) [Anh Vo]
    - tox.ini: only select "ci" marked tests for CI runs (#677)
    - Azure helper: Increase Azure Endpoint HTTP retries (#619) [Johnson Shi]
    - DataSourceAzure: send failure signal on Azure datasource failure (#594)
      [Johnson Shi]
    - test_persistence: simplify VersionIsPoppedFromState (#674)
    - only run a subset of integration tests in CI (#672)
    - cli: add --system param to allow validating system user-data on a
      machine (#575)
    - test_persistence: add VersionIsPoppedFromState test (#673)
    - introduce an upgrade framework and related testing (#659)
    - add --no-tty option to gpg (#669) [Till Riedel] (LP: #1813396)
    - Pin pycloudlib to a working commit (#666) [James Falcon]
    - DataSourceOpenNebula: exclude SRANDOM from context output (#665)
    - cloud_tests: add hirsute release definition (#662)
    - split integration and cloud_tests requirements (#652)
    - faq.rst: add warning to answer that suggests running `clean` (#661)
    - Fix stacktrace in DataSourceRbxCloud if no metadata disk is found (#632)
      [Scott Moser]
    - Make wakeonlan Network Config v2 setting actually work (#626)
      [dermotbradley]
    - HACKING.md: unify network-refactoring namespace (#658) [Mina Galić]
    - replace usage of dmidecode with kenv on FreeBSD (#621) [Mina Galić]
    - Prevent timeout on travis integration tests. (#651) [James Falcon]
    - azure: enable pushing the log to KVP from the last pushed byte  (#614)
      [Moustafa Moustafa]
    - Fix launch_kwargs bug in integration tests (#654) [James Falcon]
    - split read_fs_info into linux & freebsd parts (#625) [Mina Galić]
    - PULL_REQUEST_TEMPLATE.md: expand commit message section (#642)
    - Make some language improvements in growpart documentation (#649)
      [Shane Frasier]
    - Revert ".travis.yml: use a known-working version of lxd (#643)" (#650)
    - Fix not sourcing default 50-cloud-init ENI file on Debian (#598)
      [WebSpider]
    - remove unnecessary reboot from gpart resize (#646) [Mina Galić]
    - cloudinit: move dmi functions out of util (#622) [Scott Moser]
    - integration_tests: various launch improvements (#638)
    - test_lp1886531: don't assume /etc/fstab exists (#639)
    - Remove Ubuntu restriction from PR template (#648) [James Falcon]
    - util: fix mounting of vfat on *BSD (#637) [Mina Galić]
    - conftest: improve docstring for disable_subp_usage (#644)
    - doc: add example query commands to debug Jinja templates (#645)
    - Correct documentation and testcase data for some user-data YAML (#618)
      [dermotbradley]
    - Hetzner: Fix instance_id / SMBIOS serial comparison (#640)
      [Markus Schade]
    - .travis.yml: use a known-working version of lxd (#643)
    - tools/build-on-freebsd: fix comment explaining purpose of the script
      (#635) [Mina Galić]
    - Hetzner: initialize instance_id from system-serial-number (#630)
      [Markus Schade] (LP: #1885527)
    - Explicit set IPV6_AUTOCONF and IPV6_FORCE_ACCEPT_RA on static6 (#634)
      [Eduardo Otubo]
    - get_interfaces: don't exclude Open vSwitch bridge/bond members (#608)
      [Lukas Märdian] (LP: #1898997)
    - Add config modules for controlling IBM PowerVM RMC. (#584)
      [Aman306] (LP: #1895979)
    - Update network config docs to clarify MAC address quoting (#623)
      [dermotbradley]
    - gentoo: fix hostname rendering when value has a comment (#611)
      [Manuel Aguilera]
    - refactor integration testing infrastructure (#610) [James Falcon]
    - stages: don't reset permissions of cloud-init.log every boot (#624)
      (LP: #1900837)
    - docs: Add how to use cloud-localds to boot qemu (#617) [Joshua Powers]
    - Drop vestigial update_resolve_conf_file function (#620) [Scott Moser]
    - cc_mounts: correctly fallback to dd if fallocate fails (#585)
      (LP: #1897099)
    - .travis.yml: add integration-tests to Travis matrix (#600)
    - ssh_util: handle non-default AuthorizedKeysFile config (#586)
      [Eduardo Otubo]
    - Multiple file fix for AuthorizedKeysFile config (#60) [Eduardo Otubo]
    - bddeb: new --packaging-branch argument to pull packaging from branch
      (#576) [Paride Legovini]
    - Add more integration tests (#615) [lucasmoura]
    - DataSourceAzure: write marker file after report ready in preprovisioning
      (#590) [Johnson Shi]
    - integration_tests: emit settings to log during setup (#601)
    - integration_tests: implement citest tests run in Travis (#605)
    - Add Azure support to integration test framework (#604) [James Falcon]
    - openstack: consider product_name as valid chassis tag (#580)
      [Adrian Vladu] (LP: #1895976)
    - azure: clean up and refactor report_diagnostic_even…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants