XCP-ng 8.0 (meta-issue)

[stormi]

general

• Import sources
• Prepare build environment in Koji
• Build most RPMs
• Alpha repository
• Alpha installer
• Test
• Beta repo and installer
• Do things (see below)
• Test (see below)
• Release Candidate (RC)
• Still do things (see below)
• Test
• Final release

"Do things" (in no specific order)

• [ ] Fix RPMs for yum update (Citrix did not provide a way to update from a previous release using only RPMs this time, so there's more work to be done on our side) For this major update, we won't support yum update. Kernel changed, no backup, too risky.
• [ ] Make sure the ugly "/run/lvm/lvmetad.socket: connect failed" error disappears for people upgrading through yum lvm CLI tools display warning "/run/lvm/lvmetad.socket: connect failed" #114 For this major update, we won't support yum update. Kernel changed, no backup, too risky.
• Switch to new mirroring system for yum updates
• Update default URL in network installer to point at mirrors.xcp-ng.org (or update the short xcp-ng.org/install URL instead and check that double redirects are OK) Redirect xcp-ng.org/install to mirrors.xcp-ng.org/... #194
• Add fallback mechanism for yum update in case mirrors.xcp-ng.org fails to deliver Allow yum to fallback to a mirror if mirrorbits is down #225
• [ ] Add a second mirrorbits instance to avoid downtime postponed: Infra: add a secondary mirrorbits instance #224
• [ ] Disable the fastestmirrors yum plugin? not for now, plus it's useful for the fallback mechanism thanks to its ability to exclude a mirror unless there's no other mirror available.
• Update xcp-featured with new features : all already OK, except experimental secure boot support, but we don't know if it works at all at this stage
• Provide (or not) a way to activate experimental secure boot support: maybe later. Not sure it is ready even in experimental state.
• Handle new UEFI-related RPMs
• Replace or circumvent new closed-source security-tools package
• [ ] Update smartmontools to let them write logs? Enable smartmontools logging by default #137 no consensus reached yet
• Finalize "Verify authenticity of RPMs during net-install": Verify authenticity of RPM packages during net-install #71
• Decide about status of EXT4 and XFS support in sm: still experimental while work is going for larger improvements to the stack
• Handle experimental kernel and transition during upgrade
• ceph-module RPM => not needed anymore AFAIK (supported in kernel 4.19)
• ZFS-related RPMs
• Check emu-manager for changes
• Replace mentions of XenServer with XCP-ng in xs-sm.service and xsconsole.service. Check other services.
• Make "pulp" happy: Add a [general] section to .treeinfo to make pulp happy #88
• Update XCP-ng Center RPM OR stop providing that RPM like Citrix did and rely only on web downloads of the installer.
• Updated XCP-ng Center from the community
• Windows PV-Drivers 8.2.2 XCP-ng Windows PV-Drivers 8.2.2 #181
• Update linux pv tools for CoreOS: Outdated XenTools installation for CoreOS #183
• Fix error message about NSS in installation logs: Installer: errors while importing GPG key (Failed to initialize NSS library)  #186
• Include fixes for XSA-297 http://xenbits.xen.org/xsa/advisory-297.html
• Add useful tools from List of useful extra packages for dom0 #56 to the repository (starting with those without complex dependencies)
  • Add yum-utils, htop, iftop and cryptsetup to default installation
  • Add other basic tools to the public repositories: List of useful extra packages for dom0 #56 (comment) ("action" column)
• Rename xcp-ng-updater to xcp-ng-xapi-plugins
• Use XCP-ng colors for bash prompt and xsconsole
• ZFS module is not loaded at boot? ZFS 0.8.0 in XCP-ng 8.0 #192 => actually it is loaded if there's a dataset.
• [ ] Decide what to do with Dell diagnostic partitions that cause a bad partitioning Fresh install fails creating boot, log and swap partitions on some servers #149 No consensus reached yet.
• Make sure the installation issues on some hardware when the installer memory limit is 8GB is documented in the wiki and an issue has been created. See https://xcp-ng.org/forum/post/13640
• Update microcode Update microcodes with latest from Intel #204
• Study output from systemd-analyze verify default.target (a few warnings). Minor bug reported to Citrix devs.
• Check whether there need to be alternate drivers available right from the start. Lay the foundations for alternate driver addition afterwards.
• See what rpmlint has to say => A LOT, but the lack of public repositories for Citrix Hypervisor source RPMs makes it difficult to contribute...
• Check consequences of not having kpatch Check if absence of kpatch causes issues #209
• xsconsole issue if updated while running yum xsconsole update should not kill running local shell #233 => warning added, bug reported upstream

And anything that will show up during tests.

Specific tests

• Check ZSTD support now that we removed patches that have been included upstream
• Check upstream version of the fix to xenserver-firstboot's handling of firstboot_in_progress https://bugs.xenserver.org/browse/XSO-877 and check if we still need to add ownership of the /etc/firstboot.d/data/ directory.
• New clipboard daemon replacing xs-clipboardd: New clipboard daemon for Windows guests and VNC #166
• Check status of live migration and SXM: cross-pool or during pool upgrade. For example Live migrating HVM linux (and others?) with storage migration from any older release to 7.6 works but vm dead #111.
• Check new handling of overridden kernel modules: Change depmod configuration globally to give priority to the override directory #156
• Check NFS 4.1 support, merged upstream: NFS 4.1 Support #130
• Test updater plugin after code move in xcp-ng-updater 1.3.0

Fix bugs

• Suspend fails
• Live migration of PV VMs

[maxcuttins]

Daily visit in order to see update: ✔️

[maxcuttins]

I cannot handle this waiting anymore...
GO @stormi ! 🎉
GO @stormi ! 🎉
GO @stormi ! 🎉

[stormi]

RC coming soon! Meanwhile, everyone can help with tests :)

[stormi]

RC released: https://xcp-ng.org/forum/topic/1600/xcp-ng-8-0-0-release-candidate

[stormi]

Final 8.0 released at the end of July. Closing.