genisoimage may be going away

[ubuntu-server-builder]

This bug was originally filed in Launchpad as LP: #1915077

Launchpad details

affected_projects = ['cloud-utils (Ubuntu)']
assignee = None
assignee_name = None
date_closed = None
date_created = 2021-02-08T21:39:44.694094+00:00
date_fix_committed = None
date_fix_released = None
id = 1915077
importance = undecided
is_complete = False
lp_url = https://bugs.launchpad.net/cloud-init/+bug/1915077
milestone = None
owner = mwhudson
owner_name = Michael Hudson-Doyle
private = False
status = confirmed
submitter = mwhudson
submitter_name = Michael Hudson-Doyle
tags = []
duplicates = []

Launchpad user Michael Hudson-Doyle(mwhudson) wrote on 2021-02-08T21:39:44.694094+00:00

It seems that cdrkit, which is where genisoimage comes from, is dead upstream and is likely to be removed from debian: https://lists.debian.org/debian-cloud/2021/02/msg00011.html

Plenty of cloud-init docs and tutorials refer to genisoimage to create seed ISOs, it may be time to find something else.

[ubuntu-server-builder]

Launchpad user James Falcon(falcojr) wrote on 2021-02-15T14:21:28.240801+00:00

I asked Dan Watkins about this and received this reply:

In terms of scope, cloud-init does not Depend on genisoimage but does
recommend its use in documentation. cloud-image-utils (built from
cloud-utils) does Depend directly on it.

It sounds like, if it's going away, genisoimage is going away in
bookworm, the Debian stable release after the one that just went into
freeze (bullseye). bullseye goes into hard freeze (2021-03-12[0]) after
hirsute's Debian import freeze (2021-02-25[1]), so there's no chance
that it will affect hirsute. If bullseye is released before ~August
(Debian don't have set release dates, they release once it's Ready
(TM)), and genisoimage is removed from testing soon after that release,
then it may affect us is in I.

So from a "when will the wheels fall off in Ubuntu" perspective, we (a)
have a decent runway, and (b) will only be affected in the release whose
development is open after the removal happens in Debian.

That said, cloud-image-utils is in main[2] and therefore all of its
dependencies also need to be in main, so we are not free to choose our
own replacement unconstrained. We certainly won't be alone in needing
to choose a replacement, apt rdepends genisoimage indicates that,
amongst others, ubuntu-desktop and livecd-rootfs (which is the package
used to build not only live CD root filesystems but also ~every other
Ubuntu image). IMO, it's not really our place to determine the correct
replacement here: this is a tool used across different parts of Ubuntu,
so Foundations are likely better placed than we.

From an upstream cloud-init perspective, this indicates to me that we
shouldn't be recommending genisoimage to our users in our documentation.
The sooner we can document the new method of doing this, the fewer users
will be broken by its future removal (whether in Debian, Ubuntu or
whenever their distro decides to follow suite). Of course, we should
align the docs with what Ubuntu is choosing, so there's a (task)
dependency there.

[0] https://wiki.debian.org/DebianBullseye
[1] https://discourse.ubuntu.com/t/hirsute-hippo-release-schedule/18539
[2] Some details at https://wiki.ubuntu.com/MainInclusionProcess; TL;DR,
we support main both in security terms and commercially, so anything
that goes into main has to pass muster in terms of supportability.

[ubuntu-server-builder]

Launchpad user Steve Langasek(vorlon) wrote on 2021-02-15T22:18:17+00:00

On Mon, Feb 15, 2021 at 02:21:28PM -0000, James Falcon wrote:

That said, cloud-image-utils is in main[2] and therefore all of its
dependencies also need to be in main, so we are not free to choose our
own replacement unconstrained. We certainly won't be alone in needing
to choose a replacement, apt rdepends genisoimage indicates that,
amongst others, ubuntu-desktop and livecd-rootfs (which is the package
used to build not only live CD root filesystems but also ~every other
Ubuntu image). IMO, it's not really our place to determine the correct
replacement here: this is a tool used across different parts of Ubuntu,
so Foundations are likely better placed than we.

We use xorriso in place of genisoimage for Ubuntu ISO generation. I'm
actually not sure why genisoimage is a dependency of livecd-rootfs, since I
don't believe we have any ISOs as output of livecd-rootfs itself.

The ubuntu-meta dependency is being dropped; the seed change has already
been merged, and a new ubuntu-desktop is waiting in hirsute-proposed.

--
Steve Langasek Give me a lever long enough and a Free OS
Debian Developer to set it on, and I can move the world.
Ubuntu Developer https://www.debian.org/
slangasek@ubuntu.com vorlon@debian.org

[ubuntu-server-builder]

Launchpad user Dan Watkins(oddbloke) wrote on 2021-02-16T17:57:56+00:00

On Mon, Feb 15, 2021 at 10:18:17PM -0000, Steve Langasek wrote:

On Mon, Feb 15, 2021 at 02:21:28PM -0000, James Falcon wrote:

That said, cloud-image-utils is in main[2] and therefore all of its
dependencies also need to be in main, so we are not free to choose our
own replacement unconstrained. We certainly won't be alone in needing
to choose a replacement, apt rdepends genisoimage indicates that,
amongst others, ubuntu-desktop and livecd-rootfs (which is the package
used to build not only live CD root filesystems but also ~every other
Ubuntu image). IMO, it's not really our place to determine the correct
replacement here: this is a tool used across different parts of Ubuntu,
so Foundations are likely better placed than we.

We use xorriso in place of genisoimage for Ubuntu ISO generation.

OK, that's clearly what we should be moving to; thanks!

I'm actually not sure why genisoimage is a dependency of
livecd-rootfs, since I don't believe we have any ISOs as output of
livecd-rootfs itself.

It's used by the CPC Vagrant build scripts to... generate a cloud-init
seed ISO. (=

(Who could have introduced that? innocent whistling)

The ubuntu-meta dependency is being dropped; the seed change has already
been merged, and a new ubuntu-desktop is waiting in hirsute-proposed.

OK, cool; are we looking to drop it (from main) this cycle? (i.e. Do we
need to work on this ~now?)

[ubuntu-server-builder]

Launchpad user Steve Langasek(vorlon) wrote on 2021-02-17T21:48:45+00:00

On Tue, Feb 16, 2021 at 05:57:56PM -0000, Dan Watkins wrote:

I'm actually not sure why genisoimage is a dependency of
livecd-rootfs, since I don't believe we have any ISOs as output of
livecd-rootfs itself.

It's used by the CPC Vagrant build scripts to... generate a cloud-init
seed ISO. (=

(Who could have introduced that? innocent whistling)

Hah! ok.

The ubuntu-meta dependency is being dropped; the seed change has already
been merged, and a new ubuntu-desktop is waiting in hirsute-proposed.

OK, cool; are we looking to drop it (from main) this cycle? (i.e. Do we
need to work on this ~now?)

There's no hurry, we just wanted people to be in the loop sooner rather than
later. I think we could reasonably promote xorriso to main as soon as there
was a reverse-dependency demanding it.