shared and bridged networking are broken in 1.11.0

[jandubois]

Summary

In Rancher Desktop 1.11.0 the vde_vmnet and socket_vmnet options no longer work correctly.

The rd0 and rd1 interfaces exists, but have no corresponding default routes in the routing table. E.g. traefik ingress is not accessible over the bridged or shared interfaces.

The root cause is bumping Lima from 0.16.0 to 0.18.0. The error was introduced/exposed in lima-vm/lima#1898, which is restarting the network service at the end of the cloud-init boot sequence.

First boot

• On first boot the VM starts without admin privileges and rd0/rd1 are not configured
• lima-init creates /etc/network/interfaces
• networking services starts
• /etc is moved to /mnt/data/etc and mounted on top of the /etc location
• networking services are restarted

Add bridged and shared networking

• user enables admin mode, which causes a VM restart with the rd0/rd1 interfaces defined
• lima-init creates /etc/network/interfaces with the updated setting
• networking services start, including rd0/rd1
• /mnt/data/etc is mounted on top of /etc
• networking services are restarted, without rd0/rd1

Why it is broken

This last restart happens with the /etc/networking/interfaces file from the first-boot, and not the updated one from the current boot (which is hidden behind the bind-mount). Therefore it removes the rd0/rd1 interfaces again from the routing table.

Acceptance criteria

This issue should only be closed once the issue is fixed in Lima, we have bumped to the fixed Lima version, and have created a BATS test for it.

It should not be closed when the workaround from the 1.11.1 release is merged back into main.