k3s example: error pulling image

[antoinerg]

First of all, thanks for the great project! I've always wanted K8S to be declarative all the way down to container images. This is awesome!

I tried running the examples on k3s by commenting out ./kubernetes.nix in favor of ./k3s.nix in the following file:

nix-snapshotter/modules/nixos/vm.nix

Lines 11 to 12 in 6eb21bd

	./kubernetes.nix
	# ./k3s.nix

then ran nix run ".#vm" to get a VM.

Although it successfully boots a VM with k3s, I hit an error when pulling a Nix image like the preloaded one (eg. kubectl apply -Rf /etc/kubernetes/redis will result in a pod that fails with a pull image error).

Doing the same steps as above but using ./kubernetes.nix works flawlessly.

[antoinerg]

I think the reason why this was failing is because we need to use a k3s version that includes the changes that closed issue k3s-io/k3s#8480

[antoinerg]

I think the reason why this was failing is because we need to use a k3s version that includes the changes that closed issue k3s-io/k3s#8480

... and we then need to point k3s's kubelet to use nix-snapshotter image service:

services.k3s = {
  enable = true;
  configPath = pkgs.writeText "k3s_config.yaml" ''
    container-runtime-endpoint: "unix:///run/containerd/containerd.sock"
    image-service-endpoint: "unix:///run/nix-snapshotter/nix-snapshotter.sock"
  '';
};

[antoinerg]

Along with #102 (comment), the fix from #107 is required!

[antoinerg]

Along with #102 (comment), the fix from #107 is required!

The fix landed so I can now follow-up with a PR with the changes from #102 (comment) 🎉

[antoinerg]

The image-service-endpoint flag was added to k3s in patch release 1.27.7 (reference: k3s-io/k3s#8481). Unfortunately, nixpkgs/nixos-23.11 uses v1.27.6.

[RobbieBuxton]

The image-service-endpoint flag was added to k3s in patch release 1.27.7 (reference: k3s-io/k3s#8481). Unfortunately, nixpkgs/nixos-23.11 uses v1.27.6.

We could patch it with an overlay until we decide to move onto the next stable Nixos release in the future?