Skip to content

[Bug] eksctl utils update-kube-proxy fails for EKS 1.34 after upgrade #8553

@vutny

Description

@vutny

What were you trying to accomplish?

After upgrading Control Plane to 1.34, trying to subsequently upgrade kube-proxy addon using eksctl utils update-kube-proxy command.

What happened?

The command succeeds, but the rollout of kube-proxy DaemonSet is unable to progress with ImagePullErr.
It seems that the image tag being set by the command is wrong and does not exist in the registry.

How to reproduce it?

Create EKS 1.33 cluster.
Upgrade it to 1.34.
Issue eksctl utils update-kube-proxy --cluster ${mycluster} --approve command

Anything else we need to know?
There is a code responsible for setting image tag string is here.

minimalBuildTag := fmt.Sprintf("%s%s-minimal-%s", tagPrefix, v.Core(), preRelease)

Looks like there aren't those "minimal" images for EKS 1.34 anymore, AWS probably ships only "standard" from now on. There are just some minimal beta images available, probably not for general use.

$ aws ecr --region us-east-1 list-images --repository-name eks/kube-proxy --registry-id 602401143452 | jq '.imageIds[] | select((.imageTag // "") | startswith("v1.34") and contains("minimal"))'
{
  "imageDigest": "sha256:d31bbd9bd54a3ffca173e508f8a0ffa6041e9fe11595ab9c5078df72d023c8e2",
  "imageTag": "v1.34.0-beta.0-minimal-eksbuild.1-linux_amd64"
}
{
  "imageDigest": "sha256:b124b7233633b50565dfdd16c067a80b4d397ab66419e1869f653cc17b4d8f52",
  "imageTag": "v1.34.0-beta.0-minimal-eksbuild.1-linux_arm64"
}
{
  "imageDigest": "sha256:a588cdf53dfff8f280ed5881385c2fdf335110becad00ec3855d370367f8fa6f",
  "imageTag": "v1.34.0-beta.0-minimal-eksbuild.1"
}

Only these tags are actually available:

$ aws eks describe-addon-versions --addon-name kube-proxy --query 'addons[].addonVersions[].addonVersion' | jq '.[] | select(startswith("v1.34"))'
"v1.34.0-eksbuild.4"
"v1.34.0-eksbuild.2"

Probably need to remove "minimal-" literal string from the template.
More context might be found in this issue: aws/containers-roadmap#2688

Versions

$ eksctl info
eksctl version: 0.215.0

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions