Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[backport 1.27] Update calico to v3.26.3 and fix nodeAddressAutodetectionV4 issue #5023

Closed
thomasferrandiz opened this issue Nov 16, 2023 · 1 comment
Assignees

Comments

@thomasferrandiz
Copy link
Contributor

Backport for: #5021

@fmoral2
Copy link
Contributor

fmoral2 commented Nov 23, 2023

Validated on Version:

-$   rke2 version v1.27.8-rc1+rke2r1 (31e6aaa64fc5bf6c416737443239b3f58515b15e)

Environment Details

Infrastructure
Cloud EC2 instance

Node(s) CPU architecture, OS, and Version:
PRETTY_NAME="Ubuntu 22.04.1 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"

Cluster Configuration:
1 node server

Steps to validate the fix

  1. Install rke2 with cni calico
  2. update /var/lib/rancher/rke2/server/manifests/rke2-calico.yaml to add:
installation:
  calicoNetwork:
    nodeAddressAutodetectionV4:
      interface: eth1
  1. Check if pods are up and running
  2. Get installation details and describe
  3. Check if it is applied and no errors

Validation Results:


~$ rke2 -v
rke2 version v1.27.8-rc1+rke2r1 (31e6aaa64fc5bf6c416737443239b3f58515b15e)
go version go1.20.11 X:boringcrypto
~$ kubectl get pods -A
NAMESPACE         NAME                                                   READY   STATUS      RESTARTS   AGE
calico-system     calico-kube-controllers-685f64bcff-4685t               1/1     Running     0          4m53s
calico-system     calico-node-xqw6m                                      1/1     Running     0          4m53s
calico-system     calico-typha-6c8bc84bfb-xzkvw                          1/1     Running     0          4m53s
kube-system       cloud-controller-manager-ip-172-31-22-2                1/1     Running     0          4m44s
kube-system       etcd-ip-172-31-22-2                                    1/1     Running     0          4m49s
kube-system       helm-install-rke2-calico-5s9sc                         0/1     Completed   2          5m31s
kube-system       helm-install-rke2-calico-crd-jgpks                     0/1     Completed   0          5m31s
kube-system       helm-install-rke2-coredns-nt4z7                        0/1     Completed   0          5m31s
kube-system       helm-install-rke2-ingress-nginx-jkvtv                  0/1     Completed   0          5m31s
kube-system       helm-install-rke2-metrics-server-llh56                 0/1     Completed   0          5m31s
kube-system       helm-install-rke2-snapshot-controller-46594            0/1     Completed   1          5m31s
kube-system       helm-install-rke2-snapshot-controller-crd-dmnqf        0/1     Completed   0          5m31s
kube-system       helm-install-rke2-snapshot-validation-webhook-6jfs4    0/1     Completed   0          5m31s
kube-system       kube-apiserver-ip-172-31-22-2                          1/1     Running     0          5m6s
kube-system       kube-controller-manager-ip-172-31-22-2                 1/1     Running     0          4m56s
kube-system       kube-proxy-ip-172-31-22-2                              1/1     Running     0          4m47s
kube-system       kube-scheduler-ip-172-31-22-2                          1/1     Running     0          4m45s
kube-system       rke2-coredns-rke2-coredns-autoscaler-6f97df447-92kwr   1/1     Running     0          5m13s
kube-system       rke2-coredns-rke2-coredns-f6c9f9649-w4cjp              1/1     Running     0          5m13s
kube-system       rke2-ingress-nginx-controller-ldr8g                    1/1     Running     0          3m55s
kube-system       rke2-metrics-server-6d79d977db-5g68z                   1/1     Running     0          4m10s
kube-system       rke2-snapshot-controller-7d6476d7cb-nwwlc              1/1     Running     0          4m3s
kube-system       rke2-snapshot-validation-webhook-5649fbd66c-7qnj9      1/1     Running     0          4
~$ kubectl describe installation default --all-namespaces
Name:         default
Namespace:    
Labels:       app.kubernetes.io/managed-by=Helm
Annotations:  meta.helm.sh/release-name: rke2-calico
              meta.helm.sh/release-namespace: kube-system
API Version:  operator.tigera.io/v1
Kind:         Installation
Metadata:
  Creation Timestamp:  2023-11-23T12:46:35Z
  Finalizers:
    tigera.io/operator-cleanup
  Generation:        2
  Resource Version:  1734
  UID:               a31ef599-f861-428d-9636-aa4085067d7b
Spec:
  Calico Network:
    Bgp:         Disabled
    Host Ports:  Enabled
    Ip Pools:
      Block Size:          26
      Cidr:                 
      Disable BGP Export:  false
      Encapsulation:       VXLAN
      Nat Outgoing:        Enabled
      Node Selector:       all()
    Linux Dataplane:       Iptables
    Multi Interface Mode:  None
    nodeAddressAutodetectionV4:
      First Found:  true
  Cni:
    Ipam:
      Type:                Calico
    Type:                  Calico
  Control Plane Replicas:  2
  Control Plane Tolerations:
    Effect:          NoSchedule
    Key:             node-role.kubernetes.io/control-plane
    Operator:        Exists
    Effect:          NoExecute
    Key:             node-role.kubernetes.io/etcd
    Operator:        Exists
  Flex Volume Path:  /var/lib/kubelet/volumeplugins/
  Image Path:        rancher
  Image Prefix:      mirrored-calico-
  Image Pull Secrets:
  Kubelet Volume Plugin Path:  None
  Kubernetes Provider:         RKE2
  Logging:
    Cni:
      Log File Max Age Days:  30
      Log File Max Count:     10
      Log File Max Size:      100Mi
      Log Severity:           Info
  Node Update Strategy:
    Rolling Update:
      Max Unavailable:  1
    Type:               RollingUpdate
  Non Privileged:       Disabled
  Variant:              Calico
Status:
  Calico Version:  v3.26.3
  Computed:
    Calico Network:
      Bgp:         Disabled
      Host Ports:  Enabled
      Ip Pools:
        Block Size:          26
        Cidr:                 
        Disable BGP Export:  false
        Encapsulation:       VXLAN
        Nat Outgoing:        Enabled
        Node Selector:       all()
      Linux Dataplane:       Iptables
      Multi Interface Mode:  None
      nodeAddressAutodetectionV4:
        First Found:  true
    Cni:
      Ipam:
        Type:                Calico
      Type:                  Calico
    Control Plane Replicas:  2
    Control Plane Tolerations:
      Effect:                    NoSchedule
      Key:                       node-role.kubernetes.io/control-plane
      Operator:                  Exists
      Effect:                    NoExecute
      Key:                       node-role.kubernetes.io/etcd
      Operator:                  Exists
    Flex Volume Path:            /var/lib/kubelet/volumeplugins/
    Image Path:                  rancher
    Image Prefix:                mirrored-calico-
    Kubelet Volume Plugin Path:  None
    Kubernetes Provider:         RKE2
    Logging:
      Cni:
        Log File Max Age Days:  30
        Log File Max Count:     10
        Log File Max Size:      100Mi
        Log Severity:           Info
    Node Update Strategy:
      Rolling Update:
        Max Unavailable:  1
      Type:               RollingUpdate
    Non Privileged:       Disabled
    Variant:              Calico
  Conditions:
    Last Transition Time:  2023-11-23T12:47:47Z
    Message:               All Objects Available
    Observed Generation:   2
    Reason:                AllObjectsAvailable
    Status:                False
    Type:                  Progressing
    Last Transition Time:  2023-11-23T12:47:47Z
    Message:               All Objects Available
    Observed Generation:   2
    Reason:                AllObjectsAvailable
    Status:                False
    Type:                  Degraded
    Last Transition Time:  2023-11-23T12:47:47Z
    Message:               All objects available
    Observed Generation:   2
    Reason:                AllObjectsAvailable
    Status:                True
    Type:                  Ready
  Mtu:                     8951
  Variant:                 Calico
Events:                    <none>


~$ k get pods -A
NAMESPACE         NAME                                                   READY   STATUS      RESTARTS   AGE
calico-system     calico-kube-controllers-685f64bcff-4685t               1/1     Running     0          9m52s
calico-system     calico-node-xqw6m                                      1/1     Running     0          9m52s
calico-system     calico-typha-6c8bc84bfb-xzkvw                          1/1     Running     0          9m52s
kube-system       cloud-controller-manager-ip-172-31-22-2                1/1     Running     0          9m43s
kube-system       etcd-ip-172-31-22-2                                    1/1     Running     0          9m48s
kube-system       helm-install-rke2-calico-5s9sc                         0/1     Completed   2          10m
kube-system       helm-install-rke2-calico-crd-jgpks                     0/1     Completed   0          10m
kube-system       helm-install-rke2-coredns-nt4z7                        0/1     Completed   0          10m
kube-system       helm-install-rke2-ingress-nginx-jkvtv                  0/1     Completed   0          10m
kube-system       helm-install-rke2-metrics-server-llh56                 0/1     Completed   0          10m
kube-system       helm-install-rke2-snapshot-controller-46594            0/1     Completed   1          10m
kube-system       helm-install-rke2-snapshot-controller-crd-dmnqf        0/1     Completed   0          10m
kube-system       helm-install-rke2-snapshot-validation-webhook-6jfs4    0/1     Completed   0          10m
kube-system       kube-apiserver-ip-172-31-22-2                          1/1     Running     0          10m
kube-system       kube-controller-manager-ip-172-31-22-2                 1/1     Running     0          9m55s
kube-system       kube-proxy-ip-172-31-22-2                              1/1     Running     0          9m46s
kube-system       kube-scheduler-ip-172-31-22-2                          1/1     Running     0          9m44s
kube-system       rke2-coredns-rke2-coredns-autoscaler-6f97df447-92kwr   1/1     Running     0          10m
kube-system       rke2-coredns-rke2-coredns-f6c9f9649-w4cjp              1/1     Running     0          10m
kube-system       rke2-ingress-nginx-controller-ldr8g                    1/1     Running     0          8m54s
kube-system       rke2-metrics-server-6d79d977db-5g68z                   1/1     Running     0          9m9s
kube-system       rke2-snapshot-controller-7d6476d7cb-nwwlc              1/1     Running     0          9m2s
kube-system       rke2-snapshot-validation-webhook-5649fbd66c-7qnj9      1/1     Running     0          9m7s
tigera-operator   tigera-operator-5b8fcdd5f6-25s9r                       1/1     Running     0          9m57s
 



@fmoral2 fmoral2 closed this as completed Nov 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants