Issue migrating Windows nodes to Tigera Operator

[amapi]

We decide to migrate from calico manifest installation to Tigera Calico Operator on K8S cluster with Windows nodes.

Everything work (calico run fine) on Linux node

Nothing work on Windows node

No calico-node-win (pod/ds) are created.

Tigera Operator pod report this error message

"Waiting for IPAMConfiguration watch to be established"

Cluster before migration:
K8S 1.27.6
Calico 3.27.2 (installed with manifest)

Calico run fine on linux and windows node

Cluster after calico tigera operator migration:
K8S 1.27.6
Calico 3.27.2 ok on linux node
Nothing on windows node

root@kwinlabmasaz0a01:~# kubectl get pod -A -o wide | grep calico
calico-system           calico-kube-controllers-8659d8b4b4-mwh2c                   1/1     Running                      0             47m     172.12.26.7      kwinlabmasaz0b01   <none>           <none>
calico-system           calico-node-2ksvj                                          1/1     Running                      0             38m     10.235.76.206    kwinlabingaz0a01   <none>           <none>
calico-system           calico-node-82hll                                          1/1     Running                      0             41m     10.235.76.218    kwinlabwrkaz0a02   <none>           <none>
calico-system           calico-node-9mjds                                          1/1     Running                      0             39m     10.235.76.208    kwinlabwrkaz0a01   <none>           <none>
calico-system           calico-node-t5lx8                                          1/1     Running                      0             40m     10.235.76.209    kwinlabmasaz0b01   <none>           <none>
calico-system           calico-node-tnc4f                                          1/1     Running                      0             39m     10.235.76.204    kwinlabwrkaz0a03   <none>           <none>
calico-system           calico-node-tnzw6                                          1/1     Running                      0             41m     10.235.76.199    kwinlabwrkaz0a04   <none>           <none>
calico-system           calico-node-vgx2g                                          1/1     Running                      0             40m     10.235.76.217    kwinlabmasaz0c01   <none>           <none>
calico-system           calico-node-vp2wn                                          1/1     Running                      0             38m     10.235.76.214    kwinlabmasaz0a01   <none>           <none>
calico-system           calico-typha-5bdbbcfb6b-6lsh2                              1/1     Running                      0             41m     10.235.76.204    kwinlabwrkaz0a03   <none>           <none>
calico-system           calico-typha-5bdbbcfb6b-c7mpp                              1/1     Running                      0             41m     10.235.76.208    kwinlabwrkaz0a01   <none>           <none>
calico-system           calico-typha-5bdbbcfb6b-wxknk                              1/1     Running                      0             41m     10.235.76.214    kwinlabmasaz0a01   <none>           <none>
calico-system           csi-node-driver-4gp2j                                      2/2     Running                      0             47m     172.12.255.200   kwinlabingaz0a01   <none>           <none>
calico-system           csi-node-driver-68kv9                                      2/2     Running                      0             47m     172.12.75.176    kwinlabwrkaz0a04   <none>           <none>
calico-system           csi-node-driver-bcc5b                                      2/2     Running                      0             47m     172.12.26.6      kwinlabmasaz0b01   <none>           <none>
calico-system           csi-node-driver-fqgk5                                      2/2     Running                      0             47m     172.12.226.196   kwinlabmasaz0c01   <none>           <none>
calico-system           csi-node-driver-kv47h                                      2/2     Running                      0             47m     172.12.106.130   kwinlabwrkaz0a03   <none>           <none>
calico-system           csi-node-driver-ppsff                                      2/2     Running                      0             47m     172.12.7.135     kwinlabmasaz0a01   <none>           <none>
calico-system           csi-node-driver-qlltc                                      2/2     Running                      0             47m     172.12.173.171   kwinlabwrkaz0a01   <none>           <none>
calico-system           csi-node-driver-wthmr                                      2/2     Running                      0             47m     172.12.204.244   kwinlabwrkaz0a02   <none>           <none>

root@kwinlabmasaz0a01:~# kubectl  get node -o wide
NAME               STATUS   ROLES                  AGE   VERSION   INTERNAL-IP     EXTERNAL-IP   OS-IMAGE                       KERNEL-VERSION      CONTAINER-RUNTIME
kwinlabaz0a01      Ready    <none>                 9h    v1.25.6   10.235.76.216   <none>        Windows Server 2022 Standard   10.0.20348.1906     containerd://1.6.1
kwinlabingaz0a01   Ready    <none>                 11h   v1.25.6   10.235.76.206   <none>        Ubuntu 22.04.1 LTS             5.15.0-58-generic   containerd://1.7.5
kwinlabmasaz0a01   Ready    control-plane,master   11h   v1.25.6   10.235.76.214   <none>        Ubuntu 22.04.1 LTS             5.15.0-58-generic   containerd://1.7.5
kwinlabmasaz0b01   Ready    control-plane,master   11h   v1.25.6   10.235.76.209   <none>        Ubuntu 22.04.1 LTS             5.15.0-58-generic   containerd://1.7.5
kwinlabmasaz0c01   Ready    control-plane,master   11h   v1.25.6   10.235.76.217   <none>        Ubuntu 22.04.1 LTS             5.15.0-58-generic   containerd://1.7.5
kwinlabwrkaz0a01   Ready    <none>                 10h   v1.25.6   10.235.76.208   <none>        Ubuntu 22.04.1 LTS             5.15.0-58-generic   containerd://1.7.5
kwinlabwrkaz0a02   Ready    <none>                 10h   v1.25.6   10.235.76.218   <none>        Ubuntu 22.04.1 LTS             5.15.0-58-generic   containerd://1.7.5
kwinlabwrkaz0a03   Ready    <none>                 10h   v1.25.6   10.235.76.204   <none>        Ubuntu 22.04.1 LTS             5.15.0-58-generic   containerd://1.7.5
kwinlabwrkaz0a04   Ready    <none>                 10h   v1.25.6   10.235.76.199   <none>        Ubuntu 22.04.1 LTS             5.15.0-58-generic   containerd://1.7.5

root@kwinlabmasaz0a01:~# kubectl logs -f tigera-operator-7c67d76845-rrvsj -n tigera-operator

{"level":"error","ts":"2024-03-28T20:18:35Z","logger":"controller_windows","msg":"Waiting for IPAMConfiguration watch to be established","reason":"ResourceNotReady","stacktrace":"github.com/tigera/operator/pkg/controller/status.(*statusManager).SetDegraded\n\t/go/src/github.com/tigera/operator/pkg/controller/status/status.go:356\ngithub.com/tigera/operator/pkg/controller/installation.(*ReconcileWindows).Reconcile\n\t/go/src/github.com/tigera/operator/pkg/controller/installation/windows_controller.go:328\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:122\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:323\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:274\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:235"}

[caseydavenport]

@coutinhop knows about this one.

I think the solution is to create the Calico API server, following these instructions: https://docs.tigera.io/calico/latest/operations/install-apiserver#install-the-api-server

[caseydavenport]

We may need a docs update for the migration docs here too