Nebula-operator: kube-scheduler container is crashloop #4299

porscheme · 2022-06-03T11:56:20Z

porscheme
Jun 3, 2022

Version: 3.1.0
Cluster: 1 meta, 1 graphd, 3 storaged
Nebula Helm chats
Attached is the Nebula-Operater helm chart values file

Any help is very much appreciated.

Below is the log

kubectl logs nebula-operator-scheduler-deployment-5b4945c796-5pdgk -c kube-scheduler -n graph
I0603 11:48:13.967511       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
I0603 11:48:13.967573       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
I0603 11:48:13.967960       1 flags.go:33] FLAG: --add-dir-header="false"
I0603 11:48:13.967985       1 flags.go:33] FLAG: --address="0.0.0.0"
I0603 11:48:13.967997       1 flags.go:33] FLAG: --algorithm-provider=""
I0603 11:48:13.968007       1 flags.go:33] FLAG: --alsologtostderr="false"
I0603 11:48:13.968016       1 flags.go:33] FLAG: --authentication-kubeconfig=""
I0603 11:48:13.968026       1 flags.go:33] FLAG: --authentication-skip-lookup="false"
I0603 11:48:13.968037       1 flags.go:33] FLAG: --authentication-token-webhook-cache-ttl="10s"
I0603 11:48:13.968048       1 flags.go:33] FLAG: --authentication-tolerate-lookup-failure="true"
I0603 11:48:13.968058       1 flags.go:33] FLAG: --authorization-always-allow-paths="[/healthz]"
I0603 11:48:13.968074       1 flags.go:33] FLAG: --authorization-kubeconfig=""
I0603 11:48:13.968084       1 flags.go:33] FLAG: --authorization-webhook-cache-authorized-ttl="10s"
I0603
 11:48:13.968093       1 flags.go:33] FLAG: --authorization-webhook-cache-unauthorized-ttl="10s"
I0603 11:48:13.968103       1 flags.go:33] FLAG: --bind-address="0.0.0.0"
I0603 11:48:13.968114       1 flags.go:33] FLAG: --cert-dir=""
I0603 11:48:13.968124       1 flags.go:33] FLAG: --client-ca-file=""
I0603 11:48:13.968136       1 flags.go:33] FLAG: --config=""
I0603 11:48:13.968149       1 flags.go:33] FLAG: --contention-profiling="true"
I0603 11:48:13.968164       1 flags.go:33] FLAG: --feature-gates=""
I0603 11:48:13.968181       1 flags.go:33] FLAG: --hard-pod-affinity-symmetric-weight="1"
I0603 11:48:13.968194       1 flags.go:33] FLAG: --help="false"
I0603 11:48:13.968204       1 flags.go:33] FLAG: --http2-max-streams-per-connection="0"
I0603 11:48:13.968217       1 flags.go:33] FLAG: --kube-api-burst="100"
I0603 11:48:13.968228       1 flags.go:33] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
I0603 11:48:13.968243       1 flags.go:33] FLAG: --kube-api-qps="50"
I0603 11:48:13.968259       1 flags.go:33] FLAG: --kubeconfig=""
I0603 11:48:13.968272       1 flags.go:33] FLAG: --leader-elect="true"
I0603 11:48:13.968283       1 flags.go:33] FLAG: --leader-elect-lease-duration="15s"
I0603 11:48:13.968294       1 flags.go:33] FLAG: --leader-elect-renew-deadline="10s"
I0603 11:48:13.968306       1 flags.go:33] FLAG: --leader-elect-resource-lock="endpoints"
I0603 11:48:13.968317       1 flags.go:33] FLAG: --leader-elect-resource-name="nebula-operator-scheduler-elect-lock"
I0603 11:48:13.968328       1 flags.go:33] FLAG: --leader-elect-resource-namespace="graph"
I0603 11:48:13.968341       1 flags.go:33] FLAG: --leader-elect-retry-period="2s"
I0603 11:48:13.968357       1 flags.go:33] FLAG: --lock-object-name="nebula-operator-scheduler-elect-lock"
I0603 11:48:13.968372       1 flags.go:33] FLAG: --lock-object-namespace="graph"
I0603 11:48:13.968386       1 flags.go:33] FLAG: --log-backtrace-at=":0"
I0603 11:48:13.968402       1 flags.go:33] FLAG: --log-dir=""
I0603 11:48:13.968416       1 flags.go:33] FLAG: --log-file=""
I0603 11:48:13.968426       1 flags.go:33] FLAG: --log-file-max-size="1800"
I0603 11:48:13.968437       1 flags.go:33] FLAG: --log-flush-frequency="5s"
I0603 11:48:13.968448       1 flags.go:33] FLAG: --logtostderr="true"
I0603 11:48:13.968458       1 flags.go:33] FLAG: --master=""
I0603 11:48:13.968470       1 flags.go:33] FLAG: --policy-config-file=""
I0603 11:48:13.968483       1 flags.go:33] FLAG: --policy-configmap="nebula-operator-scheduler-policy"
I0603 11:48:13.968499       1 flags.go:33] FLAG: --policy-configmap-namespace="graph"
I0603 11:48:13.968512       1 flags.go:33] FLAG: --port="10251"
I0603 11:48:13.968527       1 flags.go:33] FLAG: --profiling="true"
I0603 11:48:13.968541       1 flags.go:33] FLAG: --requestheader-allowed-names="[]"
I0603 11:48:13.968558       1 flags.go:33] FLAG: --requestheader-client-ca-file=""
I0603 11:48:13.968570       1 flags.go:33] FLAG: --requestheader-extra-headers-prefix="[x-remote-extra-]"
I0603 11:48:13.968589       1 flags.go:33] FLAG: --requestheader-group-headers="[x-remote-group]"
I0603 11:48:13.968605       1 flags.go:33] FLAG: --requestheader-username-headers="[x-remote-user]"
I0603 11:48:13.968623       1 flags.go:33] FLAG: --scheduler-name="nebula-scheduler"
I0603 11:48:13.968637       1 flags.go:33] FLAG: --secure-port="10261"
I0603 11:48:13.968651       1 flags.go:33] FLAG: --show-hidden-metrics-for-version=""
I0603 11:48:13.968665       1 flags.go:33] FLAG: --skip-headers="false"
I0603 11:48:13.968678       1 flags.go:33] FLAG: --skip-log-headers="false"
I0603 11:48:13.968693       1 flags.go:33] FLAG: --stderrthreshold="2"
I0603 11:48:13.968705       1 flags.go:33] FLAG: --tls-cert-file=""
I0603 11:48:13.968718       1 flags.go:33] FLAG: --tls-cipher-suites="[]"
I0603 11:48:13.968733       1 flags.go:33] FLAG: --tls-min-version=""
I0603 11:48:13.968747       1 flags.go:33] FLAG: --tls-private-key-file=""
I0603 11:48:13.968759       1 flags.go:33] FLAG: --tls-sni-cert-key="[]"
I0603 11:48:13.968775       1 flags.go:33] FLAG: --use-legacy-policy-config="false"
I0603 11:48:13.968789       1 flags.go:33] FLAG: --v="2"
I0603 11:48:13.968804       1 flags.go:33] FLAG: --version="false"
I0603 11:48:13.968821       1 flags.go:33] FLAG: --vmodule=""
I0603 11:48:13.968835       1 flags.go:33] FLAG: --write-config-to=""
I0603 11:48:17.473035       1 serving.go:313] Generated self-signed cert in-memory
W0603 11:48:26.499087       1 options.go:324] Neither --kubeconfig nor --master was specified. Using default API client. This might not work.
I0603 11:48:26.504558       1 server.go:166] Starting Kubernetes Scheduler version v1.18.8
I0603 11:48:26.679113       1 legacy_registry.go:426] Registering EvenPodsSpread predicate and priority function
I0603 11:48:26.679147       1 factory.go:243] Creating scheduler from configuration: {{ } [{NoVolumeZoneConflict <nil>} {MaxEBSVolumeCount <nil>} {MaxAzureDiskVolumeCount <nil>} {NoDiskConflict <nil>} {GeneralPredicates <nil>} {PodToleratesNodeTaints <nil>} {CheckVolumeBinding <nil>} {MaxGCEPDVolumeCount <nil>} {MatchInterPodAffinity <nil>} {CheckVolumeBinding <nil>}] [{SelectorSpreadPriority 1 <nil>} {InterPodAffinityPriority 1 <nil>} {LeastRequestedPriority 1 <nil>} {BalancedResourceAllocation 1 <nil>} {NodePreferAvoidPodsPriority 1 <nil>} {NodeAffinityPriority 1 <nil>} {TaintTolerationPriority 1 <nil>}] [{http://127.0.0.1:12021/nebula-scheduler filter   1  false <nil> 0s false [] false}] 0 false}
I0603 11:48:26.679197       1 factory.go:256] Registering predicate: NoVolumeZoneConflict
I0603 11:48:26.679209       1 legacy_registry.go:515] Predicate type NoVolumeZoneConflict already registered, reusing.
I0603 11:48:26.679221       1 factory.go:256] Registering predicate: MaxEBSVolumeCount
I0603 11:48:26.679231       1 legacy_registry.go:515] Predicate type MaxEBSVolumeCount already registered, reusing.
I0603 11:48:26.679242       1 factory.go:256] Registering predicate: MaxAzureDiskVolumeCount
I0603 11:48:26.679252       1 legacy_registry.go:515] Predicate type MaxAzureDiskVolumeCount already registered, reusing.
I0603 11:48:26.679262       1 factory.go:256] Registering predicate: NoDiskConflict
I0603 11:48:26.679272       1 legacy_registry.go:515] Predicate type NoDiskConflict already registered, reusing.
I0603 11:48:26.679282       1 factory.go:256] Registering predicate: GeneralPredicates
I0603 11:48:26.679293       1 legacy_registry.go:515] Predicate type GeneralPredicates already registered, reusing.
I0603 11:48:26.679303       1 factory.go:256] Registering predicate: PodToleratesNodeTaints
I0603 11:48:26.679313       1 legacy_registry.go:515] Predicate type PodToleratesNodeTaints already registered, reusing.
I0603 11:48:26.679323       1 factory.go:256] Registering predicate: CheckVolumeBinding
I0603 11:48:26.679333       1 legacy_registry.go:515] Predicate type CheckVolumeBinding already registered, reusing.
I0603 11:48:26.679343       1 factory.go:256] Registering predicate: MaxGCEPDVolumeCount
I0603 11:48:26.679354       1 legacy_registry.go:515] Predicate type MaxGCEPDVolumeCount already registered, reusing.
I0603 11:48:26.679370       1 factory.go:256] Registering predicate: MatchInterPodAffinity
I0603 11:48:26.679384       1 legacy_registry.go:515] Predicate type MatchInterPodAffinity already registered, reusing.
I0603 11:48:26.679400       1 factory.go:256] Registering predicate: CheckVolumeBinding
I0603 11:48:26.679413       1 legacy_registry.go:515] Predicate type CheckVolumeBinding already registered, reusing.
I0603 11:48:26.679428       1 factory.go:271] Registering priority: SelectorSpreadPriority
I0603 11:48:26.679444       1 legacy_registry.go:570] Priority type SelectorSpreadPriority already registered, reusing.
I0603 11:48:26.679460       1 factory.go:271] Registering priority: InterPodAffinityPriority
I0603 11:48:26.679476       1 legacy_registry.go:570] Priority type InterPodAffinityPriority already registered, reusing.
I0603 11:48:26.679491       1 factory.go:271] Registering priority: LeastRequestedPriority
I0603 11:48:26.679506       1 legacy_registry.go:570] Priority type LeastRequestedPriority already registered, reusing.
I0603 11:48:26.679521       1 factory.go:271] Registering priority: BalancedResourceAllocation
I0603 11:48:26.679535       1 legacy_registry.go:570] Priority type BalancedResourceAllocation already registered, reusing.
I0603 11:48:26.679550       1 factory.go:271] Registering priority: NodePreferAvoidPodsPriority
I0603 11:48:26.679562       1 legacy_registry.go:570] Priority type NodePreferAvoidPodsPriority already registered, reusing.
I0603 11:48:26.679572       1 factory.go:271] Registering priority: NodeAffinityPriority
I0603 11:48:26.679582       1 legacy_registry.go:570] Priority type NodeAffinityPriority already registered, reusing.
I0603 11:48:26.679596       1 factory.go:271] Registering priority: TaintTolerationPriority
I0603 11:48:26.679611       1 legacy_registry.go:570] Priority type TaintTolerationPriority already registered, reusing.
I0603 11:48:26.679629       1 factory.go:291] Creating scheduler with fit predicates 'map[CheckVolumeBinding:{} GeneralPredicates:{} MatchInterPodAffinity:{} MaxAzureDiskVolumeCount:{} MaxEBSVolumeCount:{} MaxGCEPDVolumeCount:{} NoDiskConflict:{} NoVolumeZoneConflict:{} PodToleratesNodeTaints:{}]' and priority functions 'map[BalancedResourceAllocation:1 InterPodAffinityPriority:1 LeastRequestedPriority:1 NodeAffinityPriority:1 NodePreferAvoidPodsPriority:1 SelectorSpreadPriority:1 TaintTolerationPriority:1]'
I0603 11:48:26.679710       1 factory.go:133] Creating extender with config {URLPrefix:http://127.0.0.1:12021/nebula-scheduler FilterVerb:filter PreemptVerb: PrioritizeVerb: Weight:1 BindVerb: EnableHTTPS:false TLSConfig:<nil> HTTPTimeout:0s NodeCacheCapable:false ManagedResources:[] Ignorable:false}
W0603 11:48:26.681350       1 authorization.go:47] Authorization is disabled
W0603 11:48:26.681369       1 authentication.go:40] Authentication is disabled
I0603 11:48:26.681383       1 deprecated_insecure_serving.go:51] Serving healthz insecurely on [::]:10251
I0603 11:48:26.767406       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0603 11:48:26.767438       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0603 11:48:26.767456       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0603 11:48:26.767459       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0603 11:48:26.767580       1 tlsconfig.go:200] loaded serving cert ["Generated self signed cert"]: "localhost@1654256897" [serving] validServingFor=[127.0.0.1,localhost,localhost] issuer="localhost-ca@1654256895" (2022-06-03 10:48:13 +0000 UTC to 2023-06-03 10:48:13 +0000 UTC (now=2022-06-03 11:48:26.767549244 +0000 UTC))
I0603 11:48:26.767725       1 reflector.go:175] Starting reflector *v1.ConfigMap (12h0m0s) from k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206
I0603 11:48:26.767752       1 reflector.go:175] Starting reflector *v1.ConfigMap (12h0m0s) from k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206
I0603 11:48:26.767929       1 named_certificates.go:53] loaded SNI cert [0/"self-signed loopback"]: "apiserver-loopback-client@1654256906" [serving] validServingFor=[apiserver-loopback-client] issuer="apiserver-loopback-client-ca@1654256902" (2022-06-03 10:48:17 +0000 UTC to 2023-06-03 10:48:17 +0000 UTC (now=2022-06-03 11:48:26.767906454 +0000 UTC))
I0603 11:48:26.767974       1 secure_serving.go:178] Serving securely on [::]:10261
I0603 11:48:26.768033       1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0603 11:48:26.768313       1 reflector.go:175] Starting reflector *v1.Service (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.768332       1 reflector.go:175] Starting reflector *v1.CSINode (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.768366       1 reflector.go:175] Starting reflector *v1.PersistentVolume (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.768427       1 reflector.go:175] Starting reflector *v1.ReplicaSet (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.768475       1 reflector.go:175] Starting reflector *v1.Node (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.768599       1 reflector.go:175] Starting reflector *v1.PersistentVolumeClaim (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.768480       1 reflector.go:175] Starting reflector *v1.StorageClass (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.768793       1 reflector.go:175] Starting reflector *v1.ReplicationController (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.768867       1 reflector.go:175] Starting reflector *v1.StatefulSet (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:26.867555       1 reflector.go:175] Starting reflector *v1.Pod (0s) from k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233
I0603 11:48:26.867763       1 reflector.go:175] Starting reflector *v1beta1.PodDisruptionBudget (0s) from k8s.io/client-go/informers/factory.go:135
I0603 11:48:27.067175       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0603 11:48:27.067276       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0603 11:48:27.067779       1 tlsconfig.go:178] loaded client CA [0/"client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"]: "ca" [] issuer="<self>" (2021-08-26 15:48:53 +0000 UTC to 2051-08-26 15:58:53 +0000 UTC (now=2022-06-03 11:48:27.067749825 +0000 UTC))
I0603 11:48:27.068130       1 tlsconfig.go:200] loaded serving cert ["Generated self signed cert"]: "localhost@1654256897" [serving] validServingFor=[127.0.0.1,localhost,localhost] issuer="localhost-ca@1654256895" (2022-06-03 10:48:13 +0000 UTC to 2023-06-03 10:48:13 +0000 UTC (now=2022-06-03 11:48:27.068108534 +0000 UTC))
I0603 11:48:27.068449       1 named_certificates.go:53] loaded SNI cert [0/"self-signed loopback"]: "apiserver-loopback-client@1654256906" [serving] validServingFor=[apiserver-loopback-client] issuer="apiserver-loopback-client-ca@1654256902" (2022-06-03 10:48:17 +0000 UTC to 2023-06-03 10:48:17 +0000 UTC (now=2022-06-03 11:48:27.068427943 +0000 UTC))
I0603 11:48:27.068852       1 tlsconfig.go:178] loaded client CA [0/"client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"]: "ca" [] issuer="<self>" (2021-08-26 15:48:53 +0000 UTC to 2051-08-26 15:58:53 +0000 UTC (now=2022-06-03 11:48:27.068832254 +0000 UTC))
I0603 11:48:27.068908       1 tlsconfig.go:178] loaded client CA [1/"client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"]: "agg-ca" [] issuer="<self>" (2021-08-26 15:48:53 +0000 UTC to 2051-08-26 15:58:53 +0000 UTC (now=2022-06-03 11:48:27.068889955 +0000 UTC))
I0603 11:48:27.068946       1 tlsconfig.go:178] loaded client CA [2/"client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"]: "agg-ca" [] issuer="<self>" (2022-02-25 22:12:53 +0000 UTC to 2052-02-25 22:22:53 +0000 UTC (now=2022-06-03 11:48:27.068928556 +0000 UTC))
I0603 11:48:27.068984       1 tlsconfig.go:178] loaded client CA [3/"client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"]: "agg-ca" [] issuer="<self>" (2022-04-29 23:28:05 +0000 UTC to 2052-04-29 23:38:05 +0000 UTC (now=2022-06-03 11:48:27.068972057 +0000 UTC))
I0603 11:48:27.069191       1 tlsconfig.go:200] loaded serving cert ["Generated self signed cert"]: "localhost@1654256897" [serving] validServingFor=[127.0.0.1,localhost,localhost] issuer="localhost-ca@1654256895" (2022-06-03 10:48:13 +0000 UTC to 2023-06-03 10:48:13 +0000 UTC (now=2022-06-03 11:48:27.069178563 +0000 UTC))
I0603 11:48:27.069393       1 named_certificates.go:53] loaded SNI cert [0/"self-signed loopback"]: "apiserver-loopback-client@1654256906" [serving] validServingFor=[apiserver-loopback-client] issuer="apiserver-loopback-client-ca@1654256902" (2022-06-03 10:48:17 +0000 UTC to 2023-06-03 10:48:17 +0000 UTC (now=2022-06-03 11:48:27.069379068 +0000 UTC))
I0603 11:48:27.468362       1 node_tree.go:86] Added node "aks-alpha-48919769-vmss000043" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.468515       1 node_tree.go:86] Added node "aks-data-19554029-vmss00001t" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.468656       1 node_tree.go:86] Added node "aks-master-19554029-vmss000000" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.468745       1 node_tree.go:86] Added node "aks-master-19554029-vmss000001" in group "westus2:\x00:westus2-2" to NodeTree
I0603 11:48:27.468826       1 node_tree.go:86] Added node "aks-storaged-27113300-vmss000008" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.468900       1 node_tree.go:86] Added node "aks-storaged-27113300-vmss000006" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.468978       1 node_tree.go:86] Added node "aks-alpha-48919769-vmss000044" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.469059       1 node_tree.go:86] Added node "aks-client-19554029-vmss000006" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.469185       1 node_tree.go:86] Added node "aks-client-19554029-vmss00000b" in group "westus2:\x00:westus2-3" to NodeTree
I0603 11:48:27.469299       1 node_tree.go:86] Added node "aks-data-19554029-vmss00001q" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.469371       1 node_tree.go:86] Added node "aks-data-19554029-vmss00001r" in group "westus2:\x00:westus2-2" to NodeTree
I0603 11:48:27.469452       1 node_tree.go:86] Added node "aks-zero-31489376-vmss00000e" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.469514       1 node_tree.go:86] Added node "aks-graphd-23670862-vmss000000" in group "westus2:\x00:0" to NodeTree
I0603 11:48:27.469589       1 node_tree.go:86] Added node "aks-master-19554029-vmss000002" in group "westus2:\x00:westus2-3" to NodeTree
I0603 11:48:27.469664       1 node_tree.go:86] Added node "aks-storaged-27113300-vmss000007" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.469735       1 node_tree.go:86] Added node "aks-metad-24303736-vmss000009" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.469830       1 node_tree.go:86] Added node "aks-alpha-48919769-vmss000042" in group "westus2:\x00:westus2-1" to NodeTree
I0603 11:48:27.469924       1 node_tree.go:86] Added node "aks-client-19554029-vmss00000a" in group "westus2:\x00:westus2-2" to NodeTree
I0603 11:48:27.470366       1 node_tree.go:86] Added node "aks-data-19554029-vmss00001s" in group "westus2:\x00:westus2-3" to NodeTree
I0603 11:48:27.470620       1 node_tree.go:86] Added node "aks-data-19554029-vmss00001u" in group "westus2:\x00:westus2-2" to NodeTree
I0603 11:48:27.567164       1 leaderelection.go:242] attempting to acquire leader lease  graph/nebula-operator-scheduler-elect-lock...

wey-gu · 2022-06-07T02:00:51Z

wey-gu
Jun 7, 2022
Collaborator

@MegaByte875 @veezhang do you see any of the values being changed to default configure could lead to the crash loop, please? I couldn't see clues from the log @porscheme already provided now. Thanks

0 replies

sunkararp · 2022-06-07T17:26:34Z

sunkararp
Jun 7, 2022

Thanks for reply. @wey-gu @veezhang

In K8s cluster, we have 3 dedicated VM scale sets for Nebula graph, namely metad, graphd and storaged
We added nodeSelector to scheduler because we don't want the pods to be created on random VMs scale sets. Please let us know, however, if graphd was the wrong VM scale set
Also per official docs, we set admissionWebhook.create to false to avoid installing cert-manager.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Nebula-operator: kube-scheduler container is crashloop #4299

{{title}}

Replies: 2 comments

{{title}}

{{title}}

Select a reply

Nebula-operator: kube-scheduler container is crashloop #4299

porscheme Jun 3, 2022

Replies: 2 comments

wey-gu Jun 7, 2022 Collaborator

sunkararp Jun 7, 2022

porscheme
Jun 3, 2022

wey-gu
Jun 7, 2022
Collaborator

sunkararp
Jun 7, 2022