why can't get service map

[tripitakav]

[apetruhin]

@tripitakav

• Which Coroot and coroot-node-agent versions are you using?
• Are there any errors in the logs?

[tripitakav]

@tripitakav

• Which Coroot and coroot-node-agent versions are you using?
• Are there any errors in the logs?

1. Coroot: v0.16.2 Node-agent:v1.7.6

There are no errors in the logs

[apetruhin]

Can you please share the output of the following Prometheus query?

node_info

[tripitakav]

Can you please share the output of the following Prometheus query?

node_info

[apetruhin]

We suspect that there are some issues with the way metrics are being relabeled, such as incorrect or missing labels.

Is this the right data source? The number of nodes doesn't match:

versus

[tripitakav]

I also think it should be due to incorrect or missing labels, because I deployed Coroot two months ago and everything was normal at that time. Then I deleted the namespace, and recently I had this issue when I was redeploying to demonstrate to the leader。

The data source is right,I'm just checking for node_info when selecting the metric, I chose staging-eks because the labels for both staging-eks and prod-hk metric are similar. Because I have deleted the prod-hk metric, only staging-eks have

[apetruhin]

@tripitakav
Let's check some other metric labels. One or two samples of each query will be enough:

1. kube_node_info
2. kube_pod_info
3. container_info

[apetruhin]

@tripitakav
We guess that the metrics from kube-state-metrics (e.g., kube_pod_info, kube_pod_labels) no longer include the uid label after the relabeling process. Coroot needs this label to load application instances.

[tripitakav]

@tripitakav Let's check some other metric labels. One or two samples of each query will be enough:

1. kube_node_info
2. kube_pod_info
3. container_info

2.

3.

[tripitakav]

@tripitakav We guess that the metrics from kube-state-metrics (e.g., kube_pod_info, kube_pod_labels) no longer include the uid label after the relabeling process. Coroot needs this label load application instances.

Yes,it don't has label include uid

[apetruhin]

Consider removing the rule that drops the uid label.