New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Node not found after scale up in metrics #21224

Closed
mrafieee opened this Issue Oct 11, 2018 · 3 comments

Comments

Projects
None yet
4 participants
@mrafieee

mrafieee commented Oct 11, 2018

I tried scaleup.yml in openshift-ansible and provisioned new nodes to the cluster but the nodes are not showing up in metrics resources.

Version

oc v3.10.0+dd10d17
kubernetes v1.10.0+b81c8f8
features: Basic-Auth
Server https://****:443
openshift v3.9.0+ba7faec-1
kubernetes v1.9.1+a0ce1bc657

Steps To Reproduce
1.  compute1      Ready     compute   91d       v1.9.1+a0ce1bc657
compute2      Ready     compute   91d       v1.9.1+a0ce1bc657
compute3      Ready     compute   90d       v1.9.1+a0ce1bc657
compute4      Ready     compute   22h       v1.9.1+a0ce1bc657
compute5      Ready     compute   22h       v1.9.1+a0ce1bc657
infra1    Ready     infra     91d       v1.9.1+a0ce1bc657
infra2   Ready     infra     91d       v1.9.1+a0ce1bc657
infra3    Ready     infra     91d       v1.9.1+a0ce1bc657
master1   Ready     master    91d       v1.9.1+a0ce1bc657
master2   Ready     master    91d       v1.9.1+a0ce1bc657
master3   Ready     master    91d       v1.9.1+a0ce1bc657
2. 
oc adm top node compute5
Current Result
oc adm top node compute5
Error from server (NotFound): the server could not find the requested resource (get services https:heapster:)
Expected Result
oc adm top node compute5
NAME                             CPU(cores)   CPU%      MEMORY(bytes)   MEMORY%
compute5   685m         18%       9618Mi          62%
@jwforres

This comment has been minimized.

Show comment
Hide comment
@jwforres
Member

jwforres commented Oct 11, 2018

@mrafieee

This comment has been minimized.

Show comment
Hide comment
@mrafieee

mrafieee Oct 11, 2018

Looking like the scale up ansible script did not generate the certificates required in the node , digging more into this

oc logs heapster-k5dhw

E1011 17:22:05.028192       1 summary.go:97] error while getting metrics summary from Kubelet ********** (z.z.z.z:10250): Get https://z.z.z.z:10250/stats/summary/: x509: certificate is valid for x.x.x.x, y.y.y.y, not z.z.z.z

mrafieee commented Oct 11, 2018

Looking like the scale up ansible script did not generate the certificates required in the node , digging more into this

oc logs heapster-k5dhw

E1011 17:22:05.028192       1 summary.go:97] error while getting metrics summary from Kubelet ********** (z.z.z.z:10250): Get https://z.z.z.z:10250/stats/summary/: x509: certificate is valid for x.x.x.x, y.y.y.y, not z.z.z.z
@mrafieee

This comment has been minimized.

Show comment
Hide comment

mrafieee commented Oct 11, 2018

@mrafieee mrafieee closed this Oct 11, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment