Kubectl top no doesn't wotk when using HPA without heapster #59438

yastij · 2018-02-06T21:48:54Z

Currently

kubectl top no

Doesn't work when using HPA without heapster, there's some files to change under utilmetrics/

we might want this for 1.10

/assign
/sig cli

The text was updated successfully, but these errors were encountered:

yastij · 2018-02-06T21:49:28Z

/area kubectl

yastij · 2018-02-07T16:43:23Z

cc @DirectXMan12

DirectXMan12 · 2018-02-09T18:31:03Z

can you clarify what you mean? #56206 should have solved this issue for 1.10.

yastij · 2018-02-09T19:20:14Z

When using metrics-server instead of heapster top no still looks for heapster

DirectXMan12 · 2018-02-09T19:34:22Z

Have you registered the metrics API with your API server? Can you provide the output of kubectl top nodes --v=10? Are you certain you have a fresh discovery cache? The code is there to pull from metrics server, when it's available.

pawankkamboj · 2018-02-21T06:33:54Z

We are facing the same issue with 1.9.3 version, here is output from top nodes

[root@docker01 metrics-server]# kubectl top nodes --v=10
I0221 12:00:49.725780   30017 loader.go:354] Config loaded from file /root/.kube/config
I0221 12:00:49.728051   30017 cached_discovery.go:118] returning cached discovery info from /root/.kube/cache/discovery/192.168.61.6_5443/servergroups.json
I0221 12:00:49.729254   30017 round_trippers.go:398] curl -k -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubectl/v1.6.6 (linux/amd64) kubernetes/7fa1c17" https://192.168.61.6:5443/api/v1/namespaces/kube-system/services/http:heapster:/proxy/apis/metrics/v1alpha1/nodes?labelSelector=
I0221 12:00:49.791600   30017 round_trippers.go:417] GET https://192.168.61.6:5443/api/v1/namespaces/kube-system/services/http:heapster:/proxy/apis/metrics/v1alpha1/nodes?labelSelector= 404 Not Found in 62 milliseconds
I0221 12:00:49.791640   30017 round_trippers.go:423] Response Headers:
I0221 12:00:49.791652   30017 round_trippers.go:426]     Content-Length: 192
I0221 12:00:49.791663   30017 round_trippers.go:426]     Date: Wed, 21 Feb 2018 06:30:49 GMT
I0221 12:00:49.791674   30017 round_trippers.go:426]     Content-Type: application/json
I0221 12:00:49.791742   30017 request.go:991] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"services \"heapster\" not found","reason":"NotFound","details":{"name":"heapster","kind":"services"},"code":404}
I0221 12:00:49.791974   30017 helpers.go:206] server response object: [{
  "metadata": {},
  "status": "Failure",
  "message": "the server could not find the requested resource (get services http:heapster:)",
  "reason": "NotFound",
  "details": {
    "name": "http:heapster:",
    "kind": "services",
    "causes": [
      {
        "reason": "UnexpectedServerResponse",
        "message": "unknown"
      }
    ]
  },
  "code": 404
}]
F0221 12:00:49.792072   30017 helpers.go:119] Error from server (NotFound): the server could not find the requested resource (get services http:heapster:)

Hete metrics server info

[root@docker01 metrics-server]# kubectl cluster-info
Kubernetes master is running at https://192.168.61.6:5443
CoreDNS is running at https://192.168.61.6:5443/api/v1/proxy/namespaces/kube-system/services/kube-dns
Metrics-server is running at https://192.168.61.6:5443/api/v1/proxy/namespaces/kube-system/services/metrics-server

To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.
[root@docker01 metrics-server]# kubectl get --raw "/apis/metrics.k8s.io/v1beta1/"
{"kind":"APIResourceList","apiVersion":"v1","groupVersion":"metrics.k8s.io/v1beta1","resources":[{"name":"nodes","singularName":"","namespaced":false,"kind":"NodeMetrics","verbs":["get","list"]},{"name":"pods","singularName":"","namespaced":true,"kind":"PodMetrics","verbs":["get","list"]}]}
[root@docker01 metrics-server]#

HPA is working fine, but only issue is with kubectl top

DirectXMan12 · 2018-02-22T19:45:39Z

1.9.3 will have the issue, since the fix merged for 1.10

yastij · 2018-03-21T13:35:42Z

@DirectXMan12 - closing this one, since this is landing in 1.10.

george-angel · 2018-07-10T11:20:43Z

I'm getting this exact same problem:

$ kubectl --context=exp-1 version
Client Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.4", GitCommit:"5ca598b4ba5abb89bb773071ce452e33fb66339d", GitTreeState:"clean", BuildDate:"2018-06-06T08:13:03Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"11", GitVersion:"v1.11.0", GitCommit:"91e7b4fd31fcd3d5f436da26c980becec37ceefe", GitTreeState:"clean", BuildDate:"2018-06-27T20:08:34Z", GoVersion:"go1.10.2", Compiler:"gc", Platform:"linux/amd64"}

$ kubectl --context=exp-1 --v=10 top node
I0710 12:20:05.040094   25083 loader.go:357] Config loaded from file /home/george/.kube/config
I0710 12:20:05.041846   25083 round_trippers.go:386] curl -k -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubectl/v1.10.4 (linux/amd64) kubernetes/5ca598b" https://elb.master.k8s-exp-1.dev.uw.systems/api
I0710 12:20:05.213848   25083 round_trippers.go:405] GET https://elb.master.k8s-exp-1.dev.uw.systems/api 200 OK in 171 milliseconds
I0710 12:20:05.213949   25083 round_trippers.go:411] Response Headers:
I0710 12:20:05.213971   25083 round_trippers.go:414]     Content-Type: application/json
I0710 12:20:05.214001   25083 round_trippers.go:414]     Content-Length: 157
I0710 12:20:05.214068   25083 round_trippers.go:414]     Date: Tue, 10 Jul 2018 11:20:05 GMT
I0710 12:20:05.214147   25083 request.go:874] Response Body: {"kind":"APIVersions","versions":["v1"],"serverAddressByClientCIDRs":[{"clientCIDR":"0.0.0.0/0","serverAddress":"elb.master.k8s-exp-1.dev.uw.systems:443"}]}
I0710 12:20:05.214831   25083 round_trippers.go:386] curl -k -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubectl/v1.10.4 (linux/amd64) kubernetes/5ca598b" https://elb.master.k8s-exp-1.dev.uw.systems/apis
I0710 12:20:05.230011   25083 round_trippers.go:405] GET https://elb.master.k8s-exp-1.dev.uw.systems/apis 200 OK in 15 milliseconds
I0710 12:20:05.230048   25083 round_trippers.go:411] Response Headers:
I0710 12:20:05.230071   25083 round_trippers.go:414]     Content-Type: application/json
I0710 12:20:05.230091   25083 round_trippers.go:414]     Content-Length: 3610
I0710 12:20:05.230111   25083 round_trippers.go:414]     Date: Tue, 10 Jul 2018 11:20:05 GMT
I0710 12:20:05.230929   25083 request.go:874] Response Body: {"kind":"APIGroupList","apiVersion":"v1","groups":[{"name":"apiregistration.k8s.io","versions":[{"groupVersion":"apiregistration.k8s.io/v1","version":"v1"},{"groupVersion":"apiregistration.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apiregistration.k8s.io/v1","version":"v1"}},{"name":"extensions","versions":[{"groupVersion":"extensions/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"extensions/v1beta1","version":"v1beta1"}},{"name":"apps","versions":[{"groupVersion":"apps/v1","version":"v1"},{"groupVersion":"apps/v1beta2","version":"v1beta2"},{"groupVersion":"apps/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apps/v1","version":"v1"}},{"name":"events.k8s.io","versions":[{"groupVersion":"events.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"events.k8s.io/v1beta1","version":"v1beta1"}},{"name":"authentication.k8s.io","versions":[{"groupVersion":"authentication.k8s.io/v1","version":"v1"},{"groupVersion":"authentication.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"authentication.k8s.io/v1","version":"v1"}},{"name":"authorization.k8s.io","versions":[{"groupVersion":"authorization.k8s.io/v1","version":"v1"},{"groupVersion":"authorization.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"authorization.k8s.io/v1","version":"v1"}},{"name":"autoscaling","versions":[{"groupVersion":"autoscaling/v1","version":"v1"},{"groupVersion":"autoscaling/v2beta1","version":"v2beta1"}],"preferredVersion":{"groupVersion":"autoscaling/v1","version":"v1"}},{"name":"batch","versions":[{"groupVersion":"batch/v1","version":"v1"},{"groupVersion":"batch/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"batch/v1","version":"v1"}},{"name":"certificates.k8s.io","versions":[{"groupVersion":"certificates.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"certificates.k8s.io/v1beta1","version":"v1beta1"}},{"name":"networking.k8s.io","versions":[{"groupVersion":"networking.k8s.io/v1","version":"v1"}],"preferredVersion":{"groupVersion":"networking.k8s.io/v1","version":"v1"}},{"name":"policy","versions":[{"groupVersion":"policy/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"policy/v1beta1","version":"v1beta1"}},{"name":"rbac.authorization.k8s.io","versions":[{"groupVersion":"rbac.authorization.k8s.io/v1","version":"v1"},{"groupVersion":"rbac.authorization.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"rbac.authorization.k8s.io/v1","version":"v1"}},{"name":"storage.k8s.io","versions":[{"groupVersion":"storage.k8s.io/v1","version":"v1"},{"groupVersion":"storage.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"storage.k8s.io/v1","version":"v1"}},{"name":"admissionregistration.k8s.io","versions":[{"groupVersion":"admissionregistration.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"admissionregistration.k8s.io/v1beta1","version":"v1beta1"}},{"name":"apiextensions.k8s.io","versions":[{"groupVersion":"apiextensions.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apiextensions.k8s.io/v1beta1","version":"v1beta1"}},{"name":"scheduling.k8s.io","versions":[{"groupVersion":"scheduling.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"scheduling.k8s.io/v1beta1","version":"v1beta1"}},{"name":"crd.projectcalico.org","versions":[{"groupVersion":"crd.projectcalico.org/v1","version":"v1"}],"preferredVersion":{"groupVersion":"crd.projectcalico.org/v1","version":"v1"}}]}
I0710 12:20:05.232292   25083 round_trippers.go:386] curl -k -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubectl/v1.10.4 (linux/amd64) kubernetes/5ca598b" https://elb.master.k8s-exp-1.dev.uw.systems/api/v1/namespaces/kube-system/services/http:heapster:/proxy/apis/metrics/v1alpha1/nodes?labelSelector=
I0710 12:20:05.248004   25083 round_trippers.go:405] GET https://elb.master.k8s-exp-1.dev.uw.systems/api/v1/namespaces/kube-system/services/http:heapster:/proxy/apis/metrics/v1alpha1/nodes?labelSelector= 404 Not Found in 15 milliseconds
I0710 12:20:05.248064   25083 round_trippers.go:411] Response Headers:
I0710 12:20:05.248084   25083 round_trippers.go:414]     Content-Type: application/json
I0710 12:20:05.248100   25083 round_trippers.go:414]     Content-Length: 192
I0710 12:20:05.248125   25083 round_trippers.go:414]     Date: Tue, 10 Jul 2018 11:20:05 GMT
I0710 12:20:05.248965   25083 request.go:874] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"services \"heapster\" not found","reason":"NotFound","details":{"name":"heapster","kind":"services"},"code":404}
I0710 12:20:05.249385   25083 helpers.go:201] server response object: [{
  "metadata": {},
  "status": "Failure",
  "message": "the server could not find the requested resource (get services http:heapster:)",
  "reason": "NotFound",
  "details": {
    "name": "http:heapster:",
    "kind": "services",
    "causes": [
      {
        "reason": "UnexpectedServerResponse",
        "message": "unknown"
      }
    ]
  },
  "code": 404
}]
F0710 12:20:05.249449   25083 helpers.go:119] Error from server (NotFound): the server could not find the requested resource (get services http:heapster:)

george-angel · 2018-07-10T14:01:48Z

No, I'm sorry, that was my fault, I had to fix netpols to allow apiserver to access metrics-server pod.

HaymonEdmur · 2018-08-02T18:08:58Z

$ kubectl top pod boston-pod
Error from server (NotFound): the server could not find the requested resource (get services http:heapster:)

Is there any other way to get cpu/mem usage for a pod?

mariojacobo · 2018-08-08T08:32:47Z

+1

"message": "the server is currently unable to handle the request (get services http:heapster:)",
"reason": "ServiceUnavailable",
"details": {
"name": "http:heapster:",
"kind": "services",
"causes": [
{
"reason": "UnexpectedServerResponse",
"message": "Error: 'dial tcp 10.48.0.70:8082: getsockopt: connection timed out'\nTrying to reach: 'http://10.48.0.70:8082/apis/metrics/v1alpha1/namespaces/default/pods?labelSelector='"

We have both heapster and metrics-server, so not really sure which one should fetch the information.

service/heapster ClusterIP 10.0.20.249 80/TCP 7d
service/kube-dns ClusterIP 10.0.16.10 53/UDP,53/TCP 7d
service/kubernetes-dashboard ClusterIP 10.0.22.112 80/TCP 7d
service/metrics-server ClusterIP 10.0.26.120 443/TCP 5d

Art-Man · 2018-11-02T07:23:09Z

+1

[root@master0 ~]# kubectl cluster-info
Kubernetes master is running at https://127.0.0.1:6443
CoreDNS is running at https://127.0.0.1:6443/api/v1/namespaces/kube-system/services/coredns:dns/proxy
kubernetes-dashboard is running at https://127.0.0.1:6443/api/v1/namespaces/kube-system/services/https:kubernetes-dashboard:/proxy

To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.

[root@master0 ~]# kubectl top nodes --v=10
I1102 15:00:02.853058 25381 loader.go:357] Config loaded from file /root/.kube/config
I1102 15:00:02.858059 25381 round_trippers.go:387] curl -k -v -XGET -H "User-Agent: kubectl/v1.10.7 (linux/amd64) kubernetes/0c38c36" -H "Accept: application/json, /" https://127.0.0.1:6443/api
I1102 15:00:02.876029 25381 round_trippers.go:406] GET https://127.0.0.1:6443/api 200 OK in 17 milliseconds
I1102 15:00:02.876084 25381 round_trippers.go:412] Response Headers:
I1102 15:00:02.876112 25381 round_trippers.go:415] Content-Type: application/json
I1102 15:00:02.876142 25381 round_trippers.go:415] Content-Length: 133
I1102 15:00:02.876170 25381 round_trippers.go:415] Date: Fri, 02 Nov 2018 07:00:02 GMT
I1102 15:00:02.876283 25381 request.go:874] Response Body: {"kind":"APIVersions","versions":["v1"],"serverAddressByClientCIDRs":[{"clientCIDR":"0.0.0.0/0","serverAddress":"10.6.0.101:6443"}]}
I1102 15:00:02.876974 25381 round_trippers.go:387] curl -k -v -XGET -H "Accept: application/json, /" -H "User-Agent: kubectl/v1.10.7 (linux/amd64) kubernetes/0c38c36" https://127.0.0.1:6443/apis
I1102 15:00:02.878348 25381 round_trippers.go:406] GET https://127.0.0.1:6443/apis 200 OK in 1 milliseconds
I1102 15:00:02.878384 25381 round_trippers.go:412] Response Headers:
I1102 15:00:02.878410 25381 round_trippers.go:415] Content-Type: application/json
I1102 15:00:02.878433 25381 round_trippers.go:415] Content-Length: 3746
I1102 15:00:02.878454 25381 round_trippers.go:415] Date: Fri, 02 Nov 2018 07:00:02 GMT
I1102 15:00:02.878534 25381 request.go:874] Response Body: {"kind":"APIGroupList","apiVersion":"v1","groups":[{"name":"apiregistration.k8s.io","versions":[{"groupVersion":"apiregistration.k8s.io/v1","version":"v1"},{"groupVersion":"apiregistration.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apiregistration.k8s.io/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"extensions","versions":[{"groupVersion":"extensions/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"extensions/v1beta1","version":"v1beta1"},"serverAddressByClientCIDRs":null},{"name":"apps","versions":[{"groupVersion":"apps/v1","version":"v1"},{"groupVersion":"apps/v1beta2","version":"v1beta2"},{"groupVersion":"apps/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apps/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"events.k8s.io","versions":[{"groupVersion":"events.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"events.k8s.io/v1beta1","version":"v1beta1"},"serverAddressByClientCIDRs":null},{"name":"authentication.k8s.io","versions":[{"groupVersion":"authentication.k8s.io/v1","version":"v1"},{"groupVersion":"authentication.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"authentication.k8s.io/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"authorization.k8s.io","versions":[{"groupVersion":"authorization.k8s.io/v1","version":"v1"},{"groupVersion":"authorization.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"authorization.k8s.io/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"autoscaling","versions":[{"groupVersion":"autoscaling/v1","version":"v1"},{"groupVersion":"autoscaling/v2beta1","version":"v2beta1"}],"preferredVersion":{"groupVersion":"autoscaling/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"batch","versions":[{"groupVersion":"batch/v1","version":"v1"},{"groupVersion":"batch/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"batch/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"certificates.k8s.io","versions":[{"groupVersion":"certificates.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"certificates.k8s.io/v1beta1","version":"v1beta1"},"serverAddressByClientCIDRs":null},{"name":"networking.k8s.io","versions":[{"groupVersion":"networking.k8s.io/v1","version":"v1"}],"preferredVersion":{"groupVersion":"networking.k8s.io/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"policy","versions":[{"groupVersion":"policy/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"policy/v1beta1","version":"v1beta1"},"serverAddressByClientCIDRs":null},{"name":"rbac.authorization.k8s.io","versions":[{"groupVersion":"rbac.authorization.k8s.io/v1","version":"v1"},{"groupVersion":"rbac.authorization.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"rbac.authorization.k8s.io/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"storage.k8s.io","versions":[{"groupVersion":"storage.k8s.io/v1","version":"v1"},{"groupVersion":"storage.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"storage.k8s.io/v1","version":"v1"},"serverAddressByClientCIDRs":null},{"name":"admissionregistration.k8s.io","versions":[{"groupVersion":"admissionregistration.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"admissionregistration.k8s.io/v1beta1","version":"v1beta1"},"serverAddressByClientCIDRs":null},{"name":"apiextensions.k8s.io","versions":[{"groupVersion":"apiextensions.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apiextensions.k8s.io/v1beta1","version":"v1beta1"},"serverAddressByClientCIDRs":null}]}
I1102 15:00:02.879286 25381 round_trippers.go:387] curl -k -v -XGET -H "Accept: application/json, /" -H "User-Agent: kubectl/v1.10.7 (linux/amd64) kubernetes/0c38c36" https://127.0.0.1:6443/api/v1/namespaces/kube-system/services/http:heapster:/proxy/apis/metrics/v1alpha1/nodes?labelSelector=
I1102 15:00:02.884683 25381 round_trippers.go:406] GET https://127.0.0.1:6443/api/v1/namespaces/kube-system/services/http:heapster:/proxy/apis/metrics/v1alpha1/nodes?labelSelector= 404 Not Found in 5 milliseconds
I1102 15:00:02.884749 25381 round_trippers.go:412] Response Headers:
I1102 15:00:02.884777 25381 round_trippers.go:415] Content-Type: application/json
I1102 15:00:02.884796 25381 round_trippers.go:415] Content-Length: 192
I1102 15:00:02.884824 25381 round_trippers.go:415] Date: Fri, 02 Nov 2018 07:00:02 GMT
I1102 15:00:02.884891 25381 request.go:874] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"services "heapster" not found","reason":"NotFound","details":{"name":"heapster","kind":"services"},"code":404}
I1102 15:00:02.885222 25381 helpers.go:201] server response object: [{
"metadata": {},
"status": "Failure",
"message": "the server could not find the requested resource (get services http:heapster:)",
"reason": "NotFound",
"details": {
"name": "http:heapster:",
"kind": "services",
"causes": [
{
"reason": "UnexpectedServerResponse",
"message": "unknown"
}
]
},
"code": 404
}]
F1102 15:00:02.885295 25381 helpers.go:119] Error from server (NotFound): the server could not find the requested resource (get services http:heapster:)

DirectXMan12 · 2018-11-07T19:22:59Z

@mariojacobo make sure you're using a version of kubectl from kubernetes 1.10+. @Art-Man it doesn't look like you have the metrics API available (check that list of APIs in the output for metrics.k8s.io). Make sure it's registered in kubectl get apiservices.

pulpbill · 2018-12-14T12:49:02Z

Same, I have kube-state-metrics in the cluster, can't I get top from it?

I1214 09:38:35.675417 23770 round_trippers.go:442] Response Headers: I1214 09:38:35.675449 23770 round_trippers.go:445] Content-Type: application/json I1214 09:38:35.675478 23770 round_trippers.go:445] Content-Length: 192 I1214 09:38:35.675495 23770 round_trippers.go:445] Date: Fri, 14 Dec 2018 12:38:35 GMT I1214 09:38:35.675591 23770 request.go:836] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"services \"heapster\" not found","reason":"NotFound","details":{"name":"heapster","kind":"services"},"code":404} I1214 09:38:35.676064 23770 helpers.go:207] server response object: [{ "metadata": {}, "status": "Failure", "message": "the server could not find the requested resource (get services http:heapster:)", "reason": "NotFound", "details": { "name": "http:heapster:", "kind": "services", "causes": [ { "reason": "UnexpectedServerResponse", "message": "unknown" } ] }, "code": 404 }] F1214 09:38:35.676158 23770 helpers.go:120] Error from server (NotFound): the server could not find the requested resource (get services http:heapster:)

zedtux · 2019-01-09T09:36:38Z

I have a k8s 1.13 cluster running and have the same error message than @HaymonEdmur from his comment.

I've checked the presence of metrics.k8s.io as told by @DirectXMan12 and it was missing.
I have installed it from the kubernetes-incubator/metrics-server project with the kubectl create -f deploy/1.8+/ command.
Now the metrics.k8s.io api service is present from the output of the kubectl get apiservices command.

Now when I'm running the top command, I have the following :

$ kubectl top nodes
error: metrics not available yet

$ kubectl top pods

The kubectl top nodes returns the error message directly, it sad by okay.
The kubectl top pods returns nothing and that's really surprising me as I have running pods.

Is there anything I'm doing wrong here?

k8s-ci-robot assigned yastij Feb 6, 2018

k8s-ci-robot added the sig/cli Categorizes an issue or PR as relevant to SIG CLI. label Feb 6, 2018

k8s-ci-robot added the area/kubectl label Feb 6, 2018

yastij changed the title ~~Kubectl top no doesn't wotk when using HPA without prometheus~~ Kubectl top no doesn't wotk when using HPA without heapster Feb 6, 2018

yastij closed this as completed Mar 21, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Kubectl top no doesn't wotk when using HPA without heapster #59438

Kubectl top no doesn't wotk when using HPA without heapster #59438

yastij commented Feb 6, 2018 •

edited

yastij commented Feb 6, 2018

yastij commented Feb 7, 2018

DirectXMan12 commented Feb 9, 2018

yastij commented Feb 9, 2018

DirectXMan12 commented Feb 9, 2018

pawankkamboj commented Feb 21, 2018 •

edited

DirectXMan12 commented Feb 22, 2018

yastij commented Mar 21, 2018

george-angel commented Jul 10, 2018 •

edited

george-angel commented Jul 10, 2018

HaymonEdmur commented Aug 2, 2018

mariojacobo commented Aug 8, 2018

Art-Man commented Nov 2, 2018

DirectXMan12 commented Nov 7, 2018

pulpbill commented Dec 14, 2018 •

edited

zedtux commented Jan 9, 2019

Kubectl top no doesn't wotk when using HPA without heapster #59438

Kubectl top no doesn't wotk when using HPA without heapster #59438

Comments

yastij commented Feb 6, 2018 • edited

yastij commented Feb 6, 2018

yastij commented Feb 7, 2018

DirectXMan12 commented Feb 9, 2018

yastij commented Feb 9, 2018

DirectXMan12 commented Feb 9, 2018

pawankkamboj commented Feb 21, 2018 • edited

DirectXMan12 commented Feb 22, 2018

yastij commented Mar 21, 2018

george-angel commented Jul 10, 2018 • edited

george-angel commented Jul 10, 2018

HaymonEdmur commented Aug 2, 2018

mariojacobo commented Aug 8, 2018

Art-Man commented Nov 2, 2018

DirectXMan12 commented Nov 7, 2018

pulpbill commented Dec 14, 2018 • edited

zedtux commented Jan 9, 2019

yastij commented Feb 6, 2018 •

edited

pawankkamboj commented Feb 21, 2018 •

edited

george-angel commented Jul 10, 2018 •

edited

pulpbill commented Dec 14, 2018 •

edited