Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Controller manager failed to be started when rollback from v1.8.3 to v1.7.3 #56574

Closed
liqlin2015 opened this issue Nov 29, 2017 · 13 comments
Closed

Controller manager failed to be started when rollback from v1.8.3 to v1.7.3 #56574

liqlin2015 opened this issue Nov 29, 2017 · 13 comments
Labels
lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. sig/apps Categorizes an issue or PR as relevant to SIG Apps.
Projects
Workloads

Comments

@liqlin2015
Copy link

Is this a BUG REPORT or FEATURE REQUEST?:

/kind bug

What happened:

I had a kubernetes v1.8.3 cluster setup and running fine. Then I rollback kubernetes core services apiserver, controller-manager and scheduler to v1.7.3 for some verification.

However controller manager can not be started due to following error

I1129 14:10:31.740716       1 feature_gate.go:144] feature gates: map[TaintBasedEvictions:true PersistentLocalVolumes:true]
I1129 14:10:31.745389       1 controllermanager.go:107] Version: v1.7.3-11
I1129 14:10:31.754805       1 leaderelection.go:179] attempting to acquire leader lease...
I1129 14:10:31.777706       1 leaderelection.go:189] successfully acquired lease kube-system/kube-controller-manager
I1129 14:10:31.781626       1 event.go:218] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"kube-controller-manager", UID:"179186cf-d4aa-11e7-a20a-fa163e711521", APIVersion:"v1", ResourceVersion:"62502", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' qing-4.novalocal became leader
F1129 14:10:32.033106       1 controllermanager.go:176] error building controller context: failed to get supported resources from server: unable to retrieve the complete list of server APIs: apps/v1beta2: the server could not find the requested resource, autoscaling/v2beta1: the server could not find the requested resource, batch/v1beta1: the server could not find the requested resource, rbac.authorization.k8s.io/v1: the server could not find the requested resource

What you expected to happen:

Kubernetes core services apiserver, controler manager and scheduler should be started successfully in the rollback case.

How to reproduce it (as minimally and precisely as possible):

  1. Set up a v1.8.3 kubernetes cluster. Create some deployment/statefulset/daemonset/rbac roles.
  2. Rollback kubernetes to v1.7.3.

Anything else we need to know?:

Environment: None

  • Kubernetes version (use kubectl version):
  • Cloud provider or hardware configuration: None
  • OS (e.g. from /etc/os-release): Ubuntu 16.04
  • Kernel (e.g. uname -a):
  • Install tools: self-defined
  • Others:
@k8s-github-robot k8s-github-robot added the needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. label Nov 29, 2017
@liqlin2015
Copy link
Author

/sig apps

@k8s-ci-robot k8s-ci-robot added the sig/apps Categorizes an issue or PR as relevant to SIG Apps. label Nov 29, 2017
@k8s-github-robot k8s-github-robot removed the needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. label Nov 29, 2017
@liggitt
Copy link
Member

liggitt commented Nov 29, 2017

Was the controller manager rolled back as well?

@liqlin2015
Copy link
Author

@liggitt Yes. I have rolled back all apiserver, controller manager, scheduler, kube-proxy and kubelet services back to v1.7.3

@liqlin2015
Copy link
Author

Should I restore ETCD data before roll back to v1.7.3

@liggitt
Copy link
Member

liggitt commented Nov 30, 2017

What is the output of

kubectl version
kubectl api-versions
kubectl get apiservices -o yaml

@hzxuzhonghu
Copy link
Member

Enables the v1beta2 version of the apps API group by default #50643

Seems group version is not enabled in 1.7.3

@liqlin2015
Copy link
Author 

# kubectl -s 127.0.0.1:8888 version
Client Version: version.Info{Major:"1", Minor:"8", GitVersion:"v1.8.3", GitCommit:"f0efb3cb883751c5ffdbe6d515f3cb4fbe7b7acd", GitTreeState:"clean", BuildDate:"2017-11-08T18:39:33Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"7+", GitVersion:"v1.7.3", GitCommit:"f747daa02c9ffba3fabc9f679b5003b3f7fcb2c0", GitTreeState:"clean", BuildDate:"2017-08-28T07:04:45Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}

# kubectl -s 127.0.0.1:8888 api-versions
admissionregistration.k8s.io/v1alpha1
apiextensions.k8s.io/v1beta1
apiregistration.k8s.io/v1beta1
apps/v1beta1
apps/v1beta2
authentication.k8s.io/v1
authentication.k8s.io/v1beta1
authorization.k8s.io/v1
authorization.k8s.io/v1beta1
autoscaling/v1
autoscaling/v2beta1
batch/v1
batch/v1beta1
batch/v2alpha1
certificates.k8s.io/v1beta1
extensions/v1beta1
networking.k8s.io/v1
policy/v1beta1
rbac.authorization.k8s.io/v1
rbac.authorization.k8s.io/v1alpha1
rbac.authorization.k8s.io/v1beta1
settings.k8s.io/v1alpha1
storage.k8s.io/v1
storage.k8s.io/v1beta1
v1

# kubectl -s 127.0.0.1:8888 get apiservices -o yaml
apiVersion: v1
items:
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:37Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1.
    namespace: ""
    resourceVersion: "158117"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1.
    uid: e538baf6-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    groupPriorityMinimum: 18000
    service: null
    version: v1
    versionPriority: 1
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:37Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1.authentication.k8s.io
    namespace: ""
    resourceVersion: "158111"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1.authentication.k8s.io
    uid: e5d1db2e-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: authentication.k8s.io
    groupPriorityMinimum: 17700
    service: null
    version: v1
    versionPriority: 15
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1.authorization.k8s.io
    namespace: ""
    resourceVersion: "158104"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1.authorization.k8s.io
    uid: e5d1f1c9-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: authorization.k8s.io
    groupPriorityMinimum: 17600
    service: null
    version: v1
    versionPriority: 15
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1.autoscaling
    namespace: ""
    resourceVersion: "158110"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1.autoscaling
    uid: e5d22969-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: autoscaling
    groupPriorityMinimum: 17500
    service: null
    version: v1
    versionPriority: 15
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1.batch
    namespace: ""
    resourceVersion: "158098"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1.batch
    uid: e5d2d3ce-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: batch
    groupPriorityMinimum: 17400
    service: null
    version: v1
    versionPriority: 15
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1.networking.k8s.io
    namespace: ""
    resourceVersion: "158112"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1.networking.k8s.io
    uid: e5d3b85a-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: networking.k8s.io
    groupPriorityMinimum: 17200
    service: null
    version: v1
    versionPriority: 15
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1.rbac.authorization.k8s.io
    namespace: ""
    resourceVersion: "158105"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1.rbac.authorization.k8s.io
    uid: e5d3c0db-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: rbac.authorization.k8s.io
    groupPriorityMinimum: 17000
    service: null
    version: v1
    versionPriority: 15
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1.storage.k8s.io
    namespace: ""
    resourceVersion: "158106"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1.storage.k8s.io
    uid: e5d3c1dd-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: storage.k8s.io
    groupPriorityMinimum: 16800
    service: null
    version: v1
    versionPriority: 15
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:37Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1alpha1.admissionregistration.k8s.io
    namespace: ""
    resourceVersion: "158113"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1alpha1.admissionregistration.k8s.io
    uid: e538b2cf-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: admissionregistration.k8s.io
    groupPriorityMinimum: 16700
    service: null
    version: v1alpha1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:37Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-30T06:11:11Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: "true"
    name: v1alpha1.rbac.authorization.k8s.io
    namespace: ""
    resourceVersion: "158128"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1alpha1.rbac.authorization.k8s.io
    uid: 435fbee5-d595-11e7-a4fe-fa163e3f492b
  spec:
    caBundle: null
    group: rbac.authorization.k8s.io
    groupPriorityMinimum: 17000
    service: null
    version: v1alpha1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-30T06:11:11Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-30T06:11:11Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: "true"
    name: v1alpha1.settings.k8s.io
    namespace: ""
    resourceVersion: "158129"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1alpha1.settings.k8s.io
    uid: 435fd9dc-d595-11e7-a4fe-fa163e3f492b
  spec:
    caBundle: null
    group: settings.k8s.io
    groupPriorityMinimum: 16900
    service: null
    version: v1alpha1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-30T06:11:11Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:37Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.apiextensions.k8s.io
    namespace: ""
    resourceVersion: "158107"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.apiextensions.k8s.io
    uid: e538c224-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: apiextensions.k8s.io
    groupPriorityMinimum: 16700
    service: null
    version: v1beta1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:37Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:37Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.apps
    namespace: ""
    resourceVersion: "158108"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.apps
    uid: e538c720-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: apps
    groupPriorityMinimum: 17800
    service: null
    version: v1beta1
    versionPriority: 1
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:37Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.authentication.k8s.io
    namespace: ""
    resourceVersion: "158099"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.authentication.k8s.io
    uid: e5d1d79b-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: authentication.k8s.io
    groupPriorityMinimum: 17700
    service: null
    version: v1beta1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.authorization.k8s.io
    namespace: ""
    resourceVersion: "158096"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.authorization.k8s.io
    uid: e5d20396-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: authorization.k8s.io
    groupPriorityMinimum: 17600
    service: null
    version: v1beta1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.batch
    namespace: ""
    resourceVersion: "158109"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.batch
    uid: e5d2e20f-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: batch
    groupPriorityMinimum: 17400
    service: null
    version: v1beta1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.certificates.k8s.io
    namespace: ""
    resourceVersion: "158100"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.certificates.k8s.io
    uid: e5d2eac9-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: certificates.k8s.io
    groupPriorityMinimum: 17300
    service: null
    version: v1beta1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.extensions
    namespace: ""
    resourceVersion: "158114"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.extensions
    uid: e5d351d2-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: extensions
    groupPriorityMinimum: 17900
    service: null
    version: v1beta1
    versionPriority: 1
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.policy
    namespace: ""
    resourceVersion: "158101"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.policy
    uid: e5d3b82a-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: policy
    groupPriorityMinimum: 17100
    service: null
    version: v1beta1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.rbac.authorization.k8s.io
    namespace: ""
    resourceVersion: "158115"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.rbac.authorization.k8s.io
    uid: e5d3c4db-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: rbac.authorization.k8s.io
    groupPriorityMinimum: 17000
    service: null
    version: v1beta1
    versionPriority: 12
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta1.storage.k8s.io
    namespace: ""
    resourceVersion: "158102"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta1.storage.k8s.io
    uid: e5d46143-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: storage.k8s.io
    groupPriorityMinimum: 16800
    service: null
    version: v1beta1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:37Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v1beta2.apps
    namespace: ""
    resourceVersion: "158097"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v1beta2.apps
    uid: e538cc30-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: apps
    groupPriorityMinimum: 17800
    service: null
    version: v1beta2
    versionPriority: 1
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:37Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v2alpha1.batch
    namespace: ""
    resourceVersion: "158116"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v2alpha1.batch
    uid: e5d2ef3c-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: batch
    groupPriorityMinimum: 17400
    service: null
    version: v2alpha1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
- apiVersion: apiregistration.k8s.io/v1beta1
  kind: APIService
  metadata:
    creationTimestamp: 2017-11-29T03:03:38Z
    labels:
      kube-aggregator.kubernetes.io/automanaged: onstart
    name: v2beta1.autoscaling
    namespace: ""
    resourceVersion: "158103"
    selfLink: /apis/apiregistration.k8s.io/v1beta1/apiservices/v2beta1.autoscaling
    uid: e5d2809d-d4b1-11e7-aa5c-fa163e3f492b
  spec:
    caBundle: null
    group: autoscaling
    groupPriorityMinimum: 17500
    service: null
    version: v2beta1
    versionPriority: 9
  status:
    conditions:
    - lastTransitionTime: 2017-11-29T03:03:38Z
      message: Local APIServices are always available
      reason: Local
      status: "True"
      type: Available
kind: List
metadata:
  resourceVersion: ""
  selfLink: ""

@liggitt
Copy link
Member

liggitt commented Nov 30, 2017

Ah. Setup/cleanup of APIService objects between versions had a bug (#51912) that was resolved in 1.7.6 and 1.8

I would recommending targeting the latest 1.7.x release for the downgrade.

@liqlin2015
Copy link
Author

Thanks @liggitt

@magicluo0755
Copy link

Hi liqlin2015, I also got this problem while rollback k8s v1.8.4 to 1.7.4
Does 1.7.6 has resolved this issue?

@kow3ns kow3ns added this to Backlog in Workloads Feb 26, 2018
@fejta-bot
Copy link

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Apr 30, 2018
@fejta-bot
Copy link

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle rotten
/remove-lifecycle stale

@k8s-ci-robot k8s-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels May 30, 2018
@fejta-bot
Copy link

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/close

Workloads automation moved this from Backlog to Done Jun 29, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. sig/apps Categorizes an issue or PR as relevant to SIG Apps.
Projects
Workloads
  
Done
Milestone
No milestone
Development

No branches or pull requests
7 participants
@liggitt @magicluo0755 @liqlin2015 @hzxuzhonghu @k8s-github-robot @k8s-ci-robot @fejta-bot