[chectl] chectl/0.0.20201221-next.06243fa failed to update eclipse-che CR on minikube

[dmytro-ndp]

Describe the bug

chectl/0.0.20201221-next.06243fa linux-x64 node-v12.20.0 failed to update eclipse-che CR on minikube:
https://main-jenkins-csb-crwqe.apps.ocp4.prod.psi.redhat.com/job/Che/job/e2e/job/minikube/job/basic/job/eclipse-che/9/artifact/logs-and-configs/che-logs/che-operator-f568b8db9-gmh99.pod.log

time="2020-12-22T04:45:42Z" level=info msg="Updating eclipse-che CR with installation flavor: che"
time="2020-12-22T04:45:42Z" level=error msg="Failed to update eclipse-che CR: CheCluster.org.eclipse.che "eclipse-che" is invalid: []: Invalid value: map[string]interface {}{"apiVersion":"org.eclipse.che/v1", "kind":"CheCluster", "metadata":map[string]interface {}{"creationTimestamp":"2020-12-22T04:40:02Z", "generation":2, "name":"eclipse-che", "namespace":"eclipse-che", "resourceVersion":"663", "selfLink":"/apis/org.eclipse.che/v1/namespaces/eclipse-che/checlusters/eclipse-che", "uid":"c139df5e-440f-11eb-9948-fa163e79d907"}, "spec":map[string]interface {}{"auth":map[string]interface {}{"externalIdentityProvider":false, "identityProviderIngress":map[string]interface {}{}, "identityProviderRoute":map[string]interface {}{}, "openShiftoAuth":interface {}(nil), "updateAdminPassword":false}, "database":map[string]interface {}{"externalDb":false}, "imagePuller":map[string]interface {}{"enable":false, "spec":map[string]interface {}{}}, "k8s":map[string]interface {}{"ingressDomain":"10.0.155.133.nip.io", "tlsSecretName":"che-tls"}, "metrics":map[string]interface {}{"enable":true}, "server":map[string]interface {}{"allowUserDefinedWorkspaceNamespaces":false, "cheClusterRoles":"eclipse-che-che-namespace-editor", "cheDebug":"false", "cheFlavor":"che", "cheImage":"quay.io/eclipse/che-server", "cheImageTag":"nightly", "cheServerIngress":map[string]interface {}{}, "cheServerRoute":map[string]interface {}{}, "customCheProperties":map[string]interface {}{"CHE_LIMITS_USER_WORKSPACES_RUN_COUNT":"-1", "CHE_WORKSPACE_PLUGIN__BROKER_PULL__POLICY":"IfNotPresent", "CHE_WORKSPACE_SIDECAR_IMAGE__PULL__POLICY":"IfNotPresent"}, "devfileRegistryIngress":map[string]interface {}{}, "devfileRegistryRoute":map[string]interface {}{}, "externalDevfileRegistry":false, "externalPluginRegistry":false, "gitSelfSignedCert":false, "pluginRegistryIngress":map[string]interface {}{}, "pluginRegistryRoute":map[string]interface {}{}, "selfSignedCert":false, "tlsSupport":true, "useInternalClusterSVCNames":true}, "storage":map[string]interface {}{"preCreateSubPaths":true, "pvcClaimSize":"1Gi", "pvcStrategy":"common"}}}: validation failure list:\nspec.auth.openShiftoAuth in body must be of type boolean: "null""

Command to install Eclipse Che

chectl server:deploy --k8spodreadytimeout=600000 --k8spodwaittimeout=600000 --k8spoddownloadimagetimeout=600000 --listr-renderer=verbose --platform=minikube --che-operator-cr-patch-yaml=custom-resource-patch.yaml --chenamespace=elipse-che

where custom-resource-patch.yaml:

spec:
  server:
    cheImage: 'quay.io/eclipse/che-server'
    cheImageTag: 'nightly'
    customCheProperties:
      CHE_LIMITS_USER_WORKSPACES_RUN_COUNT: '-1'
      CHE_WORKSPACE_SIDECAR_IMAGE__PULL__POLICY: IfNotPresent
      CHE_WORKSPACE_PLUGIN__BROKER_PULL__POLICY: IfNotPresent
  auth:
    updateAdminPassword: false

chectl log:

 ​› Current Kubernetes context: minikube'
 ​(node:17940) Warning: Setting the NODE_TLS_REJECT_UNAUTHORIZED environment variable to '0' makes TLS connections and HTTPS requests insecure by disabling certificate verfication.
 ​› Installer type is set to: operator'
 ​[23:39:52] Verify Kubernetes API[started]
 ​[23:39:52] Verify Kubernetes API...OK [titl changed]
 ​[23:39:52] Verify Kubernetes API...OK [ompleted]
 ​[23:39:52] 👀  Looking for an already existing Eclipse Che instance[started]
 ​[23:39:52] Verify if Eclipse Che is deployed into namespace "eclipse-che"[started]
 ​[23:39:52] Verify if Eclipse Che is deployed into namespace "eclipse-che"...it is not [titl changed]
 ​[23:39:52] Verify if Eclipse Che is deployed into namespace "eclipse-che"...it is not [ompleted]
 ​[23:39:52] 👀  Looking for an already existing Eclipse Che instance [ompleted]
 ​[23:39:52] ✈️  Minikube preflight checklist[started]
 ​[23:39:52] Verify if kubectl is installed[started]
 ​[23:39:52] Verify if kubectl is installed [ompleted]
 ​[23:39:52] Verify if minikube is installed[started]
 ​[23:39:52] Verify if minikube is installed [ompleted]
 ​[23:39:52] Verify if minikube is running[started]
 ​[23:39:52] Verify if minikube is running [ompleted]
 ​[23:39:52] Start minikube[started]
 ​[23:39:52] Start minikube[skipped]
 ​[23:39:52] → Minikube is alread running.
 ​[23:39:52] Check Kubernetes version[started]
 ​[23:39:52] Check Kubernetes version: Found v1.14.3. [titl changed]
 ​[23:39:52] Check Kubernetes version: Found v1.14.3. [ompleted]
 ​[23:39:52] Verify if minikube ingress addon is enabled[started]
 ​[23:39:52] Verify if minikube ingress addon is enabled [ompleted]
 ​[23:39:52] Enable minikube ingress addon[started]
 ​[23:39:52] Enable minikube ingress addon[skipped]
 ​[23:39:52] → Ingress addon is alread enabled.
 ​[23:39:52] Retrieving minikube IP and domain for ingress URLs[started]
 ​[23:39:52] Retrieving minikube IP and domain for ingress URLs...10.0.155.133.nip.io. [titl changed]
 ​[23:39:52] Retrieving minikube IP and domain for ingress URLs...10.0.155.133.nip.io. [ompleted]
 ​[23:39:52] Checking minikube version[started]
 ​[23:39:52] Checking minikube version... 1.1.1 [titl changed]
 ​[23:39:52] Checking minikube version... 1.1.1 [ompleted]
 ​[23:39:52] Check if cluster accessible[started]
 ​[23:39:52] Check if cluster accessible[skipped]
 ​[23:39:52] ✈️  Minikube preflight checklist [ompleted]
 ​[23:39:52] Following Eclipse Che logs[started]
 ​[23:39:52] Start following Operator logs[started]
 ​[23:39:52] Start following Operator logs...done [titl changed]
 ​[23:39:52] Start following Operator logs...done [ompleted]
 ​[23:39:52] Start following Eclipse Che server logs[started]
 ​[23:39:52] Start following Eclipse Che server logs...done [titl changed]
 ​[23:39:52] Start following Eclipse Che server logs...done [ompleted]
 ​[23:39:52] Start following Postgres logs[started]
 ​[23:39:52] Start following Postgres logs...done [titl changed]
 ​[23:39:52] Start following Postgres logs...done [ompleted]
 ​[23:39:52] Start following Keycloak logs[started]
 ​[23:39:52] Start following Keycloak logs...done [titl changed]
 ​[23:39:52] Start following Keycloak logs...done [ompleted]
 ​[23:39:52] Start following Plugin registry logs[started]
 ​[23:39:52] Start following Plugin registry logs...done [titl changed]
 ​[23:39:52] Start following Plugin registry logs...done [ompleted]
 ​[23:39:52] Start following Devfile registry logs[started]
 ​[23:39:52] Start following Devfile registry logs...done [titl changed]
 ​[23:39:52] Start following Devfile registry logs...done [ompleted]
 ​[23:39:52] Start following namespace events[started]
 ​[23:39:52] Start following namespace events...done [titl changed]
 ​[23:39:52] Start following namespace events...done [ompleted]
 ​[23:39:52] Following Eclipse Che logs [ompleted]
 ​[23:39:52] 🏃‍  Running the Eclipse Che operator[started]
 ​[23:39:52] Copying operator resources[started]
 ​[23:39:52] Copying operator resources...done. [titl changed]
 ​[23:39:52] Copying operator resources...done. [ompleted]
 ​[23:39:52] Create Namespace (eclipse-che)[started]
 ​[23:39:52] Create Namespace (eclipse-che)...Done. [titl changed]
 ​[23:39:52] Create Namespace (eclipse-che)...Done. [ompleted]
 ​[23:39:52] Create ServiceAccount che-operator in namespace eclipse-che[started]
 ​[23:39:52] Create ServiceAccount che-operator in namespace eclipse-che...done. [titl changed]
 ​[23:39:52] Create ServiceAccount che-operator in namespace eclipse-che...done. [ompleted]
 ​[23:39:52] Create Role che-operator in namespace eclipse-che[started]
 ​[23:39:52] Create Role che-operator in namespace eclipse-che...done. [titl changed]
 ​[23:39:52] Create Role che-operator in namespace eclipse-che...done. [ompleted]
 ​[23:39:52] Create ClusterRole eclipse-che-che-operator[started]
 ​[23:39:52] Create ClusterRole eclipse-che-che-operator...done. [titl changed]
 ​[23:39:52] Create ClusterRole eclipse-che-che-operator...done. [ompleted]
 ​[23:39:52] Create ClusterRole eclipse-che-che-namespace-editor[started]
 ​[23:39:52] Create ClusterRole eclipse-che-che-namespace-editor...done. [titl changed]
 ​[23:39:52] Create ClusterRole eclipse-che-che-namespace-editor...done. [ompleted]
 ​[23:39:52] Create ClusterRoleBinding eclipse-che-che-operator-namespace-editor[started]
 ​[23:39:52] Create ClusterRoleBinding eclipse-che-che-operator-namespace-editor...done. [titl changed]
 ​[23:39:52] Create ClusterRoleBinding eclipse-che-che-operator-namespace-editor...done. [ompleted]
 ​[23:39:52] Create RoleBinding che-operator in namespace eclipse-che[started]
 ​[23:39:52] Create RoleBinding che-operator in namespace eclipse-che...done. [titl changed]
 ​[23:39:52] Create RoleBinding che-operator in namespace eclipse-che...done. [ompleted]
 ​[23:39:52] Create ClusterRoleBinding eclipse-che-che-operator[started]
 ​[23:39:52] Create ClusterRoleBinding eclipse-che-che-operator...done. [titl changed]
 ​[23:39:52] Create ClusterRoleBinding eclipse-che-che-operator...done. [ompleted]
 ​[23:39:52] Create CRD checlusters.org.eclipse.che[started]
 ​[23:39:52] Create CRD checlusters.org.eclipse.che...done. [titl changed]
 ​[23:39:52] Create CRD checlusters.org.eclipse.che...done. [ompleted]
 ​[23:39:52] Waiting 5 seconds for the new Kubernetes resources to get flushed[started]
 ​[23:39:57] Waiting 5 seconds for the new Kubernetes resources to get flushed...done. [titl changed]
 ​[23:39:57] Waiting 5 seconds for the new Kubernetes resources to get flushed...done. [ompleted]
 ​[23:39:57] Create deployment che-operator in namespace eclipse-che[started]
 ​[23:39:57] Create deployment che-operator in namespace eclipse-che...done. [titl changed]
 ​[23:39:57] Create deployment che-operator in namespace eclipse-che...done. [ompleted]
 ​[23:39:57] Operator pod bootstrap[started]
 ​[23:39:57] Scheduling[started]
 ​[23:39:58] Scheduling...done [titl changed]
 ​[23:39:58] Scheduling...done [ompleted]
 ​[23:39:58] Downloading images[started]
 ​[23:40:02] Downloading images...done [titl changed]
 ​[23:40:02] Downloading images...done [ompleted]
 ​[23:40:02] Starting[started]
 ​[23:40:02] Starting...done [titl changed]
 ​[23:40:02] Starting...done [ompleted]
 ​[23:40:02] Operator pod bootstrap [ompleted]
 ​[23:40:02] Prepare Eclipse Che cluster CR[started]
 ​[23:40:02] Prepare Eclipse Che cluster CR...Done. [titl changed]
 ​[23:40:02] Prepare Eclipse Che cluster CR...Done. [ompleted]
 ​[23:40:02] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace eclipse-che[started]
 ​[23:40:02] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace eclipse-che...done. [titl changed]
 ​[23:40:02] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace eclipse-che...done. [ompleted]
 ​[23:40:02] 🏃‍  Running the Eclipse Che operator [ompleted]
 ​[23:40:02] ✅  Post installation checklist[started]
 ​[23:40:02] PostgreSQL pod bootstrap[started]
 ​[23:40:02] Scheduling[started]
 ​[23:50:15] Schedulin [failed]
 ​[23:50:15] → Timeout: there are no pods in the namespace: eclipse-che, selector: app=che,component=postgres. Check Eclipse Che logs for details. Consider increasing error recheck timeout with --k8spoderrorrechecktimout flag.
 ​[23:50:15] PostgreSQL pod bootstra [failed]
 ​[23:50:15] → Timeout: there are no pods in the namespace: eclipse-che, selector: app=che,component=postgres. Check Eclipse Che logs for details. Consider increasing error recheck timeout with --k8spoderrorrechecktimout flag.
 ​[23:50:15] ✅  Post installation checklis [failed]
 ​[23:50:15] → Timeout: there are no pods in the namespace: eclipse-che, selector: app=che,component=postgres. Check Eclipse Che logs for details. Consider increasing error recheck timeout with --k8spoderrorrechecktimeut flag.
  ​›   Error: Error: Timeout: there are no pods in the namespace: eclise-che, 
  ​›   selector: app=che,component=postgres. Check Eclipse Che logs for etails. 
  ​›   Consider increasing error recheck timeout with --k8spoderrorrechektimeout
  ​›   flag.
  ​›   Command server:deploy failed. Eror log: 
  ​›   /home/hudson/.cache/chectl/error.log

Che version

• latest
• nightly
• other: please specify

Steps to reproduce

Expected behavior

Runtime

• kubernetes (include output of kubectl version)
• Openshift (include output of oc version)
• minikube 1.1.1
• minishift (include output of minishift version and oc version)
• docker-desktop + K8S (include output of docker version and kubectl version)
• other: (please specify)

Screenshots

Installation method

• chectl/0.0.20201221-next.06243fa linux-x64 node-v12.20.0
• OperatorHub
• I don't know

Environment

• my computer
  • Windows
  • Linux
  • macOS
• Cloud
  • Amazon
  • Azure
  • GCE
  • other (please specify)
• other: CRW CCI

Eclipse Che Logs

Additional context