[chectl] 'chectl server:deploy' command failed on "Create ServiceAccount che-operator" step

[dmytro-ndp]

Describe the bug

chectl 0.0.20210209-next.57d1e1f server:deploy command failed on "Create ServiceAccount che-operator" step on minikube 1.1.1
https://codeready-workspaces-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/Multiuser-Che-PR-check-E2E-Happy-path-tests-against-k8s/4508/

chectl server:deploy --k8spodreadytimeout=600000 --k8spodwaittimeout=600000 --k8spoddownloadimagetimeout=600000 --listr-renderer=verbose --platform=minikube --che-operator-cr-patch-yaml=custom-resource-patch.yaml --telemetry=off --chenamespace=eclipse-che

where custom-resource-patch.yaml:

spec:
  server:
    cheImage: 'maxura/che-server'
    cheImageTag: '18915'
    customCheProperties:
      CHE_LIMITS_USER_WORKSPACES_RUN_COUNT: '-1'
      CHE_WORKSPACE_SIDECAR_IMAGE__PULL__POLICY: IfNotPresent
      CHE_WORKSPACE_PLUGIN__BROKER_PULL__POLICY: IfNotPresent
  auth:
    updateAdminPassword: false

Installation log

› Current Kubernetes context: 'minikube'
(node:21177) Warning: Setting the NODE_TLS_REJECT_UNAUTHORIZED environment variable to '0' makes TLS connections and HTTPS requests insecure by disabling certificate verification.
› Installer type is set to: 'operator'
[11:47:02] Verify Kubernetes API [started]
[11:47:02] Verify Kubernetes API...OK [title changed]
[11:47:02] Verify Kubernetes API...OK [completed]
[11:47:02] 👀  Looking for an already existing Eclipse Che instance [started]
[11:47:02] Verify if Eclipse Che is deployed into namespace "eclipse-che" [started]
[11:47:02] Verify if Eclipse Che is deployed into namespace "eclipse-che"...it is not [title changed]
[11:47:02] Verify if Eclipse Che is deployed into namespace "eclipse-che"...it is not [completed]
[11:47:02] 👀  Looking for an already existing Eclipse Che instance [completed]
[11:47:02] ✈️  Minikube preflight checklist [started]
[11:47:02] Verify if kubectl is installed [started]
[11:47:02] Verify if kubectl is installed [completed]
[11:47:02] Verify if minikube is installed [started]
[11:47:02] Verify if minikube is installed [completed]
[11:47:02] Verify if minikube is running [started]
[11:47:02] Verify if minikube is running [completed]
[11:47:02] Start minikube [started]
[11:47:02] Start minikube [skipped]
[11:47:02] → Minikube is already running.
[11:47:02] Check Kubernetes version [started]
[11:47:03] Check Kubernetes version: Found v1.14.3. [title changed]
[11:47:03] Check Kubernetes version: Found v1.14.3. [completed]
[11:47:03] Verify if minikube ingress addon is enabled [started]
[11:47:03] Verify if minikube ingress addon is enabled [completed]
[11:47:03] Enable minikube ingress addon [started]
[11:47:03] Enable minikube ingress addon [skipped]
[11:47:03] → Ingress addon is already enabled.
[11:47:03] Retrieving minikube IP and domain for ingress URLs [started]
[11:47:03] Retrieving minikube IP and domain for ingress URLs...10.0.209.5.nip.io. [title changed]
[11:47:03] Retrieving minikube IP and domain for ingress URLs...10.0.209.5.nip.io. [completed]
[11:47:03] Checking minikube version [started]
[11:47:03] Checking minikube version... 1.1.1 [title changed]
[11:47:03] Checking minikube version... 1.1.1 [completed]
[11:47:03] Check if cluster accessible [started]
[11:47:03] Check if cluster accessible [skipped]
[11:47:03] ✈️  Minikube preflight checklist [completed]
[11:47:03] Following Eclipse Che logs [started]
[11:47:03] Start following Operator logs [started]
[11:47:03] Start following Operator logs...done [title changed]
[11:47:03] Start following Operator logs...done [completed]
[11:47:03] Start following Eclipse Che server logs [started]
[11:47:03] Start following Eclipse Che server logs...done [title changed]
[11:47:03] Start following Eclipse Che server logs...done [completed]
[11:47:03] Start following Postgres logs [started]
[11:47:03] Start following Postgres logs...done [title changed]
[11:47:03] Start following Postgres logs...done [completed]
[11:47:03] Start following Keycloak logs [started]
[11:47:03] Start following Keycloak logs...done [title changed]
[11:47:03] Start following Keycloak logs...done [completed]
[11:47:03] Start following Plugin registry logs [started]
[11:47:03] Start following Plugin registry logs...done [title changed]
[11:47:03] Start following Plugin registry logs...done [completed]
[11:47:03] Start following Devfile registry logs [started]
[11:47:03] Start following Devfile registry logs...done [title changed]
[11:47:03] Start following Devfile registry logs...done [completed]
[11:47:03] Start following namespace events [started]
[11:47:03] Start following namespace events...done [title changed]
[11:47:03] Start following namespace events...done [completed]
[11:47:03] Following Eclipse Che logs [completed]
[11:47:03] 🏃‍  Running the Eclipse Che operator [started]
[11:47:03] Create Namespace (eclipse-che) [started]
[11:47:03] Create Namespace (eclipse-che)...Done. [title changed]
[11:47:03] Create Namespace (eclipse-che)...Done. [completed]
[11:47:03] Create ServiceAccount che-operator in namespace eclipse-che [started]
[11:47:03] Create ServiceAccount che-operator in namespace eclipse-che [failed]
[11:47:03] → ENOENT: no such file or directory, open '/usr/local/templates/che-operator/service_account.yaml'
[11:47:03] 🏃‍  Running the Eclipse Che operator [failed]
[11:47:03] → ENOENT: no such file or directory, open '/usr/local/templates/che-operator/service_account.yaml'
 ›   Error: Error: ENOENT: no such file or directory, open 
 ›   '/usr/local/templates/che-operator/service_account.yaml'
 ›   Command server:deploy failed. Error log: 
 ›   /home/hudson/.cache/chectl/error.log

Che version

• latest
• nightly
• other: please specify

Steps to reproduce

1. Download chectl next:

curl -sL https://www.eclipse.org/che/chectl/ > install_chectl.sh
chmod +x install_chectl.sh
sudo PATH=$PATH ./install_chectl.sh --channel=next
sudo mv /usr/local/bin/chectl ~/chectl
sudo chmod +x ~/chectl

2. Deploy Che to minikube:

  ~/chectl/bin/chectl server:deploy \
  --k8spodreadytimeout=600000 \
  --k8spodwaittimeout=600000 \
  --k8spoddownloadimagetimeout=600000 \
  --listr-renderer=verbose \
  --platform=minikube \
  --che-operator-cr-patch-yaml=custom-resource-patch.yaml \
  --telemetry=off \
  --chenamespace=eclipse-che

where custom-resource-patch.yaml:

spec:
  server:
    cheImage: 'maxura/che-server'
    cheImageTag: '18915'
    customCheProperties:
      CHE_LIMITS_USER_WORKSPACES_RUN_COUNT: '-1'
      CHE_WORKSPACE_SIDECAR_IMAGE__PULL__POLICY: IfNotPresent
      CHE_WORKSPACE_PLUGIN__BROKER_PULL__POLICY: IfNotPresent
  auth:
    updateAdminPassword: false

Expected behavior

Runtime

• kubernetes (include output of kubectl version)
• Openshift (include output of oc version)
• minikube 1.1.1
• minishift (include output of minishift version and oc version)
• docker-desktop + K8S (include output of docker version and kubectl version)
• other: (please specify)

Screenshots

Installation method

• chectl/0.0.20210209-next.57d1e1f linux-x64 node-v12.20.1 https://github.com/che-incubator/chectl/releases/download/20210209154951/chectl-linux-x64.tar.gz
  • provide a full command that was used to deploy Eclipse Che (including the output)
  • provide an output of chectl version command
• OperatorHub
• I don't know

Environment

• my computer
  • Windows
  • Linux
  • macOS
• Cloud
  • Amazon
  • Azure
  • GCE
  • other (please specify)
• other: CRW CCI

Eclipse Che Logs

Additional context

Recent changes: che-incubator/chectl@57d1e1f

[mmorhun]

I am investigation the issue. The problem is not reproducible when build chectl from source code. So, a workaround for manual use is to build it from source code:

1. Clone chectl repository
2. Run yarn in the root folder
3. Use bin/run as chectl