Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When 'che-gateway' pod is not ready Сhe 'single-host' deploy marks as successful #18814

Closed
4 tasks done
artaleks9 opened this issue Jan 15, 2021 · 2 comments
Closed
4 tasks done
Labels
area/chectl Issues related to chectl, the CLI of Che kind/bug Outline of a bug - must adhere to the bug report template. severity/P2 Has a minor but important impact to the usage or development of the system.
Milestone

Comments

@artaleks9
Copy link
Contributor

artaleks9 commented Jan 15, 2021

Describe the bug

  • I faced out with a confused behavior of installation Che 'single-host' when 'che-gateway' pod is not ready. In the same time CLI command output shows - Command server:deploy has completed successfully.

Che version

  • nightly

Steps to reproduce

  • Install Che 'single-host' using CLI command
  • CLI command is finished success
  • Go to Che dashboard link -> Application is not availlable
    che-app-not-available

Expected behavior

  • Installation of Che 'single-host' should be finished as failed if 'che-gateway' pod is not ready.

Runtime

  • Openshift

Screenshots

che-gateway-pod-not-ready

che-single-url-gateway-not-ready

Installation method

  • chectl
18:15:10 + /mnt/hudson_workspace/workspace/install-che-single-host-chectl/chectl server:deploy --telemetry=off --listr-renderer=verbose --debug --multiuser --no-olm-suggested-namespace --platform=openshift -n che-single-host-chectl-tls-oauth --che-operator-cr-patch-yaml=/mnt/hudson_workspace/workspace/install-che-single-host-chectl/custom-resource-patch.yaml
18:15:11 › Current Kubernetes context: 'default/api-ocp45-crw-qe-com:6443/admin'
18:15:11 (node:9999) Warning: Setting the NODE_TLS_REJECT_UNAUTHORIZED environment variable to '0' makes TLS connections and HTTPS requests insecure by disabling certificate verification.
18:15:11 › Installer type is set to: 'olm'
18:15:11 [11:15:10] Verify Kubernetes API [started]
18:15:11 [11:15:10] Verify Kubernetes API...OK [title changed]
18:15:11 [11:15:10] Verify Kubernetes API...OK (it's OpenShift) [title changed]
18:15:11 [11:15:10] Verify Kubernetes API...OK (it's OpenShift) [completed]
18:15:11 [11:15:10] 👀  Looking for an already existing Eclipse Che instance [started]
18:15:11 [11:15:10] Verify if Eclipse Che is deployed into namespace "che-single-host-chectl-tls-oauth" [started]
18:15:11 [11:15:10] Verify if Eclipse Che is deployed into namespace "che-single-host-chectl-tls-oauth"...it is not [title changed]
18:15:11 [11:15:10] Verify if Eclipse Che is deployed into namespace "che-single-host-chectl-tls-oauth"...it is not [completed]
18:15:11 [11:15:10] 👀  Looking for an already existing Eclipse Che instance [completed]
18:15:11 [11:15:10] ✈️  Openshift preflight checklist [started]
18:15:11 [11:15:10] Verify if oc is installed [started]
18:15:11 [11:15:10] Verify if oc is installed...done. [title changed]
18:15:11 [11:15:10] Verify if oc is installed...done. [completed]
18:15:11 [11:15:10] Verify if openshift is running [started]
18:15:11 [11:15:10] Verify if openshift is running...done. [title changed]
18:15:11 [11:15:10] Verify if openshift is running...done. [completed]
18:15:11 [11:15:10] Check OpenShift version [started]
18:15:11 [11:15:10] Check OpenShift version: 4.x [title changed]
18:15:11 [11:15:10] Check OpenShift version: 4.x [completed]
18:15:11 [11:15:10] Check Kubernetes version [started]
18:15:12 [11:15:11] Check Kubernetes version: Unknown. [title changed]
18:15:12 [11:15:11] Check Kubernetes version: Unknown. [completed]
18:15:12 [11:15:11] ✈️  Openshift preflight checklist [completed]
18:15:12 [11:15:11] Following Eclipse Che logs [started]
18:15:12 [11:15:11] Start following Operator logs [started]
18:15:12 [11:15:11] Start following Operator logs...done [title changed]
18:15:12 [11:15:11] Start following Operator logs...done [completed]
18:15:12 [11:15:11] Start following Eclipse Che server logs [started]
18:15:12 [11:15:11] Start following Eclipse Che server logs...done [title changed]
18:15:12 [11:15:11] Start following Eclipse Che server logs...done [completed]
18:15:12 [11:15:11] Start following Postgres logs [started]
18:15:12 [11:15:11] Start following Postgres logs...done [title changed]
18:15:12 [11:15:11] Start following Postgres logs...done [completed]
18:15:12 [11:15:11] Start following Keycloak logs [started]
18:15:12 [11:15:11] Start following Keycloak logs...done [title changed]
18:15:12 [11:15:11] Start following Keycloak logs...done [completed]
18:15:12 [11:15:11] Start following Plugin registry logs [started]
18:15:12 [11:15:11] Start following Plugin registry logs...done [title changed]
18:15:12 [11:15:11] Start following Plugin registry logs...done [completed]
18:15:12 [11:15:11] Start following Devfile registry logs [started]
18:15:12 [11:15:11] Start following Devfile registry logs...done [title changed]
18:15:12 [11:15:11] Start following Devfile registry logs...done [completed]
18:15:12 [11:15:11] Start following namespace events [started]
18:15:12 [11:15:11] Start following namespace events...done [title changed]
18:15:12 [11:15:11] Start following namespace events...done [completed]
18:15:12 [11:15:11] Following Eclipse Che logs [completed]
18:15:12 [11:15:11] 🏃‍  Running Olm installaion Eclipse Che [started]
18:15:12 [11:15:11] Check if OLM is pre-installed on the platform [started]
18:15:12 [11:15:11] Check if OLM is pre-installed on the platform...done. [title changed]
18:15:12 [11:15:11] Check if OLM is pre-installed on the platform...done. [completed]
18:15:12 [11:15:11] Create Namespace (che-single-host-chectl-tls-oauth) [started]
18:15:12 [11:15:11] Create Namespace (che-single-host-chectl-tls-oauth)...Done. [title changed]
18:15:12 [11:15:11] Create Namespace (che-single-host-chectl-tls-oauth)...Done. [completed]
18:15:12 [11:15:11] Create operator group [started]
18:15:12 [11:15:11] Create operator group...created new one. [title changed]
18:15:12 [11:15:11] Create operator group...created new one. [completed]
18:15:12 [11:15:11] Configure context information [started]
18:15:12 [11:15:11] Configure context information...done. [title changed]
18:15:12 [11:15:11] Configure context information...done. [completed]
18:15:12 [11:15:11] Create nightly index CatalogSource in the namespace che-single-host-chectl-tls-oauth [started]
18:15:12 [11:15:11] Create nightly index CatalogSource in the namespace che-single-host-chectl-tls-oauth [completed]
18:15:12 [11:15:11] Create operator subscription [started]
18:15:12 [11:15:11] Create operator subscription...created new one. [title changed]
18:15:12 [11:15:11] Create operator subscription...created new one. [completed]
18:15:12 [11:15:11] Wait while subscription is ready [started]
18:15:34 [11:15:31] Wait while subscription is ready...done. [title changed]
18:15:34 [11:15:31] Wait while subscription is ready...done. [completed]
18:15:34 [11:15:31] Wait while operator installed [started]
18:15:49 [11:15:47] Wait while operator installed...done. [title changed]
18:15:49 [11:15:47] Wait while operator installed...done. [completed]
18:15:49 [11:15:47] Set custom operator image [started]
18:15:49 [11:15:47] Set custom operator image... changed to quay.io/eclipse/che-operator:nightly. [title changed]
18:15:49 [11:15:47] Set custom operator image... changed to quay.io/eclipse/che-operator:nightly. [completed]
18:15:49 [11:15:47] Prepare Eclipse Che cluster CR [started]
18:15:49 [11:15:47] Prepare Eclipse Che cluster CR...Done. [title changed]
18:15:49 [11:15:47] Prepare Eclipse Che cluster CR...Done. [completed]
18:15:49 [11:15:47] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace che-single-host-chectl-tls-oauth [started]
18:15:49 [11:15:47] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace che-single-host-chectl-tls-oauth...done. [title changed]
18:15:49 [11:15:47] Create the Custom Resource of type checlusters.org.eclipse.che in the namespace che-single-host-chectl-tls-oauth...done. [completed]
18:15:49 [11:15:47] 🏃‍  Running Olm installaion Eclipse Che [completed]
18:15:49 [11:15:47] ✅  Post installation checklist [started]
18:15:49 [11:15:47] PostgreSQL pod bootstrap [started]
18:15:49 [11:15:47] Scheduling [started]
18:16:15 [11:16:10] Scheduling...done [title changed]
18:16:15 [11:16:10] Scheduling...done [completed]
18:16:15 [11:16:10] Downloading images [started]
18:16:48 [11:16:41] Downloading images...done [title changed]
18:16:48 [11:16:41] Downloading images...done [completed]
18:16:48 [11:16:41] Starting [started]
18:17:06 [11:17:04] Starting...done [title changed]
18:17:06 [11:17:04] Starting...done [completed]
18:17:06 [11:17:04] PostgreSQL pod bootstrap [completed]
18:17:06 [11:17:04] Keycloak pod bootstrap [started]
18:17:06 [11:17:04] Scheduling [started]
18:17:06 [11:17:05] Scheduling...done [title changed]
18:17:06 [11:17:05] Scheduling...done [completed]
18:17:06 [11:17:05] Downloading images [started]
18:17:38 [11:17:36] Downloading images...done [title changed]
18:17:38 [11:17:36] Downloading images...done [completed]
18:17:38 [11:17:36] Starting [started]
18:18:19 [11:18:14] Starting...done [title changed]
18:18:19 [11:18:14] Starting...done [completed]
18:18:19 [11:18:14] Keycloak pod bootstrap [completed]
18:18:19 [11:18:14] Devfile registry pod bootstrap [started]
18:18:19 [11:18:14] Scheduling [started]
18:20:11 [11:20:03] Scheduling...done [title changed]
18:20:11 [11:20:03] Scheduling...done [completed]
18:20:11 [11:20:03] Downloading images [started]
18:20:11 [11:20:10] Downloading images...done [title changed]
18:20:11 [11:20:10] Downloading images...done [completed]
18:20:11 [11:20:10] Starting [started]
18:20:16 [11:20:14] Starting...done [title changed]
18:20:16 [11:20:14] Starting...done [completed]
18:20:16 [11:20:14] Devfile registry pod bootstrap [completed]
18:20:16 [11:20:14] Plugin registry pod bootstrap [started]
18:20:16 [11:20:14] Scheduling [started]
18:20:16 [11:20:14] Scheduling...done [title changed]
18:20:16 [11:20:14] Scheduling...done [completed]
18:20:16 [11:20:14] Downloading images [started]
18:20:29 [11:20:26] Downloading images...done [title changed]
18:20:29 [11:20:26] Downloading images...done [completed]
18:20:29 [11:20:26] Starting [started]
18:20:34 [11:20:32] Starting...done [title changed]
18:20:34 [11:20:32] Starting...done [completed]
18:20:34 [11:20:32] Plugin registry pod bootstrap [completed]
18:20:34 [11:20:32] Eclipse Che pod bootstrap [started]
18:20:34 [11:20:32] Scheduling [started]
18:20:34 [11:20:32] Scheduling...done [title changed]
18:20:34 [11:20:32] Scheduling...done [completed]
18:20:34 [11:20:32] Downloading images [started]
18:21:00 [11:20:57] Downloading images...done [title changed]
18:21:00 [11:20:57] Downloading images...done [completed]
18:21:00 [11:20:57] Starting [started]
18:21:00 [11:20:57] Starting...done [title changed]
18:21:00 [11:20:57] Starting...done [completed]
18:21:00 [11:20:57] Eclipse Che pod bootstrap [completed]
18:21:00 [11:20:57] Eclipse Che status check [started]
18:21:00 [11:20:57] Eclipse Che status check...done [title changed]
18:21:00 [11:20:57] Eclipse Che status check...done [completed]
18:21:00 [11:20:57] ✅  Post installation checklist [completed]
18:21:00 [11:20:57] Retrieving Keycloak admin credentials [started]
18:21:00 [11:20:57] Retrieving Keycloak admin credentials...done [title changed]
18:21:00 [11:20:57] Retrieving Keycloak admin credentials...done [completed]
18:21:00 [11:20:57] Retrieving Che self-signed CA certificate [started]
18:21:00 [11:20:57] Retrieving Che self-signed CA certificate... done [title changed]
18:21:00 [11:20:57] Retrieving Che self-signed CA certificate... done [completed]
18:21:00 [11:20:57] Prepare post installation output [started]
18:21:00 [11:20:58] Prepare post installation output...done [title changed]
18:21:00 [11:20:58] Prepare post installation output...done [completed]
18:21:00 [11:20:58] Show important messages [started]
18:21:00 [11:20:58] Eclipse Che UNKNOWN has been successfully deployed. [started]
18:21:00 [11:20:58] Eclipse Che UNKNOWN has been successfully deployed. [completed]
18:21:00 [11:20:58] Documentation             : https://www.eclipse.org/che/docs/ [started]
18:21:00 [11:20:58] Documentation             : https://www.eclipse.org/che/docs/ [completed]
18:21:00 [11:20:58] ------------------------------------------------------------------------------- [started]
18:21:00 [11:20:58] ------------------------------------------------------------------------------- [completed]
18:21:00 [11:20:58] Users Dashboard           : https://che-che-single-host-chectl-tls-oauth.apps.ocp45.crw-qe.com [started]
18:21:00 [11:20:58] Users Dashboard           : https://che-che-single-host-chectl-tls-oauth.apps.ocp45.crw-qe.com [completed]
18:21:00 [11:20:58] Admin user login          : "admin:admin". NOTE: must change after first login. [started]
18:21:00 [11:20:58] Admin user login          : "admin:admin". NOTE: must change after first login. [completed]
18:21:00 [11:20:58] ------------------------------------------------------------------------------- [started]
18:21:00 [11:20:58] ------------------------------------------------------------------------------- [completed]
18:21:00 [11:20:58] Plug-in Registry          : https://che-che-single-host-chectl-tls-oauth.apps.ocp45.crw-qe.com/plugin-registry/v3 [started]
18:21:00 [11:20:58] Plug-in Registry          : https://che-che-single-host-chectl-tls-oauth.apps.ocp45.crw-qe.com/plugin-registry/v3 [completed]
18:21:00 [11:20:58] Devfile Registry          : https://che-che-single-host-chectl-tls-oauth.apps.ocp45.crw-qe.com/devfile-registry [started]
18:21:00 [11:20:58] Devfile Registry          : https://che-che-single-host-chectl-tls-oauth.apps.ocp45.crw-qe.com/devfile-registry [completed]
18:21:00 [11:20:58] ------------------------------------------------------------------------------- [started]
18:21:00 [11:20:58] ------------------------------------------------------------------------------- [completed]
18:21:00 [11:20:58] Identity Provider URL     : https://che-che-single-host-chectl-tls-oauth.apps.ocp45.crw-qe.com/auth [started]
18:21:00 [11:20:58] Identity Provider URL     : https://che-che-single-host-chectl-tls-oauth.apps.ocp45.crw-qe.com/auth [completed]
18:21:00 [11:20:58] Identity Provider login   : "admin:admin". [started]
18:21:00 [11:20:58] Identity Provider login   : "admin:admin". [completed]
18:21:00 [11:20:58] ------------------------------------------------------------------------------- [started]
18:21:00 [11:20:58] ------------------------------------------------------------------------------- [completed]
18:21:00 [11:20:58] Show important messages [completed]
18:21:00 Command server:deploy has completed successfully in 05:48.

Environment

  • Cloud
    - [x] other (OpenStack)
@artaleks9 artaleks9 added the kind/bug Outline of a bug - must adhere to the bug report template. label Jan 15, 2021
@che-bot che-bot added the status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. label Jan 15, 2021
@artaleks9 artaleks9 added area/chectl Issues related to chectl, the CLI of Che severity/P1 Has a major impact to usage or development of the system. team/deploy and removed status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. labels Jan 15, 2021
@tolusha tolusha added severity/P2 Has a minor but important impact to the usage or development of the system. and removed severity/P1 Has a major impact to usage or development of the system. team/deploy labels Feb 2, 2021
@tolusha tolusha mentioned this issue Jul 7, 2021
24 tasks
@tolusha tolusha added this to the 7.34 milestone Jul 8, 2021
@tolusha tolusha removed this from the 7.34 milestone Jul 12, 2021
@tolusha
Copy link
Contributor

tolusha commented Jul 12, 2021

We can detect if gateway pod is being deployed by checking values in a che configmap but this configmap is created after gateway pod is deployed

@tolusha
Copy link
Contributor

tolusha commented Jul 16, 2021

Will be fixed by #19284

@tolusha tolusha mentioned this issue Sep 3, 2021
29 tasks
@tolusha tolusha added this to the 7.37 milestone Sep 8, 2021
@tolusha tolusha mentioned this issue Sep 27, 2021
27 tasks
@tolusha tolusha removed this from the 7.37 milestone Sep 28, 2021
@tolusha tolusha added this to the 7.38 milestone Sep 28, 2021
@tolusha tolusha mentioned this issue Oct 18, 2021
25 tasks
@tolusha tolusha modified the milestones: 7.38, 7.39 Oct 20, 2021
@tolusha tolusha mentioned this issue Nov 9, 2021
27 tasks
@tolusha tolusha modified the milestones: 7.39, 7.40 Nov 9, 2021
@tolusha tolusha mentioned this issue Nov 29, 2021
28 tasks
@tolusha tolusha modified the milestones: 7.40, 7.41 Dec 1, 2021
@tolusha tolusha closed this as completed Dec 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/chectl Issues related to chectl, the CLI of Che kind/bug Outline of a bug - must adhere to the bug report template. severity/P2 Has a minor but important impact to the usage or development of the system.
Projects
None yet
Development

No branches or pull requests

3 participants