Skip to content

Application not available, waits for ever: Recreate deployment is running #142

@fabnoe

Description

@fabnoe

I've installed the default catalog: Node.js + MongoDB (Persistent) via web Web Console.

Error if I open the route url
Application is not available

And the WebConsole shows on the Node Pod
Recreate deployment is running

I got this log for the build:
Pushing image 172.30.254.23:5000/husk/nodejs-mongo-persistent:latest ...
Pushed 5/6 layers, 84% complete
Pushed 6/6 layers, 100% complete
Push successful

oc status

In project husk on server https://api.starter-us-west-2.openshift.com:443

svc/mongodb - 172.30.144.37:27017
  dc/mongodb deploys openshift/mongodb:3.2 
    deployment #1 deployed 3 minutes ago - 1 pod

http://nodejs-mongo-persistent-husk.7e14.starter-us-west-2.openshiftapps.com (svc/nodejs-mongo-persistent)
  dc/nodejs-mongo-persistent deploys istag/nodejs-mongo-persistent:latest <-
    bc/nodejs-mongo-persistent source builds https://github.com/openshift/nodejs-ex.git on openshift/nodejs:6 
    deployment #1 running for 2 minutes - 0/1 pods growing to 1

Errors:
  * route/nodejs-mongo-persistent is routing traffic to svc/nodejs-mongo-persistent, but either the administrator has not installed a router or the router is not selecting this route.

oc describe pods

Name:			mongodb-1-qpnp1
Namespace:		husk
Security Policy:	restricted
Node:			ip-172-31-54-218.us-west-2.compute.internal/172.31.54.218
Start Time:		Sat, 07 Oct 2017 10:22:03 +0200
Labels:			deployment=mongodb-1
			deploymentconfig=mongodb
			name=mongodb
Annotations:		kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicationController","namespace":"husk","name":"mongodb-1","uid":"9006eee7-ab38-11e7-a41e-0ab8769191d3",...
			kubernetes.io/limit-ranger=LimitRanger plugin set: cpu request for container mongodb; cpu limit for container mongodb
			openshift.io/deployment-config.latest-version=1
			openshift.io/deployment-config.name=mongodb
			openshift.io/deployment.name=mongodb-1
			openshift.io/scc=restricted
Status:			Running
IP:			10.129.19.162
Controllers:		ReplicationController/mongodb-1
Containers:
  mongodb:
    Container ID:	docker://c3711071b32f5c1fd970450675bcb53b4192352667d30c28cc2a1483a4ddef22
    Image:		registry.access.redhat.com/rhscl/mongodb-32-rhel7@sha256:9d577425aa4dfe939cd0262fe6674001a6a5250799a623d667c35b79cf114de0
    Image ID:		docker-pullable://registry.access.redhat.com/rhscl/mongodb-32-rhel7@sha256:9d577425aa4dfe939cd0262fe6674001a6a5250799a623d667c35b79cf114de0
    Port:		27017/TCP
    State:		Running
      Started:		Sat, 07 Oct 2017 10:22:36 +0200
    Ready:		True
    Restart Count:	0
    Limits:
      cpu:	2
      memory:	1Gi
    Requests:
      cpu:	100m
      memory:	512Mi
    Liveness:	tcp-socket :27017 delay=30s timeout=1s period=10s #success=1 #failure=3
    Readiness:	exec [/bin/sh -i -c mongo 127.0.0.1:27017/$MONGODB_DATABASE -u $MONGODB_USER -p $MONGODB_PASSWORD --eval="quit()"] delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      MONGODB_USER:		<set to the key 'database-user' in secret 'nodejs-mongo-persistent'>		Optional: false
      MONGODB_PASSWORD:		<set to the key 'database-password' in secret 'nodejs-mongo-persistent'>	Optional: false
      MONGODB_DATABASE:		sampledb
      MONGODB_ADMIN_PASSWORD:	<set to the key 'database-admin-password' in secret 'nodejs-mongo-persistent'>	Optional: false
    Mounts:
      /var/lib/mongodb/data from mongodb-data (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-ttxr1 (ro)
Conditions:
  Type		Status
  Initialized 	True 
  Ready 	True 
  PodScheduled 	True 
Volumes:
  mongodb-data:
    Type:	PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:	mongodb
    ReadOnly:	false
  default-token-ttxr1:
    Type:	Secret (a volume populated by a Secret)
    SecretName:	default-token-ttxr1
    Optional:	false
QoS Class:	Burstable
Node-Selectors:	type=compute
Tolerations:	<none>
Events:
  FirstSeen	LastSeen	Count	From							SubObjectPath			Type	Reason		Message
  ---------	--------	-----	----							-------------			--------	------		-------
  5m		5m		1	default-scheduler									NormaScheduled	Successfully assigned mongodb-1-qpnp1 to ip-172-31-54-218.us-west-2.compute.internal
  4m		4m		1	kubelet, ip-172-31-54-218.us-west-2.compute.internal	spec.containers{mongodb}	NormaPulling		pulling image "registry.access.redhat.com/rhscl/mongodb-32-rhel7@sha256:9d577425aa4dfe939cd0262fe6674001a6a5250799a623d667c35b79cf114de0"
  4m		4m		1	kubelet, ip-172-31-54-218.us-west-2.compute.internal	spec.containers{mongodb}	NormaPulled		Successfully pulled image "registry.access.redhat.com/rhscl/mongodb-32-rhel7@sha256:9d577425aa4dfe939cd0262fe6674001a6a5250799a623d667c35b79cf114de0"
  4m		4m		1	kubelet, ip-172-31-54-218.us-west-2.compute.internal	spec.containers{mongodb}	NormaCreated		Created container
  4m		4m		1	kubelet, ip-172-31-54-218.us-west-2.compute.internal	spec.containers{mongodb}	NormaStarted		Started container


Name:			nodejs-mongo-persistent-1-build
Namespace:		husk
Security Policy:	privileged
Node:			ip-172-31-63-231.us-west-2.compute.internal/172.31.63.231
Start Time:		Sat, 07 Oct 2017 10:21:47 +0200
Labels:			openshift.io/build.name=nodejs-mongo-persistent-1
Annotations:		kubernetes.io/limit-ranger=LimitRanger plugin set: cpu, memory request for container sti-build; cpu, memory limit for container sti-build
			openshift.io/build.name=nodejs-mongo-persistent-1
			openshift.io/scc=privileged
Status:			Succeeded
IP:			10.129.25.122
Controllers:		<none>
Containers:
  sti-build:
    Container ID:	docker://1243ab3f375bce22e30f0932f25d476303e5f011c64c2d3429a22ec126d7d118
    Image:		registry.ops.openshift.com/openshift3/ose-sti-builder:v3.6.173.0.5
    Image ID:		docker-pullable://registry.ops.openshift.com/openshift3/ose-sti-builder@sha256:36c039209e3a732c459d3fd7c85d8ca1a516a0e3341056581a4a9e893e7a0306
    Port:		
    Args:
      --loglevel=0
    State:		Terminated
      Reason:		Completed
      Exit Code:	0
      Started:		Sat, 07 Oct 2017 10:22:05 +0200
      Finished:		Sat, 07 Oct 2017 10:22:48 +0200
    Ready:		False
    Restart Count:	0
    Limits:
      cpu:	1
      memory:	512Mi
    Requests:
      cpu:	50m
      memory:	256Mi
    Environment:
      BUILD:	{"kind":"Build","apiVersion":"v1","metadata":{"name":"nodejs-mongo-persistent-1","namespace":"husk","selfLink":"/apis/build.openshift.io/v1/namespaces/husk/builds/nodejs-mongo-persistent-1","uid":"8fec8b85-ab38-11e7-a41e-0ab8769191d3","resourceVersion":"1486242443","creationTimestamp":"2017-10-07T08:21:47Z","labels":{"app":"nodejs-mongo-persistent","buildconfig":"nodejs-mongo-persistent","openshift.io/build-config.name":"nodejs-mongo-persistent","openshift.io/build.start-policy":"Serial","template":"nodejs-mongo-persistent"},"annotations":{"openshift.io/build-config.name":"nodejs-mongo-persistent","openshift.io/build.number":"1"},"ownerReferences":[{"apiVersion":"build.openshift.io/v1","kind":"BuildConfig","name":"nodejs-mongo-persistent","uid":"8fdedbd0-ab38-11e7-8a41-0a2a2b777307","controller":true}]},"spec":{"serviceAccount":"builder","source":{"type":"Git","git":{"uri":"https://github.com/openshift/nodejs-ex.git"}},"strategy":{"type":"Source","sourceStrategy":{"from":{"kind":"DockerImage","name":"registry.access.redhat.com/rhscl/nodejs-6-rhel7@sha256:b0b80d7bb0a1d69ef513a063c5fb3b074b02f699fd5437051233932dae7c864a"},"env":[{"name":"NPM_MIRROR"}],"forcePull":true}},"output":{"to":{"kind":"DockerImage","name":"172.30.254.23:5000/husk/nodejs-mongo-persistent:latest"},"pushSecret":{"name":"builder-dockercfg-gfs81"}},"resources":{},"postCommit":{"script":"npm test"},"nodeSelector":null,"triggeredBy":[{"message":"Image change","imageChangeBuild":{"imageID":"registry.access.redhat.com/rhscl/nodejs-6-rhel7@sha256:b0b80d7bb0a1d69ef513a063c5fb3b074b02f699fd5437051233932dae7c864a","fromRef":{"kind":"ImageStreamTag","namespace":"openshift","name":"nodejs:6"}}}]},"status":{"phase":"New","outputDockerImageReference":"172.30.254.23:5000/husk/nodejs-mongo-persistent:latest","config":{"kind":"BuildConfig","namespace":"husk","name":"nodejs-mongo-persistent"},"output":{}}}

      SOURCE_REPOSITORY:	https://github.com/openshift/nodejs-ex.git
      SOURCE_URI:		https://github.com/openshift/nodejs-ex.git
      ORIGIN_VERSION:		v3.6.173.0.5
      ALLOWED_UIDS:		1-
      DROP_CAPS:		KILL,MKNOD,SETGID,SETUID,SYS_CHROOT
      PUSH_DOCKERCFG_PATH:	/var/run/secrets/openshift.io/push
    Mounts:
      /var/run/docker.sock from docker-socket (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from builder-token-pdjqf (ro)
      /var/run/secrets/openshift.io/push from builder-dockercfg-gfs81-push (ro)
Conditions:
  Type		Status
  Initialized 	True 
  Ready 	False 
  PodScheduled 	True 
Volumes:
  docker-socket:
    Type:	HostPath (bare host directory volume)
    Path:	/var/run/docker.sock
  builder-dockercfg-gfs81-push:
    Type:	Secret (a volume populated by a Secret)
    SecretName:	builder-dockercfg-gfs81
    Optional:	false
  builder-token-pdjqf:
    Type:	Secret (a volume populated by a Secret)
    SecretName:	builder-token-pdjqf
    Optional:	false
QoS Class:	Burstable
Node-Selectors:	type=compute
Tolerations:	<none>
Events:
  FirstSeen	LastSeen	Count	From							SubObjectPath			Type	Reason		Message
  ---------	--------	-----	----							-------------			--------	------		-------
  5m		5m		1	default-scheduler									NormaScheduled	Successfully assigned nodejs-mongo-persistent-1-build to ip-172-31-63-231.us-west-2.compute.internal
  5m		5m		1	kubelet, ip-172-31-63-231.us-west-2.compute.internal	spec.containers{sti-build}	NormaPulling		pulling image "registry.ops.openshift.com/openshift3/ose-sti-builder:v3.6.173.0.5"
  5m		5m		1	kubelet, ip-172-31-63-231.us-west-2.compute.internal	spec.containers{sti-build}	NormaPulled		Successfully pulled image "registry.ops.openshift.com/openshift3/ose-sti-builder:v3.6.173.0.5"
  5m		5m		1	kubelet, ip-172-31-63-231.us-west-2.compute.internal	spec.containers{sti-build}	NormaCreated		Created container
  5m		5m		1	kubelet, ip-172-31-63-231.us-west-2.compute.internal	spec.containers{sti-build}	NormaStarted		Started container
  2m		2m		1	kubelet, ip-172-31-63-231.us-west-2.compute.internal					Warning		FailedMount	Unable to mount volumes for pod "nodejs-mongo-persistent-1-build_husk(8ff1bea6-ab38-11e7-a41e-0ab8769191d3)": timeout expired waiting for volumes to attach/mount for pod "husk"/"nodejs-mongo-persistent-1-build". list of unattached/unmounted volumes=[docker-socket builder-dockercfg-gfs81-push builder-token-pdjqf]
  2m		2m		1	kubelet, ip-172-31-63-231.us-west-2.compute.internal					Warning		FailedSync	Error syncing pod


Name:			nodejs-mongo-persistent-1-deploy
Namespace:		husk
Security Policy:	restricted
Node:			ip-172-31-50-162.us-west-2.compute.internal/172.31.50.162
Start Time:		Sat, 07 Oct 2017 10:22:48 +0200
Labels:			openshift.io/deployer-pod-for.name=nodejs-mongo-persistent-1
Annotations:		kubernetes.io/limit-ranger=LimitRanger plugin set: cpu, memory request for container deployment; cpu, memory limit for container deployment
			openshift.io/deployment.name=nodejs-mongo-persistent-1
			openshift.io/scc=restricted
Status:			Running
IP:			10.130.127.202
Controllers:		<none>
Containers:
  deployment:
    Container ID:	docker://f50e6b9764122223c15c8c05f94a677c32d307157755f23703a5f086d59bba01
    Image:		registry.ops.openshift.com/openshift3/ose-deployer:v3.6.173.0.5
    Image ID:		docker-pullable://registry.ops.openshift.com/openshift3/ose-deployer@sha256:b2f160d0edf98fe161cb27ee694e5995f543dd631306573d735ac9eb1807244c
    Port:		
    State:		Running
      Started:		Sat, 07 Oct 2017 10:23:48 +0200
    Ready:		True
    Restart Count:	0
    Limits:
      cpu:	1
      memory:	512Mi
    Requests:
      cpu:	50m
      memory:	256Mi
    Environment:
      KUBERNETES_MASTER:	https://ip-172-31-50-164.us-west-2.compute.internal
      OPENSHIFT_MASTER:		https://ip-172-31-50-164.us-west-2.compute.internal
      BEARER_TOKEN_FILE:	/var/run/secrets/kubernetes.io/serviceaccount/token
      OPENSHIFT_CA_DATA:	-----BEGIN CERTIFICATE-----
MIIC6jCCAdKgAwIBAgIBATANBgkqhkiG9w0BAQsFADAmMSQwIgYDVQQDDBtvcGVu
c2hpZnQtc2lnbmVyQDE0OTMzMzU1ODIwHhcNMTcwNDI3MjMyNjIyWhcNMjIwNDI2
MjMyNjIzWjAmMSQwIgYDVQQDDBtvcGVuc2hpZnQtc2lnbmVyQDE0OTMzMzU1ODIw
ggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDPUg0F78yfoFVJp20knL1j
uhLqh/MTu81CJXabjVHBte5bf4iPx6Y03FWbihFIkqO0LqSOVGafKhZPGRKPcQ4I
snz+SF05WTZVFCFh/sv1Zq2u8ZVdmaSIswlG7iws4TAyTSQoZQreWBb5URg5hV3o
k+KE23oSOEC5sxsIgvEsFp4S0JvUxj0yspjkuCQu6k11N3OkPnYd3r8TYYA0FqzO
rTFAf9PihMXnDo3mZUKKFS1pQnDgYXxcLV9WPpKOUqMr2ejU0g7S78zPXUfHMOnx
9pVxOAOUl62HZGgnPJ3NQchKfhe621Doi0quUPm4S2zKbIFvjx2mX+lmBtes1KbX
AgMBAAGjIzAhMA4GA1UdDwEB/wQEAwICpDAPBgNVHRMBAf8EBTADAQH/MA0GCSqG
SIb3DQEBCwUAA4IBAQBWkKw3HobKxLsWmZpabJiHWUyxbvihsCICjuqTnewNNWao
IJOofFV02Lc1BVaSBgiPeGLHh6KtDmX37YfHrNDaC8GOIzyTIsFFBRVUz599mt3d
GmE8P3NkebWWc24crUlBR8aW9JQxcANnXRNszb0uKYIRw0ew8rpTfEZTHJRNFdUZ
MMq3a6EytlaZET8nGMHd8mUBrtZtNGY960+ZzkAn4oQwEbNQpdu5f48pbOcRWi59
M3QcgEqKs/AezFClo18O1L2ECR9JAOEu/nScaZQIcYcYkCPJEOjUuqjXwuHuT8kG
ehiZQzwqOJHbJOFlp4wkRxg8h72wISmaNuvhBsEO
-----END CERTIFICATE-----

      OPENSHIFT_DEPLOYMENT_NAME:	nodejs-mongo-persistent-1
      OPENSHIFT_DEPLOYMENT_NAMESPACE:	husk
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from deployer-token-t7hkp (ro)
Conditions:
  Type		Status
  Initialized 	True 
  Ready 	True 
  PodScheduled 	True 
Volumes:
  deployer-token-t7hkp:
    Type:	Secret (a volume populated by a Secret)
    SecretName:	deployer-token-t7hkp
    Optional:	false
QoS Class:	Burstable
Node-Selectors:	type=compute
Tolerations:	<none>
Events:
  FirstSeen	LastSeen	Count	From							SubObjectPath			Type	Reason		Message
  ---------	--------	-----	----							-------------			--------	------		-------
  4m		4m		1	default-scheduler									NormaScheduled	Successfully assigned nodejs-mongo-persistent-1-deploy to ip-172-31-50-162.us-west-2.compute.internal
  4m		4m		1	kubelet, ip-172-31-50-162.us-west-2.compute.internal	spec.containers{deployment}	NormaPulling		pulling image "registry.ops.openshift.com/openshift3/ose-deployer:v3.6.173.0.5"
  3m		3m		1	kubelet, ip-172-31-50-162.us-west-2.compute.internal	spec.containers{deployment}	NormaPulled		Successfully pulled image "registry.ops.openshift.com/openshift3/ose-deployer:v3.6.173.0.5"
  3m		3m		1	kubelet, ip-172-31-50-162.us-west-2.compute.internal	spec.containers{deployment}	NormaCreated		Created container
  3m		3m		1	kubelet, ip-172-31-50-162.us-west-2.compute.internal	spec.containers{deployment}	NormaStarted		Started container

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions