Test failures: runtime-pullpolicy, image-stream, monitor #526
Description
runtime-pullpolicyandimage-streamtests failed on P and Z, but passed on Xmonitorfailed in kind-tests (on X)
Failures were seen in both of these builds:
RCO build 397
RCO build 396
==========
monitor kind-e2e test failed. It passed on OCP X, P and Z. It also passed on WLO.
Observed on:
Name: monitor
State: fail
Errors:
[servicemonitors.monitoring.coreos.com](http://servicemonitors.monitoring.coreos.com/) "service-monitor-liberty" not found
=======
runtime_pullpolicy test failed on Z, but it passed on X
--- FAIL: kuttl/harness/runtime_pullpolicy (102.05s)
Failed on this build as well:
https://cloud.ibm.com/devops/pipelines/tekton/729b3aea-0a81-4b4d-bd42-7e5811980010/runs/9207070c-cbb8-4989-bdcd-83eaca686655/deploy-acceptance-tests/run-stage?env_id=ibm:yp:us-south
CONT kuttl/harness/runtime_pullpolicy
logger.go:42: 18:14:42 | runtime_pullpolicy | Skipping creation of user-supplied namespace: rco-test-359
logger.go:42: 18:14:42 | runtime_pullpolicy/0-always | starting test step 0-always
logger.go:42: 18:14:45 | runtime_pullpolicy/0-always | RuntimeComponent:rco-test-359/example-runtime-component created
logger.go:42: 18:15:17 | runtime_pullpolicy/0-always | test step completed 0-always
logger.go:42: 18:15:17 | runtime_pullpolicy/1-ifNotPresent | starting test step 1-ifNotPresent
logger.go:42: 18:15:20 | runtime_pullpolicy/1-ifNotPresent | RuntimeComponent:rco-test-359/example-runtime-component updated
logger.go:42: 18:15:20 | runtime_pullpolicy/1-ifNotPresent | test step completed 1-ifNotPresent
I0411 18:21:24.740133 185 request.go:682] Waited for 1.330894418s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/migration.k8s.io/v1alpha1?timeout=32s
I0411 18:21:34.762973 185 request.go:682] Waited for 1.580789187s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/network.openshift.io/v1?timeout=32s
I0411 18:21:44.805988 185 request.go:682] Waited for 1.935755109s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/autoscaling.openshift.io/v1?timeout=32s
logger.go:42: 18:15:20 | runtime_pullpolicy/2-never | starting test step 2-never
logger.go:42: 18:15:23 | runtime_pullpolicy/2-never | RuntimeComponent:rco-test-359/example-runtime-component updated
logger.go:42: 18:16:24 | runtime_pullpolicy/2-never | test step failed 2-never
case.go:364: failed in step 2-never
case.go:366: --- Deployment:rco-test-359/example-runtime-component
+++ Deployment:rco-test-359/example-runtime-component
@@ -1,10 +1,258 @@
apiVersion: apps/v1
kind: Deployment
metadata:
+ labels:
+ [app.kubernetes.io/component:](http://app.kubernetes.io/component:) backend
+ [app.kubernetes.io/instance:](http://app.kubernetes.io/instance:) example-runtime-component
+ [app.kubernetes.io/managed-by:](http://app.kubernetes.io/managed-by:) runtime-component-operator
+ [app.kubernetes.io/name:](http://app.kubernetes.io/name:) example-runtime-component
+ [app.kubernetes.io/part-of:](http://app.kubernetes.io/part-of:) example-runtime-component
+ rc.app.stacks/name: example-runtime-component
+ managedFields:
+ - apiVersion: apps/v1
+ fieldsType: FieldsV1
+ fieldsV1:
+ f:metadata:
+ f:labels:
+ .: {}
+ f:app.kubernetes.io/component: {}
+ f:app.kubernetes.io/instance: {}
+ f:app.kubernetes.io/managed-by: {}
+ f:app.kubernetes.io/name: {}
+ f:app.kubernetes.io/part-of: {}
+ f:rc.app.stacks/name: {}
+ f:ownerReferences:
+ .: {}
+ k:{"uid":"07db65cc-476c-4f81-b370-0de67e844734"}: {}
+ f:spec:
+ f:progressDeadlineSeconds: {}
I0411 18:21:57.998024 185 request.go:682] Waited for 1.033219763s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/serving.knative.dev/v1beta1?timeout=32s
+ f:replicas: {}
+ f:revisionHistoryLimit: {}
+ f:selector: {}
+ f:strategy:
+ f:rollingUpdate:
+ .: {}
+ f:maxSurge: {}
+ f:maxUnavailable: {}
+ f:type: {}
+ f:template:
+ f:metadata:
+ f:labels:
+ .: {}
+ f:app.kubernetes.io/component: {}
+ f:app.kubernetes.io/instance: {}
+ f:app.kubernetes.io/managed-by: {}
+ f:app.kubernetes.io/name: {}
+ f:app.kubernetes.io/part-of: {}
+ f:rc.app.stacks/name: {}
+ f:spec:
+ f:affinity:
+ .: {}
+ f:podAntiAffinity:
+ .: {}
+ f:preferredDuringSchedulingIgnoredDuringExecution: {}
+ f:containers:
+ k:{"name":"app"}:
+ .: {}
+ f:env:
+ .: {}
+ k:{"name":"SA_RESOURCE_VERSION"}:
+ .: {}
+ f:name: {}
+ f:value: {}
+ k:{"name":"SERVICE_CERT_SECRET_RESOURCE_VERSION"}:
+ .: {}
+ f:name: {}
+ f:value: {}
+ k:{"name":"TLS_DIR"}:
+ .: {}
+ f:name: {}
+ f:value: {}
+ f:image: {}
+ f:imagePullPolicy: {}
+ f:name: {}
+ f:ports:
+ .: {}
+ k:{"containerPort":8080,"protocol":"TCP"}:
+ .: {}
+ f:containerPort: {}
+ f:name: {}
+ f:protocol: {}
+ f:resources: {}
+ f:securityContext:
+ .: {}
+ f:allowPrivilegeEscalation: {}
+ f:capabilities:
+ .: {}
+ f:drop: {}
+ f:privileged: {}
+ f:readOnlyRootFilesystem: {}
+ f:runAsNonRoot: {}
+ f:terminationMessagePath: {}
+ f:terminationMessagePolicy: {}
+ f:volumeMounts:
+ .: {}
+ k:{"mountPath":"/etc/x509/certs"}:
+ .: {}
+ f:mountPath: {}
+ f:name: {}
+ f:readOnly: {}
+ f:dnsPolicy: {}
+ f:restartPolicy: {}
+ f:schedulerName: {}
+ f:securityContext: {}
+ f:serviceAccount: {}
+ f:serviceAccountName: {}
+ f:terminationGracePeriodSeconds: {}
+ f:volumes:
+ .: {}
+ k:{"name":"svc-certificate"}:
+ .: {}
+ f:name: {}
+ f:secret:
+ .: {}
+ f:defaultMode: {}
+ f:secretName: {}
+ manager: manager
+ operation: Update
+ time: "2023-04-11T18:14:47Z"
+ - apiVersion: apps/v1
+ fieldsType: FieldsV1
+ fieldsV1:
+ f:metadata:
+ f:annotations:
+ .: {}
+ f:deployment.kubernetes.io/revision: {}
+ f:status:
+ f:availableReplicas: {}
+ f:conditions:
+ .: {}
+ k:{"type":"Available"}:
+ .: {}
+ f:lastTransitionTime: {}
I0411 18:22:08.036046 185 request.go:682] Waited for 1.184800979s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/network.operator.openshift.io/v1?timeout=32s
I0411 18:22:18.629811 185 request.go:682] Waited for 1.029127958s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/quota.openshift.io/v1?timeout=32s
+ f:lastUpdateTime: {}
+ f:message: {}
+ f:reason: {}
+ f:status: {}
+ f:type: {}
+ k:{"type":"Progressing"}:
+ .: {}
+ f:lastTransitionTime: {}
+ f:lastUpdateTime: {}
+ f:message: {}
+ f:reason: {}
+ f:status: {}
+ f:type: {}
+ f:observedGeneration: {}
+ f:readyReplicas: {}
+ f:replicas: {}
+ f:unavailableReplicas: {}
+ f:updatedReplicas: {}
+ manager: kube-controller-manager
+ operation: Update
+ subresource: status
+ time: "2023-04-11T18:15:24Z"
name: example-runtime-component
namespace: rco-test-359
+ ownerReferences:
+ - apiVersion: rc.app.stacks/v1
+ blockOwnerDeletion: true
+ controller: true
+ kind: RuntimeComponent
+ name: example-runtime-component
+ uid: 07db65cc-476c-4f81-b370-0de67e844734
+spec:
+ progressDeadlineSeconds: 600
+ replicas: 1
+ revisionHistoryLimit: 10
+ selector:
+ matchLabels:
+ [app.kubernetes.io/instance:](http://app.kubernetes.io/instance:) example-runtime-component
+ strategy:
+ rollingUpdate:
+ maxSurge: 25%!
(MISSING)+ maxUnavailable: 25%!
(MISSING)+ type: RollingUpdate
+ template:
+ metadata:
+ creationTimestamp: null
+ labels:
+ [app.kubernetes.io/component:](http://app.kubernetes.io/component:) backend
+ [app.kubernetes.io/instance:](http://app.kubernetes.io/instance:) example-runtime-component
+ [app.kubernetes.io/managed-by:](http://app.kubernetes.io/managed-by:) runtime-component-operator
+ [app.kubernetes.io/name:](http://app.kubernetes.io/name:) example-runtime-component
+ [app.kubernetes.io/part-of:](http://app.kubernetes.io/part-of:) example-runtime-component
+ rc.app.stacks/name: example-runtime-component
+ spec:
+ affinity:
+ podAntiAffinity:
+ preferredDuringSchedulingIgnoredDuringExecution:
+ - podAffinityTerm:
+ labelSelector:
+ matchLabels:
+ [app.kubernetes.io/instance:](http://app.kubernetes.io/instance:) example-runtime-component
+ topologyKey: [kubernetes.io/hostname](http://kubernetes.io/hostname)
+ weight: 50
+ containers:
+ - env:
+ - name: TLS_DIR
+ value: /etc/x509/certs
+ - name: SA_RESOURCE_VERSION
+ value: "40449"
+ - name: SERVICE_CERT_SECRET_RESOURCE_VERSION
+ value: "40467"
+ image: [icr.io/appcafe/open-liberty](http://icr.io/appcafe/open-liberty)
+ imagePullPolicy: Never
+ name: app
+ ports:
+ - containerPort: 8080
+ name: 8080-tcp
+ protocol: TCP
I0411 18:22:32.373474 185 request.go:682] Waited for 1.030724983s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/authorization.openshift.io/v1?timeout=32s
I0411 18:22:42.419088 185 request.go:682] Waited for 2.034299334s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/packages.operators.coreos.com/v1?timeout=32s
+ resources: {}
+ securityContext:
+ allowPrivilegeEscalation: false
+ capabilities:
+ drop:
+ - ALL
+ privileged: false
+ readOnlyRootFilesystem: false
I0411 18:22:52.426805 185 request.go:682] Waited for 2.334416999s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/operator.knative.dev/v1beta1?timeout=32s
I0411 18:23:04.811417 185 request.go:682] Waited for 1.035203233s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/apiserver.openshift.io/v1?timeout=32s
I0411 18:23:24.211448 185 request.go:682] Waited for 1.032943285s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/ingress.operator.openshift.io/v1?timeout=32s
I0411 18:23:34.242524 185 request.go:682] Waited for 2.27997187s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/serving.knative.dev/v1alpha1?timeout=32s
+ runAsNonRoot: true
+ terminationMessagePath: /dev/termination-log
I0411 18:23:44.251372 185 request.go:682] Waited for 1.825684463s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/controlplane.operator.openshift.io/v1alpha1?timeout=32s
I0411 18:23:54.723670 185 request.go:682] Waited for 1.030151385s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/autoscaling.openshift.io/v1beta1?timeout=32s
+ terminationMessagePolicy: File
+ volumeMounts:
+ - mountPath: /etc/x509/certs
+ name: svc-certificate
+ readOnly: true
I0411 18:24:13.902950 185 request.go:682] Waited for 1.036638931s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/operators.coreos.com/v1alpha2?timeout=32s
I0411 18:24:23.945420 185 request.go:682] Waited for 2.185882268s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/rc.app.stacks/v1?timeout=32s
+ dnsPolicy: ClusterFirst
+ restartPolicy: Always
+ schedulerName: default-scheduler
I0411 18:24:40.076844 185 request.go:682] Waited for 1.035191075s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/security.internal.openshift.io/v1?timeout=32s
+ securityContext: {}
+ serviceAccount: example-runtime-component
I0411 18:24:50.713048 185 request.go:682] Waited for 1.031450627s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/snapshot.storage.k8s.io/v1beta1?timeout=32s
+ serviceAccountName: example-runtime-component
+ terminationGracePeriodSeconds: 30
+ volumes:
+ - name: svc-certificate
+ secret:
+ defaultMode: 420
+ secretName: example-runtime-component-svc-tls-cm
status:
+ availableReplicas: 1
+ conditions:
+ - lastTransitionTime: "2023-04-11T18:15:16Z"
+ lastUpdateTime: "2023-04-11T18:15:16Z"
I0411 18:25:05.632315 185 request.go:682] Waited for 1.023151362s due to client-side throttling, not priority and fairness, request: GET:https://9.46.103.239:6443/apis/operators.coreos.com/v1alpha1?timeout=32s
+ message: Deployment has minimum availability.
+ reason: MinimumReplicasAvailable
+ status: "True"
+ type: Available
+ - lastTransitionTime: "2023-04-11T18:14:47Z"
+ lastUpdateTime: "2023-04-11T18:15:24Z"
+ message: ReplicaSet "example-runtime-component-67765c6549" is progressing.
+ reason: ReplicaSetUpdated
+ status: "True"
+ type: Progressing
+ observedGeneration: 3
readyReplicas: 1
- replicas: 1
+ replicas: 2
+ unavailableReplicas: 1
updatedReplicas: 1
case.go:366: resource Deployment:rco-test-359/example-runtime-component: .status.replicas: value mismatch, expected: 1 != actual: 2