Failed
=== RUN   TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
time="2023-05-17T17:04:20Z" level=info msg="Deleting e2e-test-name=TestIstioUpdateInMiddleZeroCanaryReplicas"
W0517 17:04:20.689779   16935 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0517 17:04:20.693829   16935 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-05-17T17:04:21Z" level=info msg="service/istio-host-split-canary created\n" rollout=istio-host-split
time="2023-05-17T17:04:21Z" level=info msg="service/istio-host-split-stable created\n" rollout=istio-host-split
time="2023-05-17T17:04:21Z" level=info msg="virtualservice.networking.istio.io/istio-host-split-vsvc created\n" rollout=istio-host-split
time="2023-05-17T17:04:22Z" level=info msg="rollout.argoproj.io/istio-host-split created\n" rollout=istio-host-split
time="2023-05-17T17:04:22Z" level=info msg="Waiting for condition: status=Healthy" rollout=istio-host-split
time="2023-05-17T17:04:23Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=istio-host-split
time="2023-05-17T17:04:23Z" level=info msg="Updated rollout pod spec: 2023-05-17T17:04:23.230176183Z" rollout=istio-host-split
time="2023-05-17T17:04:23Z" level=info msg="Waiting for condition: status=Paused" rollout=istio-host-split
    when.go:440: timeout after 2m0s waiting for condition status=Paused
Name:            istio-host-split
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout spec update to be observed
Strategy:        Canary
  Step:          3/3
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       2
  Current:       2
  Updated:       2
  Ready:         2
  Available:     2

NAME                                          KIND        STATUS         AGE   INFO
⟳ istio-host-split                            Rollout     �[94m◌�[0m Progressing  2m1s  
└──# revision:1                                                                
   └──⧉ �[32mistio-host-split-5b6ddfd769�[0m           ReplicaSet  �[32m✔�[0m Healthy      2m1s  �[32mstable�[0m
      ├──□ istio-host-split-5b6ddfd769-5qs8j  Pod         �[32m✔�[0m Running      2m1s  ready:1/1
      └──□ istio-host-split-5b6ddfd769-nlt68  Pod         �[32m✔�[0m Running      2m1s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "1"
  creationTimestamp: "2023-05-17T17:04:22Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestIstioUpdateInMiddleZeroCanaryReplicas
  name: istio-host-split
  namespace: default
  resourceVersion: "14392"
  uid: 3d53967a-adcb-424d-b9ec-64f542b2b024
spec:
  replicas: 2
  selector:
    matchLabels:
      app: istio-host-split
  strategy:
    canary:
      canaryService: istio-host-split-canary
      stableService: istio-host-split-stable
      steps:
      - setWeight: 0
      - setCanaryScale:
          replicas: 1
      - pause: {}
      trafficRouting:
        istio:
          virtualService:
            name: istio-host-split-vsvc
            routes:
            - primary
  template:
    metadata:
      annotations:
        update: "2023-05-17T17:04:23.230176183Z"
      creationTimestamp: null
      labels:
        app: istio-host-split
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: istio-host-split
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 5b6ddfd769
        serviceName: istio-host-split-canary
        weight: 0
      stable:
        podTemplateHash: 5b6ddfd769
        serviceName: istio-host-split-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-05-17T17:04:22Z"
    lastUpdateTime: "2023-05-17T17:04:22Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-05-17T17:04:23Z"
    lastUpdateTime: "2023-05-17T17:04:23Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-05-17T17:04:22Z"
    lastUpdateTime: "2023-05-17T17:04:23Z"
    message: ReplicaSet "istio-host-split-5b6ddfd769" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  - lastTransitionTime: "2023-05-17T17:04:23Z"
    lastUpdateTime: "2023-05-17T17:04:23Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  currentPodHash: 5b6ddfd769
  currentStepHash: 97f6fb877
  currentStepIndex: 3
  observedGeneration: "1"
  phase: Healthy
  readyReplicas: 2
  replicas: 2
  selector: app=istio-host-split
  stableRS: 5b6ddfd769
  updatedReplicas: 2

2023-05-17T17:04:22Z         Normal    RolloutNotCompleted     Rollout not completed, started update to revision 1 (5b6ddfd769)
2023-05-17T17:04:22Z         Normal    RolloutUpdated          Rollout updated to revision 1
2023-05-17T17:04:22Z         Normal    NewReplicaSetCreated    Created ReplicaSet istio-host-split-5b6ddfd769 (revision 1)
2023-05-17T17:04:22Z (x2)    Normal    TrafficWeightUpdated    Traffic weight updated to 0
2023-05-17T17:04:22Z         Normal    ScalingReplicaSet       Scaled up ReplicaSet istio-host-split-5b6ddfd769 (revision 1) from 0 to 2
2023-05-17T17:04:22Z         Normal    RolloutCompleted        Rollout completed update to revision 1 (5b6ddfd769): Initial deploy
2023-05-17T17:04:22Z         Normal    TrafficWeightUpdated    Traffic weight updated 
2023-05-17T17:04:23Z         Normal    SwitchService           Switched selector for service 'istio-host-split-stable' from '' to '5b6ddfd769'
2023-05-17T17:04:23Z         Normal    SwitchService           Switched selector for service 'istio-host-split-canary' from '' to '5b6ddfd769'

time="2023-05-17T17:06:23Z" level=info msg="Deleting e2e-test-name=TestIstioUpdateInMiddleZeroCanaryReplicas"
W0517 17:06:23.749659   16935 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0517 17:06:23.754199   16935 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-05-17T17:06:23Z" level=info msg="Deleting e2e-test-name"
W0517 17:06:23.917420   16935 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0517 17:06:23.921741   16935 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas (123.21s)

Failed
=== RUN   TestIstioSuite
--- FAIL: TestIstioSuite (207.26s)

Failed
=== RUN   TestCanarySuite/TestEphemeralMetadata
time="2023-05-17T16:53:15Z" level=info msg="Deleting e2e-test-name=TestEphemeralMetadata"
W0517 16:53:15.355601   17091 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0517 16:53:15.359507   17091 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-05-17T16:53:15Z" level=info msg="rollout.argoproj.io/ephemeral-metadata-canary created\n" rollout=ephemeral-metadata-canary
time="2023-05-17T16:53:15Z" level=info msg="Waiting for condition: status.replicas=2" rollout=ephemeral-metadata-canary
time="2023-05-17T16:53:15Z" level=info msg="Condition 'status.replicas=2' met after 0s" rollout=ephemeral-metadata-canary
2023/05/17 16:53:15 +map[app:ephemeral-metadata-canary role:stable rollouts-pod-template-hash:64d4f9dbd6]
2023/05/17 16:53:15 +map[app:ephemeral-metadata-canary role:stable rollouts-pod-template-hash:64d4f9dbd6]
time="2023-05-17T16:53:15Z" level=info msg="Pod expectation 'all pods have stable metadata' met" rollout=ephemeral-metadata-canary
time="2023-05-17T16:53:15Z" level=info msg="Waiting for condition: status=Healthy" rollout=ephemeral-metadata-canary
time="2023-05-17T16:53:17Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=ephemeral-metadata-canary
time="2023-05-17T16:53:17Z" level=info msg="Updated rollout pod spec: 2023-05-17T16:53:17.754706626Z" rollout=ephemeral-metadata-canary
time="2023-05-17T16:53:17Z" level=info msg="Waiting for condition: status=Paused" rollout=ephemeral-metadata-canary
    when.go:440: timeout after 2m0s waiting for condition status=Paused
Name:            ephemeral-metadata-canary
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout spec update to be observed
Strategy:        Canary
  Step:          2/2
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       2
  Current:       2
  Updated:       2
  Ready:         2
  Available:     2

NAME                                                   KIND        STATUS         AGE   INFO
⟳ ephemeral-metadata-canary                            Rollout     �[94m◌�[0m Progressing  2m2s  
└──# revision:1                                                                         
   └──⧉ �[32mephemeral-metadata-canary-64d4f9dbd6�[0m           ReplicaSet  �[32m✔�[0m Healthy      2m2s  �[32mstable�[0m
      ├──□ ephemeral-metadata-canary-64d4f9dbd6-q8n7h  Pod         �[32m✔�[0m Running      2m2s  ready:1/1
      └──□ ephemeral-metadata-canary-64d4f9dbd6-wll27  Pod         �[32m✔�[0m Running      2m2s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "1"
  creationTimestamp: "2023-05-17T16:53:15Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestEphemeralMetadata
  name: ephemeral-metadata-canary
  namespace: default
  resourceVersion: "6765"
  uid: 38c0d106-6794-41cb-a466-629d7cb1cc24
spec:
  replicas: 2
  selector:
    matchLabels:
      app: ephemeral-metadata-canary
  strategy:
    canary:
      canaryMetadata:
        labels:
          role: canary
      stableMetadata:
        labels:
          role: stable
      steps:
      - setWeight: 50
      - pause: {}
  template:
    metadata:
      annotations:
        update: "2023-05-17T16:53:17.754706626Z"
      creationTimestamp: null
      labels:
        app: ephemeral-metadata-canary
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: ephemeral-metadata
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-05-17T16:53:15Z"
    lastUpdateTime: "2023-05-17T16:53:15Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-05-17T16:53:17Z"
    lastUpdateTime: "2023-05-17T16:53:17Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-05-17T16:53:15Z"
    lastUpdateTime: "2023-05-17T16:53:17Z"
    message: ReplicaSet "ephemeral-metadata-canary-64d4f9dbd6" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  - lastTransitionTime: "2023-05-17T16:53:17Z"
    lastUpdateTime: "2023-05-17T16:53:17Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  currentPodHash: 64d4f9dbd6
  currentStepHash: 757f5f97b
  currentStepIndex: 2
  observedGeneration: "1"
  phase: Healthy
  readyReplicas: 2
  replicas: 2
  selector: app=ephemeral-metadata-canary
  stableRS: 64d4f9dbd6
  updatedReplicas: 2

2023-05-17T16:53:15Z    Normal    RolloutNotCompleted     Rollout not completed, started update to revision 1 (64d4f9dbd6)
2023-05-17T16:53:15Z    Normal    RolloutUpdated          Rollout updated to revision 1
2023-05-17T16:53:15Z    Normal    NewReplicaSetCreated    Created ReplicaSet ephemeral-metadata-canary-64d4f9dbd6 (revision 1)
2023-05-17T16:53:15Z    Normal    ScalingReplicaSet       Scaled up ReplicaSet ephemeral-metadata-canary-64d4f9dbd6 (revision 1) from 0 to 2
2023-05-17T16:53:15Z    Normal    RolloutCompleted        Rollout completed update to revision 1 (64d4f9dbd6): Initial deploy

time="2023-05-17T16:55:17Z" level=info msg="Deleting e2e-test-name=TestEphemeralMetadata"
W0517 16:55:18.031736   17091 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0517 16:55:18.036547   17091 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestCanarySuite/TestEphemeralMetadata (122.79s)

Failed
=== RUN   TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
time="2023-05-17T16:58:07Z" level=info msg="Deleting e2e-test-name=TestReduceWeightAndHonorMaxUnavailable"
time="2023-05-17T16:58:08Z" level=info msg="rollout.argoproj.io/reduceweight-maxunavailable created\n" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:08Z" level=info msg="Waiting for condition: status=Healthy" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:14Z" level=info msg="Condition 'status=Healthy' met after 6s" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:14Z" level=info msg="Updated rollout pod spec: 2023-05-17T16:58:14.672999805Z" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:14Z" level=info msg="Waiting for condition: status=Paused" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:26Z" level=info msg="Condition 'status=Paused' met after 12s" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:26Z" level=info msg="Pod expectation 'canary pod count == 3' met" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:26Z" level=info msg="Pod expectation 'stable pod count == 0' met" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:26Z" level=info msg="Promoted rollout" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:26Z" level=info msg="Sleeping 2s" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:28Z" level=info msg="Pod expectation 'canary pod count == 3' met" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:28Z" level=warning msg="unexpected stable (hash 758678599b) pod count: expected 2, saw: 0" rollout=reduceweight-maxunavailable
time="2023-05-17T16:58:28Z" level=error msg="Pod expectation 'stable pod count == 2' failed" rollout=reduceweight-maxunavailable
Name:            reduceweight-maxunavailable
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout to unpause
Strategy:        Canary
  Step:          1/6
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[33mcanary�[0m)
Replicas:
  Desired:       3
  Current:       3
  Updated:       3
  Ready:         3
  Available:     3

NAME                                                     KIND        STATUS         AGE  INFO
⟳ reduceweight-maxunavailable                            Rollout     �[94m◌�[0m Progressing  21s  
├──# revision:2                                                                          
│  └──⧉ �[33mreduceweight-maxunavailable-79d795846f�[0m           ReplicaSet  �[32m✔�[0m Healthy      15s  �[33mcanary�[0m
│     ├──□ reduceweight-maxunavailable-79d795846f-mffpc  Pod         �[32m✔�[0m Running      15s  ready:1/1
│     ├──□ reduceweight-maxunavailable-79d795846f-qsfsh  Pod         �[32m✔�[0m Running      15s  ready:1/1
│     └──□ reduceweight-maxunavailable-79d795846f-cmv2f  Pod         �[32m✔�[0m Running      9s   ready:1/1
└──# revision:1                                                                          
   └──⧉ �[32mreduceweight-maxunavailable-758678599b�[0m           ReplicaSet  �[0m•�[0m ScaledDown   21s  �[32mstable�[0m
      └──□ reduceweight-maxunavailable-758678599b-c7f68  Pod         �[94m◌�[0m Terminating  21s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-05-17T16:58:08Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestReduceWeightAndHonorMaxUnavailable
  name: reduceweight-maxunavailable
  namespace: default
  resourceVersion: "7078"
  uid: fcac72e6-fbf7-429e-8439-587d2e2d1178
spec:
  replicas: 3
  selector:
    matchLabels:
      app: reduceweight-maxunavailable
  strategy:
    canary:
      maxSurge: 2
      maxUnavailable: 0
      steps:
      - setWeight: 100
      - pause: {}
      - setWeight: 0
      - pause: {}
      - setWeight: 100
      - analysis:
          analysisRunMetadata: {}
          args:
          - name: exit-code
            value: "1"
          templates:
          - templateName: sleep-job
  template:
    metadata:
      annotations:
        update: "2023-05-17T16:58:14.672999805Z"
      creationTimestamp: null
      labels:
        app: reduceweight-maxunavailable
    spec:
      containers:
      - image: nginx:1.19-alpine
        lifecycle:
          postStart:
            exec:
              command:
              - sleep
              - "5"
          preStop:
            exec:
              command:
              - sleep
              - "5"
        name: reduceweight-maxunavailable
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 3
  availableReplicas: 3
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-05-17T16:58:14Z"
    lastUpdateTime: "2023-05-17T16:58:14Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-05-17T16:58:14Z"
    lastUpdateTime: "2023-05-17T16:58:14Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-05-17T16:58:14Z"
    lastUpdateTime: "2023-05-17T16:58:14Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-05-17T16:58:26Z"
    lastUpdateTime: "2023-05-17T16:58:26Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: Unknown
    type: Progressing
  - lastTransitionTime: "2023-05-17T16:58:26Z"
    lastUpdateTime: "2023-05-17T16:58:26Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  controllerPause: true
  currentPodHash: 79d795846f
  currentStepHash: 7dd587c87d
  currentStepIndex: 1
  message: CanaryPauseStep
  observedGeneration: "3"
  phase: Paused
  readyReplicas: 3
  replicas: 3
  selector: app=reduceweight-maxunavailable
  stableRS: 758678599b
  updatedReplicas: 3

2023-05-17T16:58:08Z    Normal    RolloutNotCompleted     Rollout not completed, started update to revision 1 (758678599b)
2023-05-17T16:58:08Z    Normal    RolloutUpdated          Rollout updated to revision 1
2023-05-17T16:58:08Z    Normal    NewReplicaSetCreated    Created ReplicaSet reduceweight-maxunavailable-758678599b (revision 1)
2023-05-17T16:58:08Z    Normal    ScalingReplicaSet       Scaled up ReplicaSet reduceweight-maxunavailable-758678599b (revision 1) from 0 to 3
2023-05-17T16:58:08Z    Normal    RolloutCompleted        Rollout completed update to revision 1 (758678599b): Initial deploy
2023-05-17T16:58:14Z    Normal    RolloutNotCompleted     Rollout not completed, started update to revision 2 (79d795846f)
2023-05-17T16:58:14Z    Normal    RolloutUpdated          Rollout updated to revision 2
2023-05-17T16:58:14Z    Normal    NewReplicaSetCreated    Created ReplicaSet reduceweight-maxunavailable-79d795846f (revision 2)
2023-05-17T16:58:14Z    Normal    ScalingReplicaSet       Scaled up ReplicaSet reduceweight-maxunavailable-79d795846f (revision 2) from 0 to 2
2023-05-17T16:58:20Z    Normal    ScalingReplicaSet       Scaled down ReplicaSet reduceweight-maxunavailable-758678599b (revision 1) from 3 to 2
2023-05-17T16:58:20Z    Normal    ScalingReplicaSet       Scaled down ReplicaSet reduceweight-maxunavailable-758678599b (revision 1) from 2 to 1
2023-05-17T16:58:20Z    Normal    ScalingReplicaSet       Scaled up ReplicaSet reduceweight-maxunavailable-79d795846f (revision 2) from 2 to 3
2023-05-17T16:58:26Z    Normal    ScalingReplicaSet       Scaled down ReplicaSet reduceweight-maxunavailable-758678599b (revision 1) from 1 to 0
2023-05-17T16:58:26Z    Normal    RolloutStepCompleted    Rollout step 1/6 completed (setWeight: 100)
2023-05-17T16:58:26Z    Normal    RolloutPaused           Rollout is paused (CanaryPauseStep)

time="2023-05-17T16:58:29Z" level=info msg="Deleting e2e-test-name=TestReduceWeightAndHonorMaxUnavailable"
    --- FAIL: TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable (21.33s)

Failed
=== RUN   TestCanarySuite
time="2023-05-17T16:55:06Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (236.84s)

Failed
=== RUN   TestRollbackSuite/TestRollbackAnalysisOutsideWindow
time="2023-05-17T17:10:13Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisOutsideWindow"
time="2023-05-17T17:10:14Z" level=info msg="rollout.argoproj.io/window configured\n" rollout=window
time="2023-05-17T17:10:14Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-05-17T17:10:19Z" level=info msg="Condition 'status=Healthy' met after 5s" rollout=window
time="2023-05-17T17:10:19Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-05-17T17:10:19Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-05-17T17:10:27Z" level=info msg="Condition 'status=Healthy' met after 7s" rollout=window
time="2023-05-17T17:10:27Z" level=info msg="AnalysisRun expectation 'analysisrun count == 1' met" rollout=window
time="2023-05-17T17:10:27Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"three\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"three\"}}}}}" rollout=window
time="2023-05-17T17:10:27Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-05-17T17:10:33Z" level=info msg="Condition 'status=Healthy' met after 5s" rollout=window
time="2023-05-17T17:10:33Z" level=info msg="AnalysisRun expectation 'analysisrun count == 2' met" rollout=window
time="2023-05-17T17:10:33Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"four\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"four\"}}}}}" rollout=window
time="2023-05-17T17:10:33Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-05-17T17:10:33Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=window
time="2023-05-17T17:10:33Z" level=error msg="AnalysisRun expectation 'analysisrun count == 3' failed" rollout=window
Name:            window
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/2
  SetWeight:     50
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       2
  Current:       2
  Updated:       0
  Ready:         2
  Available:     2

NAME                                                         KIND         STATUS         AGE  INFO
⟳ window                                                     Rollout      �[94m◌�[0m Progressing  20s  
├──# revision:4                                                                               
│  └──⧉ �[33mwindow-cd5644b76�[0m                                     ReplicaSet   �[0m•�[0m ScaledDown   0s   �[33mcanary�[0m
├──# revision:3                                                                               
│  ├──⧉ �[32mwindow-6458bcd6fb�[0m                                    ReplicaSet   �[32m✔�[0m Healthy      6s   �[32mstable�[0m
│  │  ├──□ window-6458bcd6fb-lhdvd                           Pod          �[32m✔�[0m Running      6s   ready:1/1
│  │  └──□ window-6458bcd6fb-k59f8                           Pod          �[32m✔�[0m Running      1s   ready:1/1
│  └──α �[0mwindow-6458bcd6fb-3-1�[0m                                AnalysisRun  �[32m✔�[0m Successful   5s   �[32m✔�[0m 1
│     └──⊞ �[0m1d85f293-4e9c-44b3-a4c5-9f3937cfbf1b.sleep-job.1�[0m  Job          �[32m✔�[0m Successful   5s   
├──# revision:2                                                                               
│  ├──⧉ window-5658c69dbb                                    ReplicaSet   �[0m•�[0m ScaledDown   14s  
│  │  └──□ window-5658c69dbb-km4hn                           Pod          �[94m◌�[0m Terminating  14s  ready:1/1
│  └──α �[0mwindow-5658c69dbb-2-1�[0m                                AnalysisRun  �[32m✔�[0m Successful   12s  �[32m✔�[0m 1
│     └──⊞ �[0mf8894acc-97e3-4ce7-a517-9a38be7610de.sleep-job.1�[0m  Job          �[32m✔�[0m Successful   12s  
└──# revision:1                                                                               
   └──⧉ window-c64cf84f6                                     ReplicaSet   �[0m•�[0m ScaledDown   20s  

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "3"
  creationTimestamp: "2023-05-17T17:10:13Z"
  generation: 7
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestRollbackAnalysisOutsideWindow
    rev: four
  name: window
  namespace: default
  resourceVersion: "15042"
  uid: 68f6b040-1b2b-4779-8707-151c335dc593
spec:
  replicas: 2
  rollbackWindow:
    revisions: 2
  selector:
    matchLabels:
      app: window
  strategy:
    canary:
      steps:
      - setWeight: 50
      - analysis:
          analysisRunMetadata: {}
          args:
          - name: rev
            valueFrom:
              fieldRef:
                fieldPath: metadata.labels['rev']
          templates:
          - templateName: sleep-job
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: window
        rev: four
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: basic
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-05-17T17:10:19Z"
    lastUpdateTime: "2023-05-17T17:10:19Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-05-17T17:10:32Z"
    lastUpdateTime: "2023-05-17T17:10:32Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-05-17T17:10:33Z"
    lastUpdateTime: "2023-05-17T17:10:33Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-05-17T17:10:13Z"
    lastUpdateTime: "2023-05-17T17:10:33Z"
    message: ReplicaSet "window-6458bcd6fb" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  currentPodHash: 6458bcd6fb
  currentStepHash: 7dd87d6d74
  currentStepIndex: 2
  observedGeneration: "6"
  phase: Healthy
  readyReplicas: 2
  replicas: 2
  selector: app=window
  stableRS: 6458bcd6fb
  updatedReplicas: 2

2023-05-17T17:10:13Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 1 (c64cf84f6)
2023-05-17T17:10:13Z         Normal    RolloutUpdated           Rollout updated to revision 1
2023-05-17T17:10:13Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-c64cf84f6 (revision 1)
2023-05-17T17:10:13Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-c64cf84f6 (revision 1) from 0 to 2
2023-05-17T17:10:13Z         Normal    RolloutCompleted         Rollout completed update to revision 1 (c64cf84f6): Initial deploy
2023-05-17T17:10:19Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 2 (5658c69dbb)
2023-05-17T17:10:19Z         Normal    RolloutUpdated           Rollout updated to revision 2
2023-05-17T17:10:19Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-5658c69dbb (revision 2)
2023-05-17T17:10:19Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-5658c69dbb (revision 2) from 0 to 1
2023-05-17T17:10:20Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 2 to 1
2023-05-17T17:10:21Z         Normal    AnalysisRunRunning       Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Running' Previous: ''
2023-05-17T17:10:26Z         Normal    AnalysisRunSuccessful    Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Successful' Previous: 'Running'
2023-05-17T17:10:26Z         Normal    RolloutStepCompleted     Rollout step 2/2 completed (analysis)
2023-05-17T17:10:26Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-5658c69dbb (revision 2) from 1 to 2
2023-05-17T17:10:26Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 1 to 0
2023-05-17T17:10:26Z         Normal    RolloutCompleted         Rollout completed update to revision 2 (5658c69dbb): Completed all 2 canary steps
2023-05-17T17:10:27Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 3 (6458bcd6fb)
2023-05-17T17:10:27Z         Normal    RolloutUpdated           Rollout updated to revision 3
2023-05-17T17:10:27Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-6458bcd6fb (revision 3)
2023-05-17T17:10:27Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-6458bcd6fb (revision 3) from 0 to 1
2023-05-17T17:10:28Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-5658c69dbb (revision 2) from 2 to 1
2023-05-17T17:10:28Z (x2)    Normal    RolloutStepCompleted     Rollout step 1/2 completed (setWeight: 50)
2023-05-17T17:10:28Z         Normal    AnalysisRunRunning       Step Analysis Run 'window-6458bcd6fb-3-1' Status New: 'Running' Previous: ''
2023-05-17T17:10:31Z         Normal    AnalysisRunSuccessful    Step Analysis Run 'window-6458bcd6fb-3-1' Status New: 'Successful' Previous: 'Running'

time="2023-05-17T17:10:33Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisOutsideWindow"
    --- FAIL: TestRollbackSuite/TestRollbackAnalysisOutsideWindow (20.50s)

Failed
=== RUN   TestRollbackSuite
time="2023-05-17T17:10:12Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2023-05-17T17:10:13Z" level=info msg="rollout.argoproj.io/window created\n"
--- FAIL: TestRollbackSuite (47.85s)