Failed
=== RUN   TestRollbackSuite/TestRollbackAnalysisOutsideWindow
time="2023-05-08T17:18:58Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisOutsideWindow"
W0508 17:18:58.307910   17212 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0508 17:18:58.326396   17212 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-05-08T17:18:58Z" level=info msg="rollout.argoproj.io/window configured\n" rollout=window
time="2023-05-08T17:18:58Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-05-08T17:19:04Z" level=info msg="Condition 'status=Healthy' met after 5s" rollout=window
time="2023-05-08T17:19:04Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-05-08T17:19:04Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-05-08T17:19:10Z" level=info msg="Condition 'status=Healthy' met after 5s" rollout=window
time="2023-05-08T17:19:10Z" level=info msg="AnalysisRun expectation 'analysisrun count == 1' met" rollout=window
time="2023-05-08T17:19:10Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"three\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"three\"}}}}}" rollout=window
time="2023-05-08T17:19:10Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-05-08T17:19:10Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=window
time="2023-05-08T17:19:10Z" level=error msg="AnalysisRun expectation 'analysisrun count == 2' failed" rollout=window
Name:            window
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/2
  SetWeight:     50
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       2
  Current:       2
  Updated:       0
  Ready:         2
  Available:     2

NAME                                                         KIND         STATUS         AGE  INFO
⟳ window                                                     Rollout      �[94m◌�[0m Progressing  12s  
├──# revision:3                                                                               
│  └──⧉ �[33mwindow-6458bcd6fb�[0m                                    ReplicaSet   �[94m◌�[0m Progressing  0s   �[33mcanary�[0m
├──# revision:2                                                                               
│  ├──⧉ �[32mwindow-5658c69dbb�[0m                                    ReplicaSet   �[32m✔�[0m Healthy      6s   �[32mstable�[0m
│  │  ├──□ window-5658c69dbb-5fh2f                           Pod          �[32m✔�[0m Running      6s   ready:1/1
│  │  └──□ window-5658c69dbb-xmrb2                           Pod          �[32m✔�[0m Running      1s   ready:1/1
│  └──α �[0mwindow-5658c69dbb-2-1�[0m                                AnalysisRun  �[32m✔�[0m Successful   4s   �[32m✔�[0m 1
│     └──⊞ �[0m59921bc3-111b-45ec-9bc1-3f39df288b96.sleep-job.1�[0m  Job          �[32m✔�[0m Successful   4s   
└──# revision:1                                                                               
   └──⧉ window-c64cf84f6                                     ReplicaSet   �[0m•�[0m ScaledDown   12s  
      └──□ window-c64cf84f6-fbqkp                            Pod          �[94m◌�[0m Terminating  12s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-05-08T17:18:58Z"
  generation: 6
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestRollbackAnalysisOutsideWindow
    rev: three
  name: window
  namespace: default
  resourceVersion: "15136"
  uid: c5ceebd1-4aff-4d80-99e7-54bc0ee7e009
spec:
  replicas: 2
  rollbackWindow:
    revisions: 2
  selector:
    matchLabels:
      app: window
  strategy:
    canary:
      steps:
      - setWeight: 50
      - analysis:
          analysisRunMetadata: {}
          args:
          - name: rev
            valueFrom:
              fieldRef:
                fieldPath: metadata.labels['rev']
          templates:
          - templateName: sleep-job
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: window
        rev: three
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: basic
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-05-08T17:19:04Z"
    lastUpdateTime: "2023-05-08T17:19:04Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-05-08T17:19:10Z"
    lastUpdateTime: "2023-05-08T17:19:10Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-05-08T17:19:10Z"
    lastUpdateTime: "2023-05-08T17:19:10Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-05-08T17:18:58Z"
    lastUpdateTime: "2023-05-08T17:19:10Z"
    message: ReplicaSet "window-5658c69dbb" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  currentPodHash: 5658c69dbb
  currentStepHash: 7dd87d6d74
  currentStepIndex: 2
  observedGeneration: "5"
  phase: Healthy
  readyReplicas: 2
  replicas: 2
  selector: app=window
  stableRS: 5658c69dbb
  updatedReplicas: 2

2023-05-08T17:18:58Z    Normal    RolloutNotCompleted      Rollout not completed, started update to revision 1 (c64cf84f6)
2023-05-08T17:18:58Z    Normal    RolloutUpdated           Rollout updated to revision 1
2023-05-08T17:18:58Z    Normal    NewReplicaSetCreated     Created ReplicaSet window-c64cf84f6 (revision 1)
2023-05-08T17:18:58Z    Normal    ScalingReplicaSet        Scaled up ReplicaSet window-c64cf84f6 (revision 1) from 0 to 2
2023-05-08T17:18:58Z    Normal    RolloutCompleted         Rollout completed update to revision 1 (c64cf84f6): Initial deploy
2023-05-08T17:19:04Z    Normal    RolloutNotCompleted      Rollout not completed, started update to revision 2 (5658c69dbb)
2023-05-08T17:19:04Z    Normal    RolloutUpdated           Rollout updated to revision 2
2023-05-08T17:19:04Z    Normal    NewReplicaSetCreated     Created ReplicaSet window-5658c69dbb (revision 2)
2023-05-08T17:19:04Z    Normal    ScalingReplicaSet        Scaled up ReplicaSet window-5658c69dbb (revision 2) from 0 to 1
2023-05-08T17:19:06Z    Normal    ScalingReplicaSet        Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 2 to 1
2023-05-08T17:19:06Z    Normal    RolloutStepCompleted     Rollout step 1/2 completed (setWeight: 50)
2023-05-08T17:19:06Z    Normal    AnalysisRunRunning       Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Running' Previous: ''
2023-05-08T17:19:09Z    Normal    AnalysisRunSuccessful    Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Successful' Previous: 'Running'
2023-05-08T17:19:09Z    Normal    RolloutStepCompleted     Rollout step 2/2 completed (analysis)
2023-05-08T17:19:09Z    Normal    ScalingReplicaSet        Scaled up ReplicaSet window-5658c69dbb (revision 2) from 1 to 2
2023-05-08T17:19:10Z    Normal    ScalingReplicaSet        Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 1 to 0
2023-05-08T17:19:10Z    Normal    RolloutCompleted         Rollout completed update to revision 2 (5658c69dbb): Completed all 2 canary steps
2023-05-08T17:19:10Z    Normal    RolloutNotCompleted      Rollout not completed, started update to revision 3 (6458bcd6fb)
2023-05-08T17:19:10Z    Normal    RolloutUpdated           Rollout updated to revision 3
2023-05-08T17:19:10Z    Normal    NewReplicaSetCreated     Created ReplicaSet window-6458bcd6fb (revision 3)

time="2023-05-08T17:19:10Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisOutsideWindow"
W0508 17:19:10.783039   17212 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0508 17:19:10.790484   17212 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestRollbackSuite/TestRollbackAnalysisOutsideWindow (12.73s)

Failed
=== RUN   TestRollbackSuite
time="2023-05-08T17:18:57Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2023-05-08T17:18:58Z" level=info msg="rollout.argoproj.io/window created\n"
--- FAIL: TestRollbackSuite (37.61s)

Failed
=== RUN   TestCanarySuite/TestCanaryScaleDownOnAbort
time="2023-05-08T17:06:01Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownOnAbort"
time="2023-05-08T17:06:01Z" level=info msg="service/canary-scaledowndelay-root created\n" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:02Z" level=info msg="service/canary-scaledowndelay-canary created\n" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:02Z" level=info msg="service/canary-scaledowndelay-stable created\n" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:02Z" level=info msg="ingress.networking.k8s.io/canary-scaledowndelay-ingress created\n" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:02Z" level=info msg="rollout.argoproj.io/canary-scaledownd-on-abort created\n" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:02Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:03Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:03Z" level=info msg="Updated rollout pod spec: 2023-05-08T17:06:03.93282437Z" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:03Z" level=info msg="Waiting for condition: status=Paused" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:04Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:04Z" level=info msg="Aborted rollout" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:04Z" level=info msg="Waiting for condition: status=Degraded" rollout=canary-scaledownd-on-abort
time="2023-05-08T17:06:04Z" level=info msg="Condition 'status=Degraded' met after 0s" rollout=canary-scaledownd-on-abort
    canary_test.go:543: Expected canary-scaledowndelay-canary selector: map[app:canary-scaledowndelay rollouts-pod-template-hash:66597877b7]. Actual: map[app:canary-scaledowndelay rollouts-pod-template-hash:6795bd46cf]
Name:            canary-scaledownd-on-abort
Namespace:       default
Status:          �[31m✖�[0m Degraded
Message:         RolloutAborted: Rollout aborted update to revision 2
Strategy:        Canary
  Step:          0/2
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       1
  Current:       2
  Updated:       1
  Ready:         2
  Available:     2

NAME                                                    KIND        STATUS         AGE  INFO
⟳ canary-scaledownd-on-abort                            Rollout     �[31m✖�[0m Degraded     3s   
├──# revision:2                                                                         
│  └──⧉ �[33mcanary-scaledownd-on-abort-6795bd46cf�[0m           ReplicaSet  �[0m•�[0m ScaledDown   2s   �[33mcanary�[0m,delay:passed
│     └──□ canary-scaledownd-on-abort-6795bd46cf-jttld  Pod         �[94m◌�[0m Terminating  1s   ready:1/1
└──# revision:1                                                                         
   └──⧉ �[32mcanary-scaledownd-on-abort-66597877b7�[0m           ReplicaSet  �[32m✔�[0m Healthy      3s   �[32mstable�[0m
      └──□ canary-scaledownd-on-abort-66597877b7-xnthv  Pod         �[32m✔�[0m Running      2s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-05-08T17:06:02Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryScaleDownOnAbort
  name: canary-scaledownd-on-abort
  namespace: default
  resourceVersion: "6086"
  uid: a70723a2-4b9f-4f06-a29c-6c71ab718852
spec:
  replicas: 1
  selector:
    matchLabels:
      app: canary-scaledowndelay
  strategy:
    canary:
      abortScaleDownDelaySeconds: 1
      canaryService: canary-scaledowndelay-canary
      scaleDownDelayRevisionLimit: 1
      stableService: canary-scaledowndelay-stable
      steps:
      - setCanaryScale:
          replicas: 1
      - pause: {}
      trafficRouting:
        alb:
          ingress: canary-scaledowndelay-ingress
          rootService: canary-scaledowndelay-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-05-08T17:06:03.93282437Z"
      creationTimestamp: null
      labels:
        app: canary-scaledowndelay
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: canary-scaledowndelay
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 2
  abort: true
  abortedAt: "2023-05-08T17:06:04Z"
  availableReplicas: 2
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 6795bd46cf
        serviceName: canary-scaledowndelay-canary
        weight: 0
      stable:
        podTemplateHash: 66597877b7
        serviceName: canary-scaledowndelay-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-05-08T17:06:03Z"
    lastUpdateTime: "2023-05-08T17:06:03Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-05-08T17:06:03Z"
    lastUpdateTime: "2023-05-08T17:06:03Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-05-08T17:06:03Z"
    lastUpdateTime: "2023-05-08T17:06:03Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-05-08T17:06:04Z"
    lastUpdateTime: "2023-05-08T17:06:04Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  - lastTransitionTime: "2023-05-08T17:06:04Z"
    lastUpdateTime: "2023-05-08T17:06:04Z"
    message: Rollout aborted update to revision 2
    reason: RolloutAborted
    status: "False"
    type: Progressing
  currentPodHash: 6795bd46cf
  currentStepHash: 5db8f9b897
  currentStepIndex: 0
  message: 'RolloutAborted: Rollout aborted update to revision 2'
  observedGeneration: "3"
  phase: Degraded
  readyReplicas: 2
  replicas: 2
  selector: app=canary-scaledowndelay
  stableRS: 66597877b7
  updatedReplicas: 1

2023-05-08T17:06:02Z         Normal     RolloutNotCompleted     Rollout not completed, started update to revision 1 (66597877b7)
2023-05-08T17:06:02Z         Normal     RolloutUpdated          Rollout updated to revision 1
2023-05-08T17:06:02Z         Normal     NewReplicaSetCreated    Created ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1)
2023-05-08T17:06:02Z         Normal     PatchingALBIngress      Updating Ingress `canary-scaledowndelay-ingress` to desiredWeight '0'
2023-05-08T17:06:03Z (x2)    Normal     TrafficWeightUpdated    Traffic weight updated to 0
2023-05-08T17:06:03Z         Normal     ScalingReplicaSet       Scaled up ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1) from 0 to 1
2023-05-08T17:06:03Z         Normal     RolloutCompleted        Rollout completed update to revision 1 (66597877b7): Initial deploy
2023-05-08T17:06:03Z         Normal     SwitchService           Switched selector for service 'canary-scaledowndelay-stable' from '' to '66597877b7'
2023-05-08T17:06:03Z         Normal     SwitchService           Switched selector for service 'canary-scaledowndelay-canary' from '' to '66597877b7'
2023-05-08T17:06:03Z         Normal     RolloutNotCompleted     Rollout not completed, started update to revision 2 (6795bd46cf)
2023-05-08T17:06:04Z         Normal     RolloutUpdated          Rollout updated to revision 2
2023-05-08T17:06:04Z         Normal     NewReplicaSetCreated    Created ReplicaSet canary-scaledownd-on-abort-6795bd46cf (revision 2)
2023-05-08T17:06:04Z (x3)    Normal     TrafficWeightUpdated    Traffic weight updated 
2023-05-08T17:06:04Z         Normal     ScalingReplicaSet       Scaled up ReplicaSet canary-scaledownd-on-abort-6795bd46cf (revision 2) from 0 to 1
2023-05-08T17:06:04Z         Normal     RolloutStepCompleted    Rollout step 1/2 completed (setCanaryScale{replicas: 1})
2023-05-08T17:06:04Z         Normal     RolloutPaused           Rollout is paused (CanaryPauseStep)
2023-05-08T17:06:04Z         Warning    RolloutAborted          Rollout aborted update to revision 2
2023-05-08T17:06:04Z (x2)    Normal     SwitchService           Switched selector for service 'canary-scaledowndelay-canary' from '66597877b7' to '6795bd46cf'
2023-05-08T17:06:05Z (x2)    Normal     SwitchService           Switched selector for service 'canary-scaledowndelay-canary' from '6795bd46cf' to '66597877b7'
2023-05-08T17:06:05Z         Normal     ScalingReplicaSet       Scaled down ReplicaSet canary-scaledownd-on-abort-6795bd46cf (revision 2) from 1 to 0

time="2023-05-08T17:06:05Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownOnAbort"
    --- FAIL: TestCanarySuite/TestCanaryScaleDownOnAbort (4.03s)

Failed
=== RUN   TestCanarySuite
time="2023-05-08T17:03:27Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (234.97s)