Skip to content
GitHub Actions / E2E Tests Published Test Results succeeded Mar 30, 2023 in 0s

11 fail, 5 skipped, 80 pass in 3h 32m 10s

    4 files      4 suites   3h 32m 10s ⏱️
  96 tests   80 ✔️   5 💤 11
410 runs  366 ✔️ 20 💤 24

Results for commit 27a1827.

Annotations

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 6 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2023-03-30T01:08:20Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
time="2023-03-30T01:08:20Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2023-03-30T01:08:20Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2023-03-30T01:08:21Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2023-03-30T01:08:21Z" level=info msg="ingress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2023-03-30T01:08:21Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2023-03-30T01:08:21Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2023-03-30T01:08:22Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2023-03-30T01:08:22Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2023-03-30T01:08:22Z" level=info msg="Updated rollout pod spec: 2023-03-30T01:08:22.918023453Z" rollout=alb-rollout
time="2023-03-30T01:08:22Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/assert@v0.0.3/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:166
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:156
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeight
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                  KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                         Rollout     �[94m◌�[0m Progressing  12s  
├──# revision:2                                                                                       
│  ├──⧉ �[33malb-rollout-5876679d55�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   11s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-5876679d55-2-0�[0m                                    Experiment  �[94m◌�[0m Running      11s  
│     ├──⧉ alb-rollout-5876679d55-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      11s  
│     │  └──□ alb-rollout-5876679d55-2-0-experiment-alb-canary-9x7tb  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-5876679d55-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      11s  
│        └──□ alb-rollout-5876679d55-2-0-experiment-alb-stable-h9hnv  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                       
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                         ReplicaSet  �[32m✔�[0m Healthy      12s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-vkdcm                                Pod         �[32m✔�[0m Running      12s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-03-30T01:08:21Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeight
  name: alb-rollout
  namespace: default
  resourceVersion: "3663"
  uid: a714846c-e452-472b-9954-0b9a77693ecb
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingress: alb-rollout-ingress
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-03-30T01:08:22.918023453Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-5876679d55-2-0
    weights:
      additional:
      - weight: 20
      - weight: 20
      canary:
        podTemplateHash: 5876679d55
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2023-03-30T01:08:22Z"
    lastUpdateTime: "2023-03-30T01:08:22Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-03-30T01:08:22Z"
    lastUpdateTime: "2023-03-30T01:08:22Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-03-30T01:08:22Z"
    lastUpdateTime: "2023-03-30T01:08:22Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-03-30T01:08:21Z"
    lastUpdateTime: "2023-03-30T01:08:22Z"
    message: Created new replica set "alb-rollout-5876679d55"
    reason: NewReplicaSetCreated
    status: "True"
    type: Progressing
  currentPodHash: 5876679d55
  currentStepHash: 558cc8bf4d
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "3"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2023-03-30T01:08:21Z         Normal    RolloutNotCompleted     Rollout not completed, started update to revision 1 (d6f4fdcdc)
2023-03-30T01:08:21Z         Normal    RolloutUpdated          Rollout updated to revision 1
2023-03-30T01:08:21Z         Normal    NewReplicaSetCreated    Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2023-03-30T01:08:21Z (x2)    Normal    TrafficWeightUpdated    Traffic weight updated to 0
2023-03-30T01:08:21Z         Normal    ScalingReplicaSet       Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2023-03-30T01:08:21Z         Normal    RolloutCompleted        Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2023-03-30T01:08:22Z         Normal    SwitchService           Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2023-03-30T01:08:22Z         Normal    SwitchService           Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2023-03-30T01:08:22Z         Normal    RolloutNotCompleted     Rollout not completed, started update to revision 2 (5876679d55)
2023-03-30T01:08:22Z         Normal    RolloutUpdated          Rollout updated to revision 2
2023-03-30T01:08:22Z         Normal    NewReplicaSetCreated    Created ReplicaSet alb-rollout-5876679d55 (revision 2)
2023-03-30T01:08:22Z (x2)    Normal    TrafficWeightUpdated    Traffic weight updated 
2023-03-30T01:08:22Z         Normal    ExperimentCreated       Created Experiment 'alb-rollout-5876679d55-2-0'
2023-03-30T01:08:24Z (x2)    Normal    PatchingALBIngress      Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2023-03-30T01:08:24Z         Normal    TrafficWeightUpdated    Traffic weight updated additional: [{20  } {20  }]

time="2023-03-30T01:08:33Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (13.44s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 6 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
Raw output
Failed
=== RUN   TestAWSSuite
--- FAIL: TestAWSSuite (50.28s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

4 out of 8 runs failed: TestCanarySuite/TestCanaryDynamicStableScale (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
Raw output
Failed
=== RUN   TestCanarySuite/TestCanaryDynamicStableScale
time="2023-03-30T01:11:15Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
time="2023-03-30T01:11:15Z" level=info msg="service/dynamic-stable-scale-root created\n" rollout=dynamic-stable-scale
time="2023-03-30T01:11:16Z" level=info msg="service/dynamic-stable-scale-canary created\n" rollout=dynamic-stable-scale
time="2023-03-30T01:11:16Z" level=info msg="service/dynamic-stable-scale-stable created\n" rollout=dynamic-stable-scale
time="2023-03-30T01:11:16Z" level=info msg="ingress.networking.k8s.io/dynamic-stable-scale-ingress created\n" rollout=dynamic-stable-scale
time="2023-03-30T01:11:16Z" level=info msg="rollout.argoproj.io/dynamic-stable-scale created\n" rollout=dynamic-stable-scale
time="2023-03-30T01:11:18Z" level=info msg="Marked 4 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-03-30T01:11:18Z" level=info msg="Waiting for condition: status=Healthy" rollout=dynamic-stable-scale
time="2023-03-30T01:11:21Z" level=info msg="Condition 'status=Healthy' met after 3s" rollout=dynamic-stable-scale
time="2023-03-30T01:11:21Z" level=info msg="Updated rollout pod spec: 2023-03-30T01:11:21.692069838Z" rollout=dynamic-stable-scale
time="2023-03-30T01:11:22Z" level=info msg="Marked 1 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-03-30T01:11:22Z" level=info msg="Waiting for condition: status=Paused" rollout=dynamic-stable-scale
time="2023-03-30T01:11:23Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=dynamic-stable-scale
time="2023-03-30T01:11:23Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-03-30T01:11:25Z" level=info msg="Pod expectation 'revision:1 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-03-30T01:11:25Z" level=info msg="Pod expectation 'revision:2 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-03-30T01:11:25Z" level=info msg="Promoted rollout" rollout=dynamic-stable-scale
time="2023-03-30T01:11:26Z" level=info msg="Marked 2 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-03-30T01:11:26Z" level=info msg="Waiting for condition: status.currentStepIndex=3" rollout=dynamic-stable-scale
time="2023-03-30T01:11:28Z" level=info msg="Condition 'status.currentStepIndex=3' met after 1s" rollout=dynamic-stable-scale
time="2023-03-30T01:11:28Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-03-30T01:11:30Z" level=info msg="Pod expectation 'revision:1 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-03-30T01:11:30Z" level=info msg="Pod expectation 'revision:2 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-03-30T01:11:30Z" level=info msg="Aborted rollout" rollout=dynamic-stable-scale
time="2023-03-30T01:11:31Z" level=info msg="Marked 2 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-03-30T01:11:31Z" level=info msg="Waiting for condition: rev=2 podcount=1" rollout=dynamic-stable-scale
time="2023-03-30T01:11:33Z" level=info msg="Condition 'rev=2 podcount=1' met after 2s" rollout=dynamic-stable-scale
time="2023-03-30T01:11:33Z" level=info msg="Pod expectation 'revision:1 pod count == 4' met" rollout=dynamic-stable-scale
time="2023-03-30T01:11:34Z" level=info msg="Marked 1 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-03-30T01:11:34Z" level=info msg="Waiting for condition: rev=2 podcount=0" rollout=dynamic-stable-scale
time="2023-03-30T01:11:35Z" level=info msg="Condition 'rev=2 podcount=0' met after 0s" rollout=dynamic-stable-scale
    canary_test.go:603: Expected dynamic-stable-scale-canary selector: map[app:dynamic-stable-scale rollouts-pod-template-hash:868d98995b]. Actual: map[app:dynamic-stable-scale rollouts-pod-template-hash:fc8df5757]
Name:            dynamic-stable-scale
Namespace:       default
Status:          �[31m✖�[0m Degraded
Message:         RolloutAborted: Rollout aborted update to revision 2
Strategy:        Canary
  Step:          0/4
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       4
  Updated:       0
  Ready:         4
  Available:     4

NAME                                              KIND        STATUS         AGE  INFO
⟳ dynamic-stable-scale                            Rollout     �[31m✖�[0m Degraded     19s  
├──# revision:2                                                                   
│  └──⧉ �[33mdynamic-stable-scale-fc8df5757�[0m            ReplicaSet  �[0m•�[0m ScaledDown   14s  �[33mcanary�[0m
│     └──□ dynamic-stable-scale-fc8df5757-kbmpj   Pod         �[94m◌�[0m Terminating  14s  ready:1/1
└──# revision:1                                                                   
   └──⧉ �[32mdynamic-stable-scale-868d98995b�[0m           ReplicaSet  �[32m✔�[0m Healthy      19s  �[32mstable�[0m
      ├──□ dynamic-stable-scale-868d98995b-xz7kz  Pod         �[32m✔�[0m Running      18s  ready:1/1
      ├──□ dynamic-stable-scale-868d98995b-mgtck  Pod         �[32m✔�[0m Running      5s   ready:1/1
      ├──□ dynamic-stable-scale-868d98995b-qqqd2  Pod         �[32m✔�[0m Running      5s   ready:1/1
      └──□ dynamic-stable-scale-868d98995b-vz9nk  Pod         �[32m✔�[0m Running      5s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-03-30T01:11:16Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryDynamicStableScale
  name: dynamic-stable-scale
  namespace: default
  resourceVersion: "5248"
  uid: 3974fb0e-f10e-43c7-a220-73a58eff1a26
spec:
  replicas: 4
  selector:
    matchLabels:
      app: dynamic-stable-scale
  strategy:
    canary:
      canaryService: dynamic-stable-scale-canary
      dynamicStableScale: true
      stableService: dynamic-stable-scale-stable
      steps:
      - setWeight: 25
      - pause: {}
      - setWeight: 75
      - pause: {}
      trafficRouting:
        alb:
          ingress: dynamic-stable-scale-ingress
          rootService: dynamic-stable-scale-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-03-30T01:11:21.692069838Z"
      creationTimestamp: null
      labels:
        app: dynamic-stable-scale
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: dynamic-stable-scale
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
      readinessGates:
      - conditionType: argoproj.io/e2e-readiness
status:
  HPAReplicas: 5
  abort: true
  abortedAt: "2023-03-30T01:11:30Z"
  availableReplicas: 5
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: fc8df5757
        serviceName: dynamic-stable-scale-canary
        weight: 0
      stable:
        podTemplateHash: 868d98995b
        serviceName: dynamic-stable-scale-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-03-30T01:11:21Z"
    lastUpdateTime: "2023-03-30T01:11:21Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-03-30T01:11:21Z"
    lastUpdateTime: "2023-03-30T01:11:21Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-03-30T01:11:21Z"
    lastUpdateTime: "2023-03-30T01:11:21Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-03-30T01:11:28Z"
    lastUpdateTime: "2023-03-30T01:11:28Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  - lastTransitionTime: "2023-03-30T01:11:30Z"
    lastUpdateTime: "2023-03-30T01:11:30Z"
    message: Rollout aborted update to revision 2
    reason: RolloutAborted
    status: "False"
    type: Progressing
  currentPodHash: fc8df5757
  currentStepHash: 7c5b668566
  currentStepIndex: 0
  message: 'RolloutAborted: Rollout aborted update to revision 2'
  observedGeneration: "2"
  phase: Degraded
  readyReplicas: 5
  replicas: 5
  selector: app=dynamic-stable-scale
  stableRS: 868d98995b
  updatedReplicas: 1

2023-03-30T01:11:16Z         Normal    RolloutNotCompleted     Rollout not completed, started update to revision 1 (868d98995b)
2023-03-30T01:11:17Z         Normal    RolloutUpdated          Rollout updated to revision 1
2023-03-30T01:11:17Z         Normal    NewReplicaSetCreated    Created ReplicaSet dynamic-stable-scale-868d98995b (revision 1)
2023-03-30T01:11:17Z         Normal    PatchingALBIngress      Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '0'
2023-03-30T01:11:17Z (x2)    Normal    TrafficWeightUpdated    Traffic weight updated to 0
2023-03-30T01:11:17Z         Normal    ScalingReplicaSet       Scaled up ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 0 to 4
2023-03-30T01:11:17Z         Normal    RolloutCompleted        Rollout completed update to revision 1 (868d98995b): Initial deploy
2023-03-30T01:11:21Z         Normal    SwitchService           Switched selector for service 'dynamic-stable-scale-stable' from '' to '868d98995b'
2023-03-30T01:11:21Z         Normal    SwitchService           Switched selector for service 'dynamic-stable-scale-canary' from '' to '868d98995b'
2023-03-30T01:11:21Z         Normal    RolloutNotCompleted     Rollout not completed, started update to revision 2 (fc8df5757)
2023-03-30T01:11:21Z         Normal    RolloutUpdated          Rollout updated to revision 2
2023-03-30T01:11:21Z         Normal    NewReplicaSetCreated    Created ReplicaSet dynamic-stable-scale-fc8df5757 (revision 2)
2023-03-30T01:11:21Z (x3)    Normal    TrafficWeightUpdated    Traffic weight updated 
2023-03-30T01:11:21Z         Normal    ScalingReplicaSet       Scaled up ReplicaSet dynamic-stable-scale-fc8df5757 (revision 2) from 0 to 1
2023-03-30T01:11:23Z         Normal    SwitchService           Switched selector for service 'dynamic-stable-scale-canary' from '868d98995b' to 'fc8df5757'
2023-03-30T01:11:23Z         Normal    PatchingALBIngress      Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '25'
2023-03-30T01:11:23Z         Normal    TrafficWeightUpdated    Traffic weight updated from 0 to 25
2023-03-30T01:11:23Z         Normal    RolloutStepCompleted    Rollout step 1/4 completed (setWeight: 25)
2023-03-30T01:11:23Z         Normal    ScalingReplicaSet       Scaled down ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 4 to 3
2023-03-30T01:11:23Z         Normal    RolloutPaused           Rollout is paused (CanaryPauseStep)
2023-03-30T01:11:25Z         Normal    RolloutStepCompleted    Rollout step 2/4 completed (pause)
2023-03-30T01:11:25Z         Normal    ScalingReplicaSet       Scaled up ReplicaSet dynamic-stable-scale-fc8df5757 (revision 2) from 1 to 3

time="2023-03-30T01:11:35Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
    --- FAIL: TestCanarySuite/TestCanaryDynamicStableScale (20.67s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 6 runs failed: TestCanarySuite/TestCanaryScaleDownOnAbort (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
Raw output
Failed
=== RUN   TestCanarySuite/TestCanaryScaleDownOnAbort
time="2023-03-30T01:13:49Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownOnAbort"
time="2023-03-30T01:13:49Z" level=info msg="service/canary-scaledowndelay-root created\n" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:50Z" level=info msg="service/canary-scaledowndelay-canary created\n" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:50Z" level=info msg="service/canary-scaledowndelay-stable created\n" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:50Z" level=info msg="ingress.networking.k8s.io/canary-scaledowndelay-ingress created\n" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:50Z" level=info msg="rollout.argoproj.io/canary-scaledownd-on-abort created\n" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:50Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:52Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:52Z" level=info msg="Updated rollout pod spec: 2023-03-30T01:13:52.165606263Z" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:52Z" level=info msg="Waiting for condition: status=Paused" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:53Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:53Z" level=info msg="Aborted rollout" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:53Z" level=info msg="Waiting for condition: status=Degraded" rollout=canary-scaledownd-on-abort
time="2023-03-30T01:13:53Z" level=info msg="Condition 'status=Degraded' met after 0s" rollout=canary-scaledownd-on-abort
    canary_test.go:543: Expected canary-scaledowndelay-canary selector: map[app:canary-scaledowndelay rollouts-pod-template-hash:66597877b7]. Actual: map[app:canary-scaledowndelay rollouts-pod-template-hash:559b6fbbd8]
Name:            canary-scaledownd-on-abort
Namespace:       default
Status:          �[31m✖�[0m Degraded
Message:         RolloutAborted: Rollout aborted update to revision 2
Strategy:        Canary
  Step:          0/2
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
  Desired:       1
  Current:       2
  Updated:       1
  Ready:         2
  Available:     2

NAME                                                    KIND        STATUS      AGE  INFO
⟳ canary-scaledownd-on-abort                            Rollout     �[31m✖�[0m Degraded  3s   
├──# revision:2                                                                      
│  └──⧉ �[33mcanary-scaledownd-on-abort-559b6fbbd8�[0m           ReplicaSet  �[32m✔�[0m Healthy   1s   �[33mcanary�[0m,delay:0s
│     └──□ canary-scaledownd-on-abort-559b6fbbd8-hn7wp  Pod         �[32m✔�[0m Running   1s   ready:1/1
└──# revision:1                                                                      
   └──⧉ �[32mcanary-scaledownd-on-abort-66597877b7�[0m           ReplicaSet  �[32m✔�[0m Healthy   3s   �[32mstable�[0m
      └──□ canary-scaledownd-on-abort-66597877b7-cwcgt  Pod         �[32m✔�[0m Running   3s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-03-30T01:13:50Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryScaleDownOnAbort
  name: canary-scaledownd-on-abort
  namespace: default
  resourceVersion: "5918"
  uid: 51dc3813-15e2-4d18-b141-103242311542
spec:
  replicas: 1
  selector:
    matchLabels:
      app: canary-scaledowndelay
  strategy:
    canary:
      abortScaleDownDelaySeconds: 1
      canaryService: canary-scaledowndelay-canary
      scaleDownDelayRevisionLimit: 1
      stableService: canary-scaledowndelay-stable
      steps:
      - setCanaryScale:
          replicas: 1
      - pause: {}
      trafficRouting:
        alb:
          ingress: canary-scaledowndelay-ingress
          rootService: canary-scaledowndelay-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-03-30T01:13:52.165606263Z"
      creationTimestamp: null
      labels:
        app: canary-scaledowndelay
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: canary-scaledowndelay
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 2
  abort: true
  abortedAt: "2023-03-30T01:13:53Z"
  availableReplicas: 2
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 559b6fbbd8
        serviceName: canary-scaledowndelay-canary
        weight: 0
      stable:
        podTemplateHash: 66597877b7
        serviceName: canary-scaledowndelay-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-03-30T01:13:52Z"
    lastUpdateTime: "2023-03-30T01:13:52Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-03-30T01:13:52Z"
    lastUpdateTime: "2023-03-30T01:13:52Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-03-30T01:13:52Z"
    lastUpdateTime: "2023-03-30T01:13:52Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-03-30T01:13:53Z"
    lastUpdateTime: "2023-03-30T01:13:53Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  - lastTransitionTime: "2023-03-30T01:13:53Z"
    lastUpdateTime: "2023-03-30T01:13:53Z"
    message: Rollout aborted update to revision 2
    reason: RolloutAborted
    status: "False"
    type: Progressing
  currentPodHash: 559b6fbbd8
  currentStepHash: 5db8f9b897
  currentStepIndex: 0
  message: 'RolloutAborted: Rollout aborted update to revision 2'
  observedGeneration: "3"
  phase: Degraded
  readyReplicas: 2
  replicas: 2
  selector: app=canary-scaledowndelay
  stableRS: 66597877b7
  updatedReplicas: 1

2023-03-30T01:13:50Z         Normal     RolloutNotCompleted     Rollout not completed, started update to revision 1 (66597877b7)
2023-03-30T01:13:50Z         Normal     RolloutUpdated          Rollout updated to revision 1
2023-03-30T01:13:50Z         Normal     NewReplicaSetCreated    Created ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1)
2023-03-30T01:13:50Z         Normal     PatchingALBIngress      Updating Ingress `canary-scaledowndelay-ingress` to desiredWeight '0'
2023-03-30T01:13:50Z (x2)    Normal     TrafficWeightUpdated    Traffic weight updated to 0
2023-03-30T01:13:50Z         Normal     ScalingReplicaSet       Scaled up ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1) from 0 to 1
2023-03-30T01:13:50Z         Normal     RolloutCompleted        Rollout completed update to revision 1 (66597877b7): Initial deploy
2023-03-30T01:13:52Z         Normal     SwitchService           Switched selector for service 'canary-scaledowndelay-stable' from '' to '66597877b7'
2023-03-30T01:13:52Z         Normal     SwitchService           Switched selector for service 'canary-scaledowndelay-canary' from '' to '66597877b7'
2023-03-30T01:13:52Z         Normal     RolloutNotCompleted     Rollout not completed, started update to revision 2 (559b6fbbd8)
2023-03-30T01:13:52Z         Normal     RolloutUpdated          Rollout updated to revision 2
2023-03-30T01:13:52Z         Normal     NewReplicaSetCreated    Created ReplicaSet canary-scaledownd-on-abort-559b6fbbd8 (revision 2)
2023-03-30T01:13:52Z (x3)    Normal     TrafficWeightUpdated    Traffic weight updated 
2023-03-30T01:13:52Z         Normal     ScalingReplicaSet       Scaled up ReplicaSet canary-scaledownd-on-abort-559b6fbbd8 (revision 2) from 0 to 1
2023-03-30T01:13:53Z         Normal     RolloutStepCompleted    Rollout step 1/2 completed (setCanaryScale{replicas: 1})
2023-03-30T01:13:53Z         Normal     RolloutPaused           Rollout is paused (CanaryPauseStep)
2023-03-30T01:13:53Z         Warning    RolloutAborted          Rollout aborted update to revision 2
2023-03-30T01:13:53Z (x2)    Normal     SwitchService           Switched selector for service 'canary-scaledowndelay-canary' from '559b6fbbd8' to '66597877b7'
2023-03-30T01:13:53Z (x3)    Normal     SwitchService           Switched selector for service 'canary-scaledowndelay-canary' from '66597877b7' to '559b6fbbd8'

time="2023-03-30T01:13:53Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownOnAbort"
    --- FAIL: TestCanarySuite/TestCanaryScaleDownOnAbort (4.16s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 6 runs failed: TestCanarySuite/TestCanarySetCanaryScale (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
Raw output
Failed
=== RUN   TestCanarySuite/TestCanarySetCanaryScale
time="2023-03-30T01:13:53Z" level=info msg="Deleting e2e-test-name=TestCanarySetCanaryScale"
=== PAUSE TestCanarySuite/TestCanarySetCanaryScale
=== CONT  TestCanarySuite/TestCanarySetCanaryScale
time="2023-03-30T01:15:12Z" level=info msg="service/set-canary-scale-canary created\n" rollout=set-canary-scale
time="2023-03-30T01:15:12Z" level=info msg="service/set-canary-scale-stable created\n" rollout=set-canary-scale
time="2023-03-30T01:15:13Z" level=info msg="ingress.networking.k8s.io/set-canary-scale-ingress created\n" rollout=set-canary-scale
time="2023-03-30T01:15:13Z" level=info msg="rollout.argoproj.io/set-canary-scale created\n" rollout=set-canary-scale
time="2023-03-30T01:15:13Z" level=info msg="Waiting for condition: status=Healthy" rollout=set-canary-scale
time="2023-03-30T01:15:22Z" level=info msg="Condition 'status=Healthy' met after 8s" rollout=set-canary-scale
time="2023-03-30T01:15:22Z" level=info msg="Updated rollout pod spec: 2023-03-30T01:15:22.661046756Z" rollout=set-canary-scale
time="2023-03-30T01:15:22Z" level=info msg="Waiting for condition: status=Paused" rollout=set-canary-scale
    when.go:440: timeout after 2m0s waiting for condition status=Paused
Name:            set-canary-scale
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout spec update to be observed
Strategy:        Canary
  Step:          9/9
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       4
  Updated:       4
  Ready:         4
  Available:     4

NAME                                          KIND        STATUS         AGE   INFO
⟳ set-canary-scale                            Rollout     �[94m◌�[0m Progressing  2m9s  
└──# revision:1                                                                
   └──⧉ �[32mset-canary-scale-5d7d466b9c�[0m           ReplicaSet  �[32m✔�[0m Healthy      2m8s  �[32mstable�[0m
      ├──□ set-canary-scale-5d7d466b9c-84qmd  Pod         �[32m✔�[0m Running      2m8s  ready:1/1
      ├──□ set-canary-scale-5d7d466b9c-8nbpt  Pod         �[32m✔�[0m Running      2m8s  ready:1/1
      ├──□ set-canary-scale-5d7d466b9c-gjkln  Pod         �[32m✔�[0m Running      2m8s  ready:1/1
      └──□ set-canary-scale-5d7d466b9c-mj7zd  Pod         �[32m✔�[0m Running      2m8s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "1"
  creationTimestamp: "2023-03-30T01:15:13Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanarySetCanaryScale
  name: set-canary-scale
  namespace: default
  resourceVersion: "7706"
  uid: 56c2bbd3-8052-4e0e-b55c-9e432c9dc06d
spec:
  replicas: 4
  selector:
    matchLabels:
      app: set-canary-scale
  strategy:
    canary:
      canaryService: set-canary-scale-canary
      stableService: set-canary-scale-stable
      steps:
      - pause: {}
      - setCanaryScale:
          weight: 25
      - pause:
          duration: 100s
      - setWeight: 50
      - pause:
          duration: 10s
      - setCanaryScale:
          replicas: 3
      - pause: {}
      - setCanaryScale:
          matchTrafficWeight: true
      - pause:
          duration: 5s
      trafficRouting:
        nginx:
          stableIngress: set-canary-scale-ingress
  template:
    metadata:
      annotations:
        update: "2023-03-30T01:15:22.661046756Z"
      creationTimestamp: null
      labels:
        app: set-canary-scale
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: set-canary-scale
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 4
  availableReplicas: 4
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 5d7d466b9c
        serviceName: set-canary-scale-canary
        weight: 0
      stable:
        podTemplateHash: 5d7d466b9c
        serviceName: set-canary-scale-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-03-30T01:15:14Z"
    lastUpdateTime: "2023-03-30T01:15:14Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-03-30T01:15:22Z"
    lastUpdateTime: "2023-03-30T01:15:22Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-03-30T01:15:13Z"
    lastUpdateTime: "2023-03-30T01:15:22Z"
    message: ReplicaSet "set-canary-scale-5d7d466b9c" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  - lastTransitionTime: "2023-03-30T01:15:22Z"
    lastUpdateTime: "2023-03-30T01:15:22Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  currentPodHash: 5d7d466b9c
  currentStepHash: 574c54b58c
  currentStepIndex: 9
  observedGeneration: "1"
  phase: Healthy
  readyReplicas: 4
  replicas: 4
  selector: app=set-canary-scale
  stableRS: 5d7d466b9c
  updatedReplicas: 4

2023-03-30T01:15:13Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 1 (5d7d466b9c)
2023-03-30T01:15:14Z         Normal    RolloutUpdated           Rollout updated to revision 1
2023-03-30T01:15:14Z         Normal    NewReplicaSetCreated     Created ReplicaSet set-canary-scale-5d7d466b9c (revision 1)
2023-03-30T01:15:14Z         Normal    CreatingCanaryIngress    Creating canary ingress `set-canary-scale-set-canary-scale-ingress-canary` with weight `0`
2023-03-30T01:15:14Z (x2)    Normal    TrafficWeightUpdated     Traffic weight updated to 0
2023-03-30T01:15:14Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet set-canary-scale-5d7d466b9c (revision 1) from 0 to 4
2023-03-30T01:15:14Z         Normal    RolloutCompleted         Rollout completed update to revision 1 (5d7d466b9c): Initial deploy
2023-03-30T01:15:14Z         Normal    TrafficWeightUpdated     Traffic weight updated 
2023-03-30T01:15:22Z         Normal    SwitchService            Switched selector for service 'set-canary-scale-stable' from '' to '5d7d466b9c'
2023-03-30T01:15:22Z         Normal    SwitchService            Switched selector for service 'set-canary-scale-canary' from '' to '5d7d466b9c'

time="2023-03-30T01:17:22Z" level=info msg="Deleting e2e-test-name=TestCanarySetCanaryScale"
    --- FAIL: TestCanarySuite/TestCanarySetCanaryScale (131.26s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

6 out of 12 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
Raw output
Failed
=== RUN   TestCanarySuite
time="2023-03-30T01:11:15Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (236.85s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestRollbackSuite/TestRollbackAnalysisWithinWindow (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml
Raw output
Failed
=== RUN   TestRollbackSuite/TestRollbackAnalysisWithinWindow
time="2023-03-30T01:28:19Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisWithinWindow"
time="2023-03-30T01:28:19Z" level=info msg="rollout.argoproj.io/window created\n" rollout=window
time="2023-03-30T01:28:19Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:28:21Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=window
time="2023-03-30T01:28:21Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-03-30T01:28:21Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:28:29Z" level=info msg="Condition 'status=Healthy' met after 7s" rollout=window
time="2023-03-30T01:28:29Z" level=info msg="AnalysisRun expectation 'analysisrun count == 1' met" rollout=window
time="2023-03-30T01:28:29Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"three\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"three\"}}}}}" rollout=window
time="2023-03-30T01:28:29Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:28:35Z" level=info msg="Condition 'status=Healthy' met after 5s" rollout=window
time="2023-03-30T01:28:35Z" level=info msg="AnalysisRun expectation 'analysisrun count == 2' met" rollout=window
time="2023-03-30T01:28:35Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"four\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"four\"}}}}}" rollout=window
time="2023-03-30T01:28:35Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:28:35Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=window
time="2023-03-30T01:28:35Z" level=error msg="AnalysisRun expectation 'analysisrun count == 3' failed" rollout=window
Name:            window
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/2
  SetWeight:     50
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       2
  Current:       2
  Updated:       0
  Ready:         2
  Available:     2

NAME                                                         KIND         STATUS         AGE  INFO
⟳ window                                                     Rollout      �[94m◌�[0m Progressing  16s  
├──# revision:4                                                                               
│  └──⧉ �[33mwindow-cd5644b76�[0m                                     ReplicaSet   �[94m◌�[0m Progressing  0s   �[33mcanary�[0m
│     └──□ window-cd5644b76-967ml                            Pod          �[94m◌�[0m Pending      0s   ready:0/1
├──# revision:3                                                                               
│  ├──⧉ �[32mwindow-6458bcd6fb�[0m                                    ReplicaSet   �[32m✔�[0m Healthy      6s   �[32mstable�[0m
│  │  ├──□ window-6458bcd6fb-vt4f5                           Pod          �[32m✔�[0m Running      6s   ready:1/1
│  │  └──□ window-6458bcd6fb-hbhrw                           Pod          �[32m✔�[0m Running      1s   ready:1/1
│  └──α �[0mwindow-6458bcd6fb-3-1�[0m                                AnalysisRun  �[32m✔�[0m Successful   5s   �[32m✔�[0m 1
│     └──⊞ �[0mf64ee25b-8b61-43b3-86b8-da38e3c1cdca.sleep-job.1�[0m  Job          �[32m✔�[0m Successful   5s   
├──# revision:2                                                                               
│  ├──⧉ window-5658c69dbb                                    ReplicaSet   �[0m•�[0m ScaledDown   14s  
│  │  └──□ window-5658c69dbb-9fc4b                           Pod          �[94m◌�[0m Terminating  14s  ready:1/1
│  └──α �[0mwindow-5658c69dbb-2-1�[0m                                AnalysisRun  �[32m✔�[0m Successful   12s  �[32m✔�[0m 1
│     └──⊞ �[0m5742c32f-f03b-4385-8e65-1a28b245c836.sleep-job.1�[0m  Job          �[32m✔�[0m Successful   12s  
└──# revision:1                                                                               
   └──⧉ window-c64cf84f6                                     ReplicaSet   �[0m•�[0m ScaledDown   16s  

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "3"
  creationTimestamp: "2023-03-30T01:28:19Z"
  generation: 4
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestRollbackAnalysisWithinWindow
    rev: four
  name: window
  namespace: default
  resourceVersion: "15203"
  uid: 401aa7e7-21ba-4ffb-925e-fb0a5413f351
spec:
  replicas: 2
  rollbackWindow:
    revisions: 2
  selector:
    matchLabels:
      app: window
  strategy:
    canary:
      steps:
      - setWeight: 50
      - analysis:
          args:
          - name: rev
            valueFrom:
              fieldRef:
                fieldPath: metadata.labels['rev']
          templates:
          - templateName: sleep-job
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: window
        rev: four
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: basic
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-03-30T01:28:21Z"
    lastUpdateTime: "2023-03-30T01:28:21Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-03-30T01:28:35Z"
    lastUpdateTime: "2023-03-30T01:28:35Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-03-30T01:28:35Z"
    lastUpdateTime: "2023-03-30T01:28:35Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-03-30T01:28:19Z"
    lastUpdateTime: "2023-03-30T01:28:35Z"
    message: ReplicaSet "window-6458bcd6fb" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  currentPodHash: 6458bcd6fb
  currentStepHash: 58549f95b8
  currentStepIndex: 2
  observedGeneration: "3"
  phase: Healthy
  readyReplicas: 2
  replicas: 2
  selector: app=window
  stableRS: 6458bcd6fb
  updatedReplicas: 2

2023-03-30T01:28:19Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 1 (c64cf84f6)
2023-03-30T01:28:19Z         Normal    RolloutUpdated           Rollout updated to revision 1
2023-03-30T01:28:19Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-c64cf84f6 (revision 1)
2023-03-30T01:28:19Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-c64cf84f6 (revision 1) from 0 to 2
2023-03-30T01:28:19Z         Normal    RolloutCompleted         Rollout completed update to revision 1 (c64cf84f6): Initial deploy
2023-03-30T01:28:21Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 2 (5658c69dbb)
2023-03-30T01:28:21Z         Normal    RolloutUpdated           Rollout updated to revision 2
2023-03-30T01:28:21Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-5658c69dbb (revision 2)
2023-03-30T01:28:21Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-5658c69dbb (revision 2) from 0 to 1
2023-03-30T01:28:23Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 2 to 1
2023-03-30T01:28:23Z         Normal    AnalysisRunRunning       Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Running' Previous: ''
2023-03-30T01:28:28Z         Normal    AnalysisRunSuccessful    Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Successful' Previous: 'Running'
2023-03-30T01:28:28Z         Normal    RolloutStepCompleted     Rollout step 2/2 completed (analysis)
2023-03-30T01:28:28Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-5658c69dbb (revision 2) from 1 to 2
2023-03-30T01:28:29Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 1 to 0
2023-03-30T01:28:29Z         Normal    RolloutCompleted         Rollout completed update to revision 2 (5658c69dbb): Completed all 2 canary steps
2023-03-30T01:28:29Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 3 (6458bcd6fb)
2023-03-30T01:28:29Z         Normal    RolloutUpdated           Rollout updated to revision 3
2023-03-30T01:28:29Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-6458bcd6fb (revision 3)
2023-03-30T01:28:29Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-6458bcd6fb (revision 3) from 0 to 1
2023-03-30T01:28:30Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-5658c69dbb (revision 2) from 2 to 1
2023-03-30T01:28:30Z (x2)    Normal    RolloutStepCompleted     Rollout step 1/2 completed (setWeight: 50)
2023-03-30T01:28:30Z         Normal    AnalysisRunRunning       Step Analysis Run 'window-6458bcd6fb-3-1' Status New: 'Running' Previous: ''
2023-03-30T01:28:34Z         Normal    AnalysisRunSuccessful    Step Analysis Run 'window-6458bcd6fb-3-1' Status New: 'Successful' Previous: 'Running'

time="2023-03-30T01:28:35Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisWithinWindow"
time="2023-03-30T01:28:35Z" level=info msg="Deleting e2e-test-name"
    --- FAIL: TestRollbackSuite/TestRollbackAnalysisWithinWindow (16.33s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 6 runs failed: TestRollbackSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml
artifacts/E2E Test Results (k8s 1.25)/junit.xml
Raw output
Failed
=== RUN   TestRollbackSuite
time="2023-03-30T01:27:38Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2023-03-30T01:27:38Z" level=info msg="rollout.argoproj.io/window created\n"
--- FAIL: TestRollbackSuite (58.10s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml
Raw output
Failed
=== RUN   TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
time="2023-03-30T01:24:58Z" level=info msg="Deleting e2e-test-name=TestIstioAbortUpdateDeleteAllCanaryPods"
W0330 01:24:58.607623   16996 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0330 01:24:58.611044   16996 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-03-30T01:24:58Z" level=info msg="service/istio-host-split-canary created\n" rollout=istio-host-split
time="2023-03-30T01:24:59Z" level=info msg="service/istio-host-split-stable created\n" rollout=istio-host-split
time="2023-03-30T01:24:59Z" level=info msg="virtualservice.networking.istio.io/istio-host-split-vsvc created\n" rollout=istio-host-split
time="2023-03-30T01:24:59Z" level=info msg="rollout.argoproj.io/istio-host-split created\n" rollout=istio-host-split
time="2023-03-30T01:24:59Z" level=info msg="Waiting for condition: status=Healthy" rollout=istio-host-split
time="2023-03-30T01:25:04Z" level=info msg="Condition 'status=Healthy' met after 4s" rollout=istio-host-split
time="2023-03-30T01:25:04Z" level=info msg="Updated rollout pod spec: 2023-03-30T01:25:04.490261486Z" rollout=istio-host-split
time="2023-03-30T01:25:04Z" level=info msg="Waiting for condition: status=Paused" rollout=istio-host-split
time="2023-03-30T01:25:06Z" level=info msg="Condition 'status=Paused' met after 1s" rollout=istio-host-split
time="2023-03-30T01:25:06Z" level=info msg="Pod expectation 'revision:2 pod count == 2' met" rollout=istio-host-split
time="2023-03-30T01:25:06Z" level=info msg="Promoted rollout" rollout=istio-host-split
time="2023-03-30T01:25:06Z" level=info msg="Waiting for condition: status=Paused" rollout=istio-host-split
    when.go:440: timeout after 2m0s waiting for condition status=Paused
Name:            istio-host-split
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout to unpause
Strategy:        Canary
  Step:          2/6
  SetWeight:     20
  ActualWeight:  20
Images:          nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
  Desired:       5
  Current:       7
  Updated:       2
  Ready:         7
  Available:     7

NAME                                          KIND        STATUS         AGE   INFO
⟳ istio-host-split                            Rollout     �[94m◌�[0m Progressing  2m7s  
├──# revision:2                                                                
│  └──⧉ �[33mistio-host-split-b55bc7695�[0m            ReplicaSet  �[32m✔�[0m Healthy      2m2s  �[33mcanary�[0m
│     ├──□ istio-host-split-b55bc7695-6rjxt   Pod         �[32m✔�[0m Running      2m2s  ready:1/1
│     └──□ istio-host-split-b55bc7695-bdbzz   Pod         �[32m✔�[0m Running      2m2s  ready:1/1
└──# revision:1                                                                
   └──⧉ �[32mistio-host-split-5b6ddfd769�[0m           ReplicaSet  �[32m✔�[0m Healthy      2m7s  �[32mstable�[0m
      ├──□ istio-host-split-5b6ddfd769-w4n9l  Pod         �[32m✔�[0m Running      2m7s  ready:1/1
      ├──□ istio-host-split-5b6ddfd769-b7hlc  Pod         �[32m✔�[0m Running      2m6s  ready:1/1
      ├──□ istio-host-split-5b6ddfd769-hvwwt  Pod         �[32m✔�[0m Running      2m6s  ready:1/1
      ├──□ istio-host-split-5b6ddfd769-s6r92  Pod         �[32m✔�[0m Running      2m6s  ready:1/1
      └──□ istio-host-split-5b6ddfd769-scftw  Pod         �[32m✔�[0m Running      2m6s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-03-30T01:24:59Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestIstioAbortUpdateDeleteAllCanaryPods
  name: istio-host-split
  namespace: default
  resourceVersion: "13040"
  uid: 251bb25e-4c58-4437-9cf6-72c1ff8c54a4
spec:
  replicas: 5
  selector:
    matchLabels:
      app: istio-host-split
  strategy:
    canary:
      canaryService: istio-host-split-canary
      stableService: istio-host-split-stable
      steps:
      - setCanaryScale:
          replicas: 2
      - setWeight: 20
      - pause: {}
      - setCanaryScale:
          replicas: 4
      - setWeight: 40
      - pause: {}
      trafficRouting:
        istio:
          virtualService:
            name: istio-host-split-vsvc
            routes:
            - primary
  template:
    metadata:
      annotations:
        update: "2023-03-30T01:25:04.490261486Z"
      creationTimestamp: null
      labels:
        app: istio-host-split
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: istio-host-split
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 7
  availableReplicas: 7
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: b55bc7695
        serviceName: istio-host-split-canary
        weight: 20
      stable:
        podTemplateHash: 5b6ddfd769
        serviceName: istio-host-split-stable
        weight: 80
  conditions:
  - lastTransitionTime: "2023-03-30T01:25:04Z"
    lastUpdateTime: "2023-03-30T01:25:04Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-03-30T01:25:04Z"
    lastUpdateTime: "2023-03-30T01:25:04Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-03-30T01:25:04Z"
    lastUpdateTime: "2023-03-30T01:25:04Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-03-30T01:25:06Z"
    lastUpdateTime: "2023-03-30T01:25:06Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: Unknown
    type: Progressing
  - lastTransitionTime: "2023-03-30T01:25:06Z"
    lastUpdateTime: "2023-03-30T01:25:06Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  controllerPause: true
  currentPodHash: b55bc7695
  currentStepHash: 59c7688bb5
  currentStepIndex: 2
  message: CanaryPauseStep
  observedGeneration: "2"
  phase: Paused
  readyReplicas: 7
  replicas: 7
  selector: app=istio-host-split
  stableRS: 5b6ddfd769
  updatedReplicas: 2

2023-03-30T01:24:59Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (5b6ddfd769)
2023-03-30T01:24:59Z         Normal    RolloutUpdated            Rollout updated to revision 1
2023-03-30T01:24:59Z         Normal    NewReplicaSetCreated      Created ReplicaSet istio-host-split-5b6ddfd769 (revision 1)
2023-03-30T01:24:59Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2023-03-30T01:24:59Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet istio-host-split-5b6ddfd769 (revision 1) from 0 to 5
2023-03-30T01:24:59Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (5b6ddfd769): Initial deploy
2023-03-30T01:25:04Z         Normal    SwitchService             Switched selector for service 'istio-host-split-stable' from '' to '5b6ddfd769'
2023-03-30T01:25:04Z         Normal    SwitchService             Switched selector for service 'istio-host-split-canary' from '' to '5b6ddfd769'
2023-03-30T01:25:04Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (b55bc7695)
2023-03-30T01:25:04Z         Normal    RolloutUpdated            Rollout updated to revision 2
2023-03-30T01:25:04Z         Normal    NewReplicaSetCreated      Created ReplicaSet istio-host-split-b55bc7695 (revision 2)
2023-03-30T01:25:04Z (x3)    Normal    TrafficWeightUpdated      Traffic weight updated 
2023-03-30T01:25:04Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet istio-host-split-b55bc7695 (revision 2) from 0 to 2
2023-03-30T01:25:06Z         Normal    SwitchService             Switched selector for service 'istio-host-split-canary' from '5b6ddfd769' to 'b55bc7695'
2023-03-30T01:25:06Z         Normal    RolloutStepCompleted      Rollout step 1/6 completed (setCanaryScale{replicas: 2})
2023-03-30T01:25:06Z         Normal    Updated VirtualService    VirtualService `istio-host-split-vsvc` set to desiredWeight '20'
2023-03-30T01:25:06Z         Normal    TrafficWeightUpdated      Traffic weight updated from 0 to 20
2023-03-30T01:25:06Z         Normal    RolloutStepCompleted      Rollout step 2/6 completed (setWeight: 20)
2023-03-30T01:25:06Z         Normal    RolloutPaused             Rollout is paused (CanaryPauseStep)

time="2023-03-30T01:27:06Z" level=info msg="Deleting e2e-test-name=TestIstioAbortUpdateDeleteAllCanaryPods"
W0330 01:27:07.306716   16996 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0330 01:27:07.316536   16996 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods (128.83s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestIstioSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml
Raw output
Failed
=== RUN   TestIstioSuite
--- FAIL: TestIstioSuite (206.41s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestRollbackSuite/TestRollbackAnalysisOutsideWindow (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml
Raw output
Failed
=== RUN   TestRollbackSuite/TestRollbackAnalysisOutsideWindow
time="2023-03-30T01:25:57Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisOutsideWindow"
W0330 01:25:57.635222   17109 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0330 01:25:57.644333   17109 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-03-30T01:25:57Z" level=info msg="rollout.argoproj.io/window configured\n" rollout=window
time="2023-03-30T01:25:57Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:26:06Z" level=info msg="Condition 'status=Healthy' met after 8s" rollout=window
time="2023-03-30T01:26:06Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-03-30T01:26:06Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:26:12Z" level=info msg="Condition 'status=Healthy' met after 6s" rollout=window
time="2023-03-30T01:26:13Z" level=info msg="AnalysisRun expectation 'analysisrun count == 1' met" rollout=window
time="2023-03-30T01:26:13Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"three\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"three\"}}}}}" rollout=window
time="2023-03-30T01:26:13Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:26:17Z" level=info msg="Condition 'status=Healthy' met after 4s" rollout=window
time="2023-03-30T01:26:17Z" level=info msg="AnalysisRun expectation 'analysisrun count == 2' met" rollout=window
time="2023-03-30T01:26:17Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"four\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"four\"}}}}}" rollout=window
time="2023-03-30T01:26:17Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:26:24Z" level=info msg="Condition 'status=Healthy' met after 7s" rollout=window
time="2023-03-30T01:26:24Z" level=info msg="AnalysisRun expectation 'analysisrun count == 3' met" rollout=window
time="2023-03-30T01:26:24Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"five\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"five\"}}}}}" rollout=window
time="2023-03-30T01:26:24Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:26:29Z" level=info msg="Condition 'status=Healthy' met after 5s" rollout=window
time="2023-03-30T01:26:29Z" level=info msg="AnalysisRun expectation 'analysisrun count == 4' met" rollout=window
time="2023-03-30T01:26:29Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-03-30T01:26:29Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-03-30T01:26:29Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=window
time="2023-03-30T01:26:29Z" level=error msg="AnalysisRun expectation 'analysisrun count == 5' failed" rollout=window
Name:            window
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/2
  SetWeight:     50
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
  Desired:       2
  Current:       3
  Updated:       1
  Ready:         2
  Available:     2

NAME                                                         KIND         STATUS               AGE  INFO
⟳ window                                                     Rollout      �[94m◌�[0m Progressing        32s  
├──# revision:6                                                                                     
│  └──⧉ �[33mwindow-5658c69dbb�[0m                                    ReplicaSet   �[94m◌�[0m Progressing        23s  �[33mcanary�[0m
│     └──□ window-5658c69dbb-f5npp                           Pod          �[94m◌�[0m ContainerCreating  0s   ready:0/1
├──# revision:5                                                                                     
│  ├──⧉ �[32mwindow-8458dcdd5b�[0m                                    ReplicaSet   �[32m✔�[0m Healthy            5s   �[32mstable�[0m
│  │  ├──□ window-8458dcdd5b-vmvzf                           Pod          �[32m✔�[0m Running            5s   ready:1/1
│  │  └──□ window-8458dcdd5b-srhpt                           Pod          �[32m✔�[0m Running            1s   ready:1/1
│  └──α �[0mwindow-8458dcdd5b-5-1�[0m                                AnalysisRun  �[32m✔�[0m Successful         4s   �[32m✔�[0m 1
│     └──⊞ �[0m339ed3b6-48fb-4034-bedd-adfa638692b4.sleep-job.1�[0m  Job          �[32m✔�[0m Successful         4s   
├──# revision:4                                                                                     
│  ├──⧉ window-cd5644b76                                     ReplicaSet   �[0m•�[0m ScaledDown         12s  
│  │  └──□ window-cd5644b76-p5zwg                            Pod          �[94m◌�[0m Terminating        12s  ready:1/1
│  └──α �[0mwindow-cd5644b76-4-1�[0m                                 AnalysisRun  �[32m✔�[0m Successful         10s  �[32m✔�[0m 1
│     └──⊞ �[0madf1af9b-eafc-4102-bc39-fbf19027ef0d.sleep-job.1�[0m  Job          �[32m✔�[0m Successful         10s  
├──# revision:3                                                                                     
│  ├──⧉ window-6458bcd6fb                                    ReplicaSet   �[0m•�[0m ScaledDown         16s  
│  └──α �[0mwindow-6458bcd6fb-3-1�[0m                                AnalysisRun  �[32m✔�[0m Successful         15s  �[32m✔�[0m 1
│     └──⊞ �[0m84669208-412d-45db-899d-4f5227855798.sleep-job.1�[0m  Job          �[32m✔�[0m Successful         15s  
├──# revision:2                                                                                     
│  └──α �[0mwindow-5658c69dbb-2-1�[0m                                AnalysisRun  �[32m✔�[0m Successful         21s  �[32m✔�[0m 1
│     └──⊞ �[0m258014ce-fd2a-4755-8869-1be48a231987.sleep-job.1�[0m  Job          �[32m✔�[0m Successful         21s  
└──# revision:1                                                                                     
   └──⧉ window-c64cf84f6                                     ReplicaSet   �[0m•�[0m ScaledDown         32s  

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "5"
  creationTimestamp: "2023-03-30T01:25:57Z"
  generation: 6
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestRollbackAnalysisOutsideWindow
    rev: two
  name: window
  namespace: default
  resourceVersion: "15276"
  uid: b1dfaab8-091f-49cf-9ba9-563283729fd9
spec:
  replicas: 2
  rollbackWindow:
    revisions: 2
  selector:
    matchLabels:
      app: window
  strategy:
    canary:
      steps:
      - setWeight: 50
      - analysis:
          args:
          - name: rev
            valueFrom:
              fieldRef:
                fieldPath: metadata.labels['rev']
          templates:
          - templateName: sleep-job
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: window
        rev: two
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: basic
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-03-30T01:26:06Z"
    lastUpdateTime: "2023-03-30T01:26:06Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-03-30T01:26:29Z"
    lastUpdateTime: "2023-03-30T01:26:29Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-03-30T01:26:29Z"
    lastUpdateTime: "2023-03-30T01:26:29Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-03-30T01:25:57Z"
    lastUpdateTime: "2023-03-30T01:26:29Z"
    message: ReplicaSet "window-8458dcdd5b" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  currentPodHash: 8458dcdd5b
  currentStepHash: 58549f95b8
  currentStepIndex: 2
  observedGeneration: "5"
  phase: Healthy
  readyReplicas: 2
  replicas: 2
  selector: app=window
  stableRS: 8458dcdd5b
  updatedReplicas: 2

2023-03-30T01:25:57Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 1 (c64cf84f6)
2023-03-30T01:25:57Z         Normal    RolloutUpdated           Rollout updated to revision 1
2023-03-30T01:25:57Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-c64cf84f6 (revision 1)
2023-03-30T01:25:57Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-c64cf84f6 (revision 1) from 0 to 2
2023-03-30T01:25:57Z         Normal    RolloutCompleted         Rollout completed update to revision 1 (c64cf84f6): Initial deploy
2023-03-30T01:26:06Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 2 (5658c69dbb)
2023-03-30T01:26:06Z         Normal    RolloutUpdated           Rollout updated to revision 2
2023-03-30T01:26:06Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-5658c69dbb (revision 2)
2023-03-30T01:26:06Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-5658c69dbb (revision 2) from 0 to 1
2023-03-30T01:26:07Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 2 to 1
2023-03-30T01:26:08Z         Normal    AnalysisRunRunning       Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Running' Previous: ''
2023-03-30T01:26:11Z         Normal    AnalysisRunSuccessful    Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Successful' Previous: 'Running'
2023-03-30T01:26:11Z         Normal    RolloutStepCompleted     Rollout step 2/2 completed (analysis)
2023-03-30T01:26:11Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-5658c69dbb (revision 2) from 1 to 2
2023-03-30T01:26:12Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 1 to 0
2023-03-30T01:26:12Z         Normal    RolloutCompleted         Rollout completed update to revision 2 (5658c69dbb): Completed all 2 canary steps
2023-03-30T01:26:13Z         Normal    RolloutNotCompleted      Rollout not completed, started update to revision 3 (6458bcd6fb)
2023-03-30T01:26:13Z         Normal    RolloutUpdated           Rollout updated to revision 3
2023-03-30T01:26:13Z         Normal    NewReplicaSetCreated     Created ReplicaSet window-6458bcd6fb (revision 3)
2023-03-30T01:26:13Z         Normal    ScalingReplicaSet        Scaled up ReplicaSet window-6458bcd6fb (revision 3) from 0 to 1
2023-03-30T01:26:13Z         Normal    ScalingReplicaSet        Scaled down ReplicaSet window-5658c69dbb (revision 2) from 2 to 1
2023-03-30T01:26:14Z (x2)    Normal    RolloutStepCompleted     Rollout step 1/2 completed (setWeight: 50)
2023-03-30T01:26:14Z         Normal    AnalysisRunRunning       Step Analysis Run 'window-6458bcd6fb-3-1' Status New: 'Running' Previous: ''
2023-03-30T01:26:16Z         Normal    AnalysisRunSuccessful    Step Analysis Run 'window-6458bcd6fb-3-1' Status New: 'Successful' Previous: 'Running'

time="2023-03-30T01:26:29Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisOutsideWindow"
W0330 01:26:29.546096   17109 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0330 01:26:29.552731   17109 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestRollbackSuite/TestRollbackAnalysisOutsideWindow (32.12s)

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

5 skipped tests found

There are 5 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

96 tests found

There are 96 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite