13 fail, 5 skipped, 79 pass in 3h 37m 4s
Annotations
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
2 out of 6 runs failed: TestCanarySuite/TestCanaryDynamicStableScale (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 19s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 22s]
Raw output
Failed
=== RUN TestCanarySuite/TestCanaryDynamicStableScale
time="2023-07-14T00:56:38Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
time="2023-07-14T00:56:38Z" level=info msg="service/dynamic-stable-scale-root created\n" rollout=dynamic-stable-scale
time="2023-07-14T00:56:38Z" level=info msg="service/dynamic-stable-scale-canary created\n" rollout=dynamic-stable-scale
time="2023-07-14T00:56:39Z" level=info msg="service/dynamic-stable-scale-stable created\n" rollout=dynamic-stable-scale
time="2023-07-14T00:56:39Z" level=info msg="ingress.networking.k8s.io/dynamic-stable-scale-ingress created\n" rollout=dynamic-stable-scale
time="2023-07-14T00:56:39Z" level=info msg="rollout.argoproj.io/dynamic-stable-scale created\n" rollout=dynamic-stable-scale
time="2023-07-14T00:56:40Z" level=info msg="Marked 4 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-07-14T00:56:40Z" level=info msg="Waiting for condition: status=Healthy" rollout=dynamic-stable-scale
time="2023-07-14T00:56:44Z" level=info msg="Condition 'status=Healthy' met after 3s" rollout=dynamic-stable-scale
time="2023-07-14T00:56:44Z" level=info msg="Updated rollout pod spec: 2023-07-14T00:56:44.311839907Z" rollout=dynamic-stable-scale
time="2023-07-14T00:56:45Z" level=info msg="Marked 1 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-07-14T00:56:45Z" level=info msg="Waiting for condition: status=Paused" rollout=dynamic-stable-scale
time="2023-07-14T00:56:47Z" level=info msg="Condition 'status=Paused' met after 2s" rollout=dynamic-stable-scale
time="2023-07-14T00:56:47Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-07-14T00:56:49Z" level=info msg="Pod expectation 'revision:1 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-07-14T00:56:49Z" level=info msg="Pod expectation 'revision:2 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-07-14T00:56:49Z" level=info msg="Promoted rollout" rollout=dynamic-stable-scale
time="2023-07-14T00:56:50Z" level=info msg="Marked 2 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-07-14T00:56:50Z" level=info msg="Waiting for condition: status.currentStepIndex=3" rollout=dynamic-stable-scale
time="2023-07-14T00:56:52Z" level=info msg="Condition 'status.currentStepIndex=3' met after 1s" rollout=dynamic-stable-scale
time="2023-07-14T00:56:52Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-07-14T00:56:54Z" level=info msg="Pod expectation 'revision:1 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-07-14T00:56:54Z" level=info msg="Pod expectation 'revision:2 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-07-14T00:56:54Z" level=info msg="Aborted rollout" rollout=dynamic-stable-scale
time="2023-07-14T00:56:55Z" level=info msg="Marked 2 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-07-14T00:56:55Z" level=info msg="Waiting for condition: rev=2 podcount=1" rollout=dynamic-stable-scale
time="2023-07-14T00:56:57Z" level=info msg="Condition 'rev=2 podcount=1' met after 1s" rollout=dynamic-stable-scale
time="2023-07-14T00:56:57Z" level=info msg="Pod expectation 'revision:1 pod count == 4' met" rollout=dynamic-stable-scale
time="2023-07-14T00:56:58Z" level=info msg="Marked 1 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-07-14T00:56:58Z" level=info msg="Waiting for condition: rev=2 podcount=0" rollout=dynamic-stable-scale
time="2023-07-14T00:56:59Z" level=info msg="Condition 'rev=2 podcount=0' met after 0s" rollout=dynamic-stable-scale
canary_test.go:620: Expected dynamic-stable-scale-canary selector: map[app:dynamic-stable-scale rollouts-pod-template-hash:868d98995b]. Actual: map[app:dynamic-stable-scale rollouts-pod-template-hash:6cb7bd8746]
Name: dynamic-stable-scale
Namespace: default
Status: �[31m✖�[0m Degraded
Message: RolloutAborted: Rollout aborted update to revision 2
Strategy: Canary
Step: 0/4
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
Desired: 4
Current: 4
Updated: 0
Ready: 4
Available: 4
NAME KIND STATUS AGE INFO
⟳ dynamic-stable-scale Rollout �[31m✖�[0m Degraded 20s
├──# revision:2
│ └──⧉ �[33mdynamic-stable-scale-6cb7bd8746�[0m ReplicaSet �[0m•�[0m ScaledDown 15s �[33mcanary�[0m
│ └──□ dynamic-stable-scale-6cb7bd8746-vqfjw Pod �[94m◌�[0m Terminating 15s ready:1/1
└──# revision:1
└──⧉ �[32mdynamic-stable-scale-868d98995b�[0m ReplicaSet �[32m✔�[0m Healthy 20s �[32mstable�[0m
├──□ dynamic-stable-scale-868d98995b-2pbp9 Pod �[32m✔�[0m Running 20s ready:1/1
├──□ dynamic-stable-scale-868d98995b-cpnkw Pod �[32m✔�[0m Running 5s ready:1/1
├──□ dynamic-stable-scale-868d98995b-cqqlm Pod �[32m✔�[0m Running 5s ready:1/1
└──□ dynamic-stable-scale-868d98995b-n62cn Pod �[32m✔�[0m Running 5s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-07-14T00:56:39Z"
generation: 2
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestCanaryDynamicStableScale
name: dynamic-stable-scale
namespace: default
resourceVersion: "5340"
uid: 2fbb7a63-094c-44e0-a904-35aa776963a1
spec:
replicas: 4
selector:
matchLabels:
app: dynamic-stable-scale
strategy:
canary:
canaryService: dynamic-stable-scale-canary
dynamicStableScale: true
stableService: dynamic-stable-scale-stable
steps:
- setWeight: 25
- pause: {}
- setWeight: 75
- pause: {}
trafficRouting:
alb:
ingress: dynamic-stable-scale-ingress
rootService: dynamic-stable-scale-root
servicePort: 80
template:
metadata:
annotations:
update: "2023-07-14T00:56:44.311839907Z"
creationTimestamp: null
labels:
app: dynamic-stable-scale
spec:
containers:
- image: nginx:1.19-alpine
name: dynamic-stable-scale
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
readinessGates:
- conditionType: argoproj.io/e2e-readiness
status:
HPAReplicas: 5
abort: true
abortedAt: "2023-07-14T00:56:54Z"
availableReplicas: 5
blueGreen: {}
canary:
weights:
canary:
podTemplateHash: 6cb7bd8746
serviceName: dynamic-stable-scale-canary
weight: 0
stable:
podTemplateHash: 868d98995b
serviceName: dynamic-stable-scale-stable
weight: 100
conditions:
- lastTransitionTime: "2023-07-14T00:56:44Z"
lastUpdateTime: "2023-07-14T00:56:44Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-07-14T00:56:44Z"
lastUpdateTime: "2023-07-14T00:56:44Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-07-14T00:56:44Z"
lastUpdateTime: "2023-07-14T00:56:44Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-07-14T00:56:52Z"
lastUpdateTime: "2023-07-14T00:56:52Z"
message: Rollout is paused
reason: RolloutPaused
status: "True"
type: Paused
- lastTransitionTime: "2023-07-14T00:56:54Z"
lastUpdateTime: "2023-07-14T00:56:54Z"
message: Rollout aborted update to revision 2
reason: RolloutAborted
status: "False"
type: Progressing
currentPodHash: 6cb7bd8746
currentStepHash: 7c5b668566
currentStepIndex: 0
message: 'RolloutAborted: Rollout aborted update to revision 2'
observedGeneration: "2"
phase: Degraded
readyReplicas: 5
replicas: 5
selector: app=dynamic-stable-scale
stableRS: 868d98995b
updatedReplicas: 1
2023-07-14T00:56:39Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (868d98995b)
2023-07-14T00:56:39Z Normal RolloutUpdated Rollout updated to revision 1
2023-07-14T00:56:39Z Normal NewReplicaSetCreated Created ReplicaSet dynamic-stable-scale-868d98995b (revision 1)
2023-07-14T00:56:39Z Normal PatchingALBIngress Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '0'
2023-07-14T00:56:39Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-07-14T00:56:39Z Normal ScalingReplicaSet Scaled up ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 0 to 4
2023-07-14T00:56:39Z Normal RolloutCompleted Rollout completed update to revision 1 (868d98995b): Initial deploy
2023-07-14T00:56:44Z Normal SwitchService Switched selector for service 'dynamic-stable-scale-stable' from '' to '868d98995b'
2023-07-14T00:56:44Z Normal SwitchService Switched selector for service 'dynamic-stable-scale-canary' from '' to '868d98995b'
2023-07-14T00:56:44Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (6cb7bd8746)
2023-07-14T00:56:44Z Normal RolloutUpdated Rollout updated to revision 2
2023-07-14T00:56:44Z Normal NewReplicaSetCreated Created ReplicaSet dynamic-stable-scale-6cb7bd8746 (revision 2)
2023-07-14T00:56:44Z (x3) Normal TrafficWeightUpdated Traffic weight updated
2023-07-14T00:56:44Z Normal ScalingReplicaSet Scaled up ReplicaSet dynamic-stable-scale-6cb7bd8746 (revision 2) from 0 to 1
2023-07-14T00:56:47Z Normal SwitchService Switched selector for service 'dynamic-stable-scale-canary' from '868d98995b' to '6cb7bd8746'
2023-07-14T00:56:47Z Normal PatchingALBIngress Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '25'
2023-07-14T00:56:47Z Normal TrafficWeightUpdated Traffic weight updated from 0 to 25
2023-07-14T00:56:47Z Normal RolloutStepCompleted Rollout step 1/4 completed (setWeight: 25)
2023-07-14T00:56:47Z Normal ScalingReplicaSet Scaled down ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 4 to 3
2023-07-14T00:56:47Z Normal RolloutPaused Rollout is paused (CanaryPauseStep)
2023-07-14T00:56:49Z Normal RolloutStepCompleted Rollout step 2/4 completed (pause)
2023-07-14T00:56:49Z Normal ScalingReplicaSet Scaled up ReplicaSet dynamic-stable-scale-6cb7bd8746 (revision 2) from 1 to 3
time="2023-07-14T00:56:59Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
--- FAIL: TestCanarySuite/TestCanaryDynamicStableScale (22.04s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
2 out of 6 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 4m 6s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 4m 9s]
Raw output
Failed
=== RUN TestCanarySuite
time="2023-07-14T00:56:38Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (249.39s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 2m 7s]
Raw output
Failed
=== RUN TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
time="2023-07-14T01:09:51Z" level=info msg="Deleting e2e-test-name=TestIstioAbortUpdateDeleteAllCanaryPods"
time="2023-07-14T01:09:51Z" level=info msg="service/istio-host-split-canary created\n" rollout=istio-host-split
time="2023-07-14T01:09:51Z" level=info msg="service/istio-host-split-stable created\n" rollout=istio-host-split
time="2023-07-14T01:09:52Z" level=info msg="virtualservice.networking.istio.io/istio-host-split-vsvc created\n" rollout=istio-host-split
time="2023-07-14T01:09:52Z" level=info msg="rollout.argoproj.io/istio-host-split created\n" rollout=istio-host-split
time="2023-07-14T01:09:52Z" level=info msg="Waiting for condition: status=Healthy" rollout=istio-host-split
time="2023-07-14T01:09:57Z" level=info msg="Condition 'status=Healthy' met after 4s" rollout=istio-host-split
time="2023-07-14T01:09:57Z" level=info msg="Updated rollout pod spec: 2023-07-14T01:09:57.285890962Z" rollout=istio-host-split
time="2023-07-14T01:09:57Z" level=info msg="Waiting for condition: status=Paused" rollout=istio-host-split
when.go:440: timeout after 2m0s waiting for condition status=Paused
Name: istio-host-split
Namespace: default
Status: �[94m◌�[0m Progressing
Message: waiting for rollout spec update to be observed
Strategy: Canary
Step: 6/6
SetWeight: 100
ActualWeight: 100
Images: nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
Desired: 5
Current: 5
Updated: 5
Ready: 5
Available: 5
NAME KIND STATUS AGE INFO
⟳ istio-host-split Rollout �[94m◌�[0m Progressing 2m5s
└──# revision:1
└──⧉ �[32mistio-host-split-5b6ddfd769�[0m ReplicaSet �[32m✔�[0m Healthy 2m5s �[32mstable�[0m
├──□ istio-host-split-5b6ddfd769-4v49j Pod �[32m✔�[0m Running 2m5s ready:1/1
├──□ istio-host-split-5b6ddfd769-8ht4r Pod �[32m✔�[0m Running 2m5s ready:1/1
├──□ istio-host-split-5b6ddfd769-8x4wk Pod �[32m✔�[0m Running 2m5s ready:1/1
├──□ istio-host-split-5b6ddfd769-nmf5d Pod �[32m✔�[0m Running 2m5s ready:1/1
└──□ istio-host-split-5b6ddfd769-qv9gq Pod �[32m✔�[0m Running 2m5s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "1"
creationTimestamp: "2023-07-14T01:09:52Z"
generation: 2
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestIstioAbortUpdateDeleteAllCanaryPods
name: istio-host-split
namespace: default
resourceVersion: "13133"
uid: 9cf1e064-5834-4827-829c-f33696b03811
spec:
replicas: 5
selector:
matchLabels:
app: istio-host-split
strategy:
canary:
canaryService: istio-host-split-canary
stableService: istio-host-split-stable
steps:
- setCanaryScale:
replicas: 2
- setWeight: 20
- pause: {}
- setCanaryScale:
replicas: 4
- setWeight: 40
- pause: {}
trafficRouting:
istio:
virtualService:
name: istio-host-split-vsvc
routes:
- primary
template:
metadata:
annotations:
update: "2023-07-14T01:09:57.285890962Z"
creationTimestamp: null
labels:
app: istio-host-split
spec:
containers:
- image: nginx:1.19-alpine
name: istio-host-split
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 5
availableReplicas: 5
blueGreen: {}
canary:
weights:
canary:
podTemplateHash: 5b6ddfd769
serviceName: istio-host-split-canary
weight: 0
stable:
podTemplateHash: 5b6ddfd769
serviceName: istio-host-split-stable
weight: 100
conditions:
- lastTransitionTime: "2023-07-14T01:09:52Z"
lastUpdateTime: "2023-07-14T01:09:52Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
- lastTransitionTime: "2023-07-14T01:09:57Z"
lastUpdateTime: "2023-07-14T01:09:57Z"
message: Rollout is healthy
reason: RolloutHealthy
status: "True"
type: Healthy
- lastTransitionTime: "2023-07-14T01:09:52Z"
lastUpdateTime: "2023-07-14T01:09:57Z"
message: ReplicaSet "istio-host-split-5b6ddfd769" has successfully progressed.
reason: NewReplicaSetAvailable
status: "True"
type: Progressing
- lastTransitionTime: "2023-07-14T01:09:57Z"
lastUpdateTime: "2023-07-14T01:09:57Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
currentPodHash: 5b6ddfd769
currentStepHash: 59c7688bb5
currentStepIndex: 6
observedGeneration: "1"
phase: Healthy
readyReplicas: 5
replicas: 5
selector: app=istio-host-split
stableRS: 5b6ddfd769
updatedReplicas: 5
2023-07-14T01:09:52Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (5b6ddfd769)
2023-07-14T01:09:52Z Normal RolloutUpdated Rollout updated to revision 1
2023-07-14T01:09:52Z Normal NewReplicaSetCreated Created ReplicaSet istio-host-split-5b6ddfd769 (revision 1)
2023-07-14T01:09:52Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-07-14T01:09:52Z Normal ScalingReplicaSet Scaled up ReplicaSet istio-host-split-5b6ddfd769 (revision 1) from 0 to 5
2023-07-14T01:09:52Z Normal RolloutCompleted Rollout completed update to revision 1 (5b6ddfd769): Initial deploy
2023-07-14T01:09:52Z Normal TrafficWeightUpdated Traffic weight updated
2023-07-14T01:09:57Z Normal SwitchService Switched selector for service 'istio-host-split-stable' from '' to '5b6ddfd769'
2023-07-14T01:09:57Z Normal SwitchService Switched selector for service 'istio-host-split-canary' from '' to '5b6ddfd769'
time="2023-07-14T01:11:57Z" level=info msg="Deleting e2e-test-name=TestIstioAbortUpdateDeleteAllCanaryPods"
--- FAIL: TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods (127.25s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestIstioSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 3m 22s]
Raw output
Failed
=== RUN TestIstioSuite
--- FAIL: TestIstioSuite (202.48s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 14s]
Raw output
Failed
=== RUN TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2023-07-14T00:54:18Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
W0714 00:54:18.561777 17078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0714 00:54:18.570854 17078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-07-14T00:54:19Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2023-07-14T00:54:19Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2023-07-14T00:54:19Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2023-07-14T00:54:20Z" level=info msg="ingress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2023-07-14T00:54:20Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2023-07-14T00:54:20Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2023-07-14T00:54:21Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2023-07-14T00:54:21Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2023-07-14T00:54:21Z" level=info msg="Updated rollout pod spec: 2023-07-14T00:54:21.989429564Z" rollout=alb-rollout
time="2023-07-14T00:54:22Z" level=info msg="Sleeping 10s" rollout=alb-rollout
require.go:72:
Error Trace: /home/runner/go/pkg/mod/github.com/tj/assert@v0.0.3/require.go:72
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:166
/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:156
Error: Not equal:
expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
actual : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
Diff:
--- Expected
+++ Actual
@@ -1 +1 @@
-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
Test: TestAWSSuite/TestALBExperimentStepNoSetWeight
Name: alb-rollout
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/1
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
Desired: 1
Current: 1
Updated: 0
Ready: 1
Available: 1
NAME KIND STATUS AGE INFO
⟳ alb-rollout Rollout �[94m◌�[0m Progressing 12s
├──# revision:2
│ ├──⧉ �[33malb-rollout-655f974df7�[0m ReplicaSet �[0m•�[0m ScaledDown 10s �[33mcanary�[0m
│ └──Σ �[94malb-rollout-655f974df7-2-0�[0m Experiment �[94m◌�[0m Running 10s
│ ├──⧉ alb-rollout-655f974df7-2-0-experiment-alb-canary ReplicaSet �[32m✔�[0m Healthy 10s
│ │ └──□ alb-rollout-655f974df7-2-0-experiment-alb-canary-fxxc9 Pod �[32m✔�[0m Running 10s ready:1/1
│ └──⧉ alb-rollout-655f974df7-2-0-experiment-alb-stable ReplicaSet �[32m✔�[0m Healthy 10s
│ └──□ alb-rollout-655f974df7-2-0-experiment-alb-stable-m5z8p Pod �[32m✔�[0m Running 10s ready:1/1
└──# revision:1
└──⧉ �[32malb-rollout-d6f4fdcdc�[0m ReplicaSet �[32m✔�[0m Healthy 12s �[32mstable�[0m
└──□ alb-rollout-d6f4fdcdc-m7g5s Pod �[32m✔�[0m Running 12s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-07-14T00:54:20Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestALBExperimentStepNoSetWeight
name: alb-rollout
namespace: default
resourceVersion: "3696"
uid: 169fb594-0926-4e97-8c32-40238658a81a
spec:
replicas: 1
selector:
matchLabels:
app: alb-rollout
strategy:
canary:
canaryService: alb-rollout-canary
stableService: alb-rollout-stable
steps:
- experiment:
duration: 15s
templates:
- metadata: {}
name: experiment-alb-canary
specRef: canary
weight: 20
- metadata: {}
name: experiment-alb-stable
specRef: stable
weight: 20
trafficRouting:
alb:
ingress: alb-rollout-ingress
rootService: alb-rollout-root
servicePort: 80
template:
metadata:
annotations:
update: "2023-07-14T00:54:21.989429564Z"
creationTimestamp: null
labels:
app: alb-rollout
spec:
containers:
- image: nginx:1.19-alpine
name: alb-rollout
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 1
availableReplicas: 1
blueGreen: {}
canary:
currentExperiment: alb-rollout-655f974df7-2-0
weights:
additional:
- weight: 20
- weight: 20
canary:
podTemplateHash: 655f974df7
serviceName: alb-rollout-canary
weight: 0
stable:
podTemplateHash: d6f4fdcdc
serviceName: alb-rollout-stable
weight: 60
conditions:
- lastTransitionTime: "2023-07-14T00:54:21Z"
lastUpdateTime: "2023-07-14T00:54:21Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-07-14T00:54:22Z"
lastUpdateTime: "2023-07-14T00:54:22Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-07-14T00:54:22Z"
lastUpdateTime: "2023-07-14T00:54:22Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-07-14T00:54:20Z"
lastUpdateTime: "2023-07-14T00:54:22Z"
message: Created new replica set "alb-rollout-655f974df7"
reason: NewReplicaSetCreated
status: "True"
type: Progressing
currentPodHash: 655f974df7
currentStepHash: 558cc8bf4d
currentStepIndex: 0
message: more replicas need to be updated
observedGeneration: "3"
phase: Progressing
readyReplicas: 1
replicas: 1
selector: app=alb-rollout
stableRS: d6f4fdcdc
2023-07-14T00:54:20Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (d6f4fdcdc)
2023-07-14T00:54:20Z Normal RolloutUpdated Rollout updated to revision 1
2023-07-14T00:54:20Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2023-07-14T00:54:20Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-07-14T00:54:20Z Normal ScalingReplicaSet Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2023-07-14T00:54:20Z Normal RolloutCompleted Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2023-07-14T00:54:21Z Normal SwitchService Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2023-07-14T00:54:21Z Normal SwitchService Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2023-07-14T00:54:22Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (655f974df7)
2023-07-14T00:54:22Z Normal RolloutUpdated Rollout updated to revision 2
2023-07-14T00:54:22Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-655f974df7 (revision 2)
2023-07-14T00:54:22Z (x2) Normal TrafficWeightUpdated Traffic weight updated
2023-07-14T00:54:22Z Normal ExperimentCreated Created Experiment 'alb-rollout-655f974df7-2-0'
2023-07-14T00:54:23Z (x2) Normal PatchingALBIngress Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2023-07-14T00:54:23Z Normal TrafficWeightUpdated Traffic weight updated additional: [{20 } {20 }]
time="2023-07-14T00:54:32Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
W0714 00:54:32.705985 17078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0714 00:54:32.712105 17078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
--- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (14.28s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 55s]
Raw output
Failed
=== RUN TestAWSSuite
--- FAIL: TestAWSSuite (55.14s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 2m 3s]
Raw output
Failed
=== RUN TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
time="2023-07-14T00:53:59Z" level=info msg="Deleting e2e-test-name=TestBlueGreenPreviewReplicaCount"
W0714 00:53:59.629059 17102 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0714 00:53:59.631787 17102 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-07-14T00:53:59Z" level=info msg="service/bluegreen-preview-replicas-active created\n" rollout=bluegreen-preview-replicas
time="2023-07-14T00:54:00Z" level=info msg="service/bluegreen-preview-replicas-preview created\n" rollout=bluegreen-preview-replicas
time="2023-07-14T00:54:00Z" level=info msg="rollout.argoproj.io/bluegreen-preview-replicas created\n" rollout=bluegreen-preview-replicas
time="2023-07-14T00:54:00Z" level=info msg="Waiting for condition: status=Healthy" rollout=bluegreen-preview-replicas
time="2023-07-14T00:54:02Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=bluegreen-preview-replicas
time="2023-07-14T00:54:02Z" level=info msg="Updated rollout pod spec: 2023-07-14T00:54:02.432475419Z" rollout=bluegreen-preview-replicas
time="2023-07-14T00:54:02Z" level=info msg="Waiting for condition: status=Paused" rollout=bluegreen-preview-replicas
when.go:440: timeout after 2m0s waiting for condition status=Paused
Name: bluegreen-preview-replicas
Namespace: default
Status: �[94m◌�[0m Progressing
Message: waiting for rollout spec update to be observed
Strategy: BlueGreen
Images: nginx:1.19-alpine (�[32mstable�[0m, �[32mactive�[0m)
Replicas:
Desired: 2
Current: 2
Updated: 2
Ready: 2
Available: 2
NAME KIND STATUS AGE INFO
⟳ bluegreen-preview-replicas Rollout �[94m◌�[0m Progressing 2m2s
└──# revision:1
└──⧉ �[32m�[32mbluegreen-preview-replicas-66b7c555c5�[0m�[0m ReplicaSet �[32m✔�[0m Healthy 2m2s �[32mstable�[0m,�[32mactive�[0m
├──□ bluegreen-preview-replicas-66b7c555c5-d9zqj Pod �[32m✔�[0m Running 2m2s ready:1/1
└──□ bluegreen-preview-replicas-66b7c555c5-hbgm8 Pod �[32m✔�[0m Running 2m2s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "1"
creationTimestamp: "2023-07-14T00:54:00Z"
generation: 2
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestBlueGreenPreviewReplicaCount
name: bluegreen-preview-replicas
namespace: default
resourceVersion: "4481"
uid: f5892830-1b9f-4925-a214-48395c4e7ab4
spec:
replicas: 2
selector:
matchLabels:
app: bluegreen-preview-replicas
strategy:
blueGreen:
activeService: bluegreen-preview-replicas-active
autoPromotionEnabled: false
previewReplicaCount: 1
previewService: bluegreen-preview-replicas-preview
scaleDownDelaySeconds: 5
template:
metadata:
annotations:
update: "2023-07-14T00:54:02.432475419Z"
creationTimestamp: null
labels:
app: bluegreen-preview-replicas
spec:
containers:
- image: nginx:1.19-alpine
name: bluegreen-preview-replicas
resources:
requests:
cpu: 1m
memory: 16Mi
status:
HPAReplicas: 2
availableReplicas: 2
blueGreen:
activeSelector: 66b7c555c5
previewSelector: 66b7c555c5
canary: {}
conditions:
- lastTransitionTime: "2023-07-14T00:54:00Z"
lastUpdateTime: "2023-07-14T00:54:00Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
- lastTransitionTime: "2023-07-14T00:54:02Z"
lastUpdateTime: "2023-07-14T00:54:02Z"
message: Rollout is healthy
reason: RolloutHealthy
status: "True"
type: Healthy
- lastTransitionTime: "2023-07-14T00:54:00Z"
lastUpdateTime: "2023-07-14T00:54:02Z"
message: ReplicaSet "bluegreen-preview-replicas-66b7c555c5" has successfully progressed.
reason: NewReplicaSetAvailable
status: "True"
type: Progressing
- lastTransitionTime: "2023-07-14T00:54:02Z"
lastUpdateTime: "2023-07-14T00:54:02Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
currentPodHash: 66b7c555c5
observedGeneration: "1"
phase: Healthy
readyReplicas: 2
replicas: 2
selector: app=bluegreen-preview-replicas,rollouts-pod-template-hash=66b7c555c5
stableRS: 66b7c555c5
updatedReplicas: 2
2023-07-14T00:54:00Z Normal RolloutUpdated Rollout updated to revision 1
2023-07-14T00:54:00Z Normal NewReplicaSetCreated Created ReplicaSet bluegreen-preview-replicas-66b7c555c5 (revision 1)
2023-07-14T00:54:00Z Normal SwitchService Switched selector for service 'bluegreen-preview-replicas-preview' from '' to '66b7c555c5'
2023-07-14T00:54:00Z Normal ScalingReplicaSet Scaled up ReplicaSet bluegreen-preview-replicas-66b7c555c5 (revision 1) from 0 to 2
2023-07-14T00:54:00Z Normal RolloutCompleted Rollout completed update to revision 1 (66b7c555c5): Initial deploy
2023-07-14T00:54:02Z Normal SwitchService Switched selector for service 'bluegreen-preview-replicas-active' from '' to '66b7c555c5'
time="2023-07-14T00:56:02Z" level=info msg="Deleting e2e-test-name=TestBlueGreenPreviewReplicaCount"
W0714 00:56:02.780927 17102 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0714 00:56:02.784045 17102 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
--- FAIL: TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount (123.23s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 2m 31s]
Raw output
Failed
=== RUN TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
time="2023-07-14T00:54:59Z" level=info msg="Deleting e2e-test-name=TestBlueGreenProgressDeadlineExceededWithoutPause"
time="2023-07-14T00:55:00Z" level=info msg="service/rollout-bluegreen-without-pause created\n" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:00Z" level=info msg="rollout.argoproj.io/rollout-bluegreen-without-pause created\n" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:00Z" level=info msg="Waiting for condition: status.replicas=1" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:00Z" level=info msg="Condition 'status.replicas=1' met after 0s" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:00Z" level=info msg="Waiting for condition: status=Degraded" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:06Z" level=info msg="Condition 'status=Degraded' met after 5s" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:06Z" level=info msg="Waiting for condition: status=Healthy" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:31Z" level=info msg="Condition 'status=Healthy' met after 25s" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:31Z" level=info msg="Updated rollout pod spec: 2023-07-14T00:55:31.102961823Z" rollout=rollout-bluegreen-without-pause
time="2023-07-14T00:55:31Z" level=info msg="Waiting for condition: status=Degraded" rollout=rollout-bluegreen-without-pause
when.go:440: timeout after 2m0s waiting for condition status=Degraded
Name: rollout-bluegreen-without-pause
Namespace: default
Status: �[94m◌�[0m Progressing
Message: waiting for rollout spec update to be observed
Strategy: BlueGreen
Images: nginx:1.19-alpine (�[32mstable�[0m, �[32mactive�[0m)
Replicas:
Desired: 1
Current: 1
Updated: 1
Ready: 1
Available: 1
NAME KIND STATUS AGE INFO
⟳ rollout-bluegreen-without-pause Rollout �[94m◌�[0m Progressing 2m31s
└──# revision:1
└──⧉ �[32m�[32mrollout-bluegreen-without-pause-5cfc7565c4�[0m�[0m ReplicaSet �[32m✔�[0m Healthy 2m31s �[32mstable�[0m,�[32mactive�[0m
└──□ rollout-bluegreen-without-pause-5cfc7565c4-hkqvc Pod �[32m✔�[0m Running 2m31s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "1"
creationTimestamp: "2023-07-14T00:55:00Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestBlueGreenProgressDeadlineExceededWithoutPause
name: rollout-bluegreen-without-pause
namespace: default
resourceVersion: "4781"
uid: a5a86537-3120-4c3d-875a-1555eddfffda
spec:
progressDeadlineSeconds: 5
replicas: 1
revisionHistoryLimit: 2
selector:
matchLabels:
app: rollout-bluegreen-without-pause
strategy:
blueGreen:
activeService: rollout-bluegreen-without-pause
autoPromotionEnabled: true
template:
metadata:
annotations:
update: "2023-07-14T00:55:31.102961823Z"
creationTimestamp: null
labels:
app: rollout-bluegreen-without-pause
spec:
containers:
- image: nginx:1.19-alpine
name: rollouts-demo
ports:
- containerPort: 80
protocol: TCP
readinessProbe:
httpGet:
path: /
port: 80
initialDelaySeconds: 10
periodSeconds: 30
resources: {}
status:
HPAReplicas: 1
availableReplicas: 1
blueGreen:
activeSelector: 5cfc7565c4
canary: {}
conditions:
- lastTransitionTime: "2023-07-14T00:55:00Z"
lastUpdateTime: "2023-07-14T00:55:00Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
- lastTransitionTime: "2023-07-14T00:55:31Z"
lastUpdateTime: "2023-07-14T00:55:31Z"
message: Rollout is healthy
reason: RolloutHealthy
status: "True"
type: Healthy
- lastTransitionTime: "2023-07-14T00:55:31Z"
lastUpdateTime: "2023-07-14T00:55:31Z"
message: ReplicaSet "rollout-bluegreen-without-pause-5cfc7565c4" has successfully
progressed.
reason: NewReplicaSetAvailable
status: "True"
type: Progressing
- lastTransitionTime: "2023-07-14T00:55:31Z"
lastUpdateTime: "2023-07-14T00:55:31Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
currentPodHash: 5cfc7565c4
observedGeneration: "2"
phase: Healthy
readyReplicas: 1
replicas: 1
selector: app=rollout-bluegreen-without-pause,rollouts-pod-template-hash=5cfc7565c4
stableRS: 5cfc7565c4
updatedReplicas: 1
2023-07-14T00:55:00Z Normal RolloutUpdated Rollout updated to revision 1
2023-07-14T00:55:00Z Normal NewReplicaSetCreated Created ReplicaSet rollout-bluegreen-without-pause-5cfc7565c4 (revision 1)
2023-07-14T00:55:00Z Normal ScalingReplicaSet Scaled up ReplicaSet rollout-bluegreen-without-pause-5cfc7565c4 (revision 1) from 0 to 1
2023-07-14T00:55:00Z Normal RolloutCompleted Rollout completed update to revision 1 (5cfc7565c4): Initial deploy
2023-07-14T00:55:31Z Normal SwitchService Switched selector for service 'rollout-bluegreen-without-pause' from '' to '5cfc7565c4'
time="2023-07-14T00:57:31Z" level=info msg="Deleting e2e-test-name=TestBlueGreenProgressDeadlineExceededWithoutPause"
--- FAIL: TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause (151.52s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
2 out of 6 runs failed: TestBlueGreenSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 4m 16s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 3m 49s]
Raw output
Failed
=== RUN TestBlueGreenSuite
--- FAIL: TestBlueGreenSuite (229.31s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestFunctionalSuite/TestBlueGreenScaleDownDelay (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 2m 6s]
Raw output
Failed
=== RUN TestFunctionalSuite/TestBlueGreenScaleDownDelay
time="2023-07-14T01:04:28Z" level=info msg="Deleting e2e-test-name=TestBlueGreenScaleDownDelay"
W0714 01:04:28.302080 17078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0714 01:04:28.306281 17078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-07-14T01:04:28Z" level=info msg="service/bluegreen-scaledowndelay-active created\n" rollout=bluegreen-scaledowndelay
time="2023-07-14T01:04:29Z" level=info msg="rollout.argoproj.io/bluegreen-scaledowndelay created\n" rollout=bluegreen-scaledowndelay
time="2023-07-14T01:04:29Z" level=info msg="Waiting for condition: status=Healthy" rollout=bluegreen-scaledowndelay
time="2023-07-14T01:04:34Z" level=info msg="Condition 'status=Healthy' met after 5s" rollout=bluegreen-scaledowndelay
time="2023-07-14T01:04:34Z" level=info msg="Updated rollout pod spec: 2023-07-14T01:04:34.662239161Z" rollout=bluegreen-scaledowndelay
time="2023-07-14T01:04:34Z" level=info msg="Waiting for condition: status=Progressing" rollout=bluegreen-scaledowndelay
time="2023-07-14T01:04:34Z" level=info msg="Condition 'status=Progressing' met after 0s" rollout=bluegreen-scaledowndelay
time="2023-07-14T01:04:34Z" level=info msg="Waiting for condition: status=Healthy" rollout=bluegreen-scaledowndelay
when.go:440: timeout after 2m0s waiting for condition status=Healthy
Name: bluegreen-scaledowndelay
Namespace: default
Status: �[94m◌�[0m Progressing
Message: waiting for rollout spec update to be observed
Strategy: BlueGreen
Images: nginx:1.19-alpine (�[32mstable�[0m, �[32mactive�[0m)
Replicas:
Desired: 1
Current: 1
Updated: 1
Ready: 1
Available: 1
NAME KIND STATUS AGE INFO
⟳ bluegreen-scaledowndelay Rollout �[94m◌�[0m Progressing 2m5s
└──# revision:1
└──⧉ �[32m�[32mbluegreen-scaledowndelay-7476f947b5�[0m�[0m ReplicaSet �[32m✔�[0m Healthy 2m5s �[32mstable�[0m,�[32mactive�[0m
└──□ bluegreen-scaledowndelay-7476f947b5-d79w4 Pod �[32m✔�[0m Running 2m5s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "1"
creationTimestamp: "2023-07-14T01:04:29Z"
generation: 2
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestBlueGreenScaleDownDelay
name: bluegreen-scaledowndelay
namespace: default
resourceVersion: "9326"
uid: 8c350748-6583-42b5-b3de-45deee3470a5
spec:
replicas: 1
selector:
matchLabels:
app: bluegreen-scaledowndelay
strategy:
blueGreen:
activeService: bluegreen-scaledowndelay-active
scaleDownDelayRevisionLimit: 2
scaleDownDelaySeconds: 86400
template:
metadata:
annotations:
update: "2023-07-14T01:04:34.662239161Z"
creationTimestamp: null
labels:
app: bluegreen-scaledowndelay
spec:
containers:
- image: nginx:1.19-alpine
name: bluegreen-scaledowndelay
resources:
requests:
cpu: 1m
memory: 16Mi
status:
HPAReplicas: 1
availableReplicas: 1
blueGreen:
activeSelector: 7476f947b5
canary: {}
conditions:
- lastTransitionTime: "2023-07-14T01:04:29Z"
lastUpdateTime: "2023-07-14T01:04:29Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
- lastTransitionTime: "2023-07-14T01:04:34Z"
lastUpdateTime: "2023-07-14T01:04:34Z"
message: Rollout is healthy
reason: RolloutHealthy
status: "True"
type: Healthy
- lastTransitionTime: "2023-07-14T01:04:29Z"
lastUpdateTime: "2023-07-14T01:04:34Z"
message: ReplicaSet "bluegreen-scaledowndelay-7476f947b5" has successfully progressed.
reason: NewReplicaSetAvailable
status: "True"
type: Progressing
- lastTransitionTime: "2023-07-14T01:04:34Z"
lastUpdateTime: "2023-07-14T01:04:34Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
currentPodHash: 7476f947b5
observedGeneration: "1"
phase: Healthy
readyReplicas: 1
replicas: 1
selector: app=bluegreen-scaledowndelay,rollouts-pod-template-hash=7476f947b5
stableRS: 7476f947b5
updatedReplicas: 1
2023-07-14T01:04:29Z Normal RolloutUpdated Rollout updated to revision 1
2023-07-14T01:04:29Z Normal NewReplicaSetCreated Created ReplicaSet bluegreen-scaledowndelay-7476f947b5 (revision 1)
2023-07-14T01:04:29Z Normal ScalingReplicaSet Scaled up ReplicaSet bluegreen-scaledowndelay-7476f947b5 (revision 1) from 0 to 1
2023-07-14T01:04:29Z Normal RolloutCompleted Rollout completed update to revision 1 (7476f947b5): Initial deploy
2023-07-14T01:04:34Z Normal SwitchService Switched selector for service 'bluegreen-scaledowndelay-active' from '' to '7476f947b5'
time="2023-07-14T01:06:34Z" level=info msg="Deleting e2e-test-name=TestBlueGreenScaleDownDelay"
W0714 01:06:35.057158 17078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0714 01:06:35.061846 17078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
--- FAIL: TestFunctionalSuite/TestBlueGreenScaleDownDelay (126.92s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestFunctionalSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 8m 9s]
Raw output
Failed
=== RUN TestFunctionalSuite
time="2023-07-14T01:04:02Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestFunctionalSuite (489.23s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestRollbackSuite/TestRollbackAnalysisWithinWindow (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 2s]
Raw output
Failed
=== RUN TestRollbackSuite/TestRollbackAnalysisWithinWindow
time="2023-07-14T01:13:04Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisWithinWindow"
time="2023-07-14T01:13:04Z" level=info msg="rollout.argoproj.io/window created\n" rollout=window
time="2023-07-14T01:13:04Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-07-14T01:13:06Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=window
time="2023-07-14T01:13:06Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-07-14T01:13:06Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-07-14T01:13:06Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=window
time="2023-07-14T01:13:06Z" level=error msg="AnalysisRun expectation 'analysisrun count == 1' failed" rollout=window
Name: window
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/2
SetWeight: 50
ActualWeight: 0
Images: nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
Desired: 2
Current: 2
Updated: 0
Ready: 2
Available: 2
NAME KIND STATUS AGE INFO
⟳ window Rollout �[94m◌�[0m Progressing 2s
├──# revision:2
│ └──⧉ �[33mwindow-5658c69dbb�[0m ReplicaSet �[94m◌�[0m Progressing 0s �[33mcanary�[0m
│ └──□ window-5658c69dbb-6fspx Pod �[94m◌�[0m Pending 0s ready:0/1
└──# revision:1
└──⧉ �[32mwindow-c64cf84f6�[0m ReplicaSet �[32m✔�[0m Healthy 2s �[32mstable�[0m
├──□ window-c64cf84f6-5l2tc Pod �[32m✔�[0m Running 2s ready:1/1
└──□ window-c64cf84f6-c5r64 Pod �[32m✔�[0m Running 2s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "1"
creationTimestamp: "2023-07-14T01:13:04Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestRollbackAnalysisWithinWindow
rev: two
name: window
namespace: default
resourceVersion: "15728"
uid: 08ff707e-4dff-41ef-8ca1-9c52e84473d8
spec:
replicas: 2
rollbackWindow:
revisions: 2
selector:
matchLabels:
app: window
strategy:
canary:
steps:
- setWeight: 50
- analysis:
analysisRunMetadata: {}
args:
- name: rev
valueFrom:
fieldRef:
fieldPath: metadata.labels['rev']
templates:
- templateName: sleep-job
template:
metadata:
creationTimestamp: null
labels:
app: window
rev: two
spec:
containers:
- image: nginx:1.19-alpine
name: basic
resources:
requests:
cpu: 1m
memory: 16Mi
status:
HPAReplicas: 2
availableReplicas: 2
blueGreen: {}
canary: {}
conditions:
- lastTransitionTime: "2023-07-14T01:13:04Z"
lastUpdateTime: "2023-07-14T01:13:04Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
- lastTransitionTime: "2023-07-14T01:13:06Z"
lastUpdateTime: "2023-07-14T01:13:06Z"
message: Rollout is healthy
reason: RolloutHealthy
status: "True"
type: Healthy
- lastTransitionTime: "2023-07-14T01:13:04Z"
lastUpdateTime: "2023-07-14T01:13:06Z"
message: ReplicaSet "window-c64cf84f6" has successfully progressed.
reason: NewReplicaSetAvailable
status: "True"
type: Progressing
- lastTransitionTime: "2023-07-14T01:13:06Z"
lastUpdateTime: "2023-07-14T01:13:06Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
currentPodHash: c64cf84f6
currentStepHash: 7dd87d6d74
currentStepIndex: 2
observedGeneration: "2"
phase: Healthy
readyReplicas: 2
replicas: 2
selector: app=window
stableRS: c64cf84f6
updatedReplicas: 2
2023-07-14T01:13:04Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (c64cf84f6)
2023-07-14T01:13:04Z Normal RolloutUpdated Rollout updated to revision 1
2023-07-14T01:13:04Z Normal NewReplicaSetCreated Created ReplicaSet window-c64cf84f6 (revision 1)
2023-07-14T01:13:04Z Normal ScalingReplicaSet Scaled up ReplicaSet window-c64cf84f6 (revision 1) from 0 to 2
2023-07-14T01:13:04Z Normal RolloutCompleted Rollout completed update to revision 1 (c64cf84f6): Initial deploy
2023-07-14T01:13:06Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (5658c69dbb)
2023-07-14T01:13:06Z Normal RolloutUpdated Rollout updated to revision 2
2023-07-14T01:13:06Z Normal NewReplicaSetCreated Created ReplicaSet window-5658c69dbb (revision 2)
2023-07-14T01:13:06Z Normal ScalingReplicaSet Scaled up ReplicaSet window-5658c69dbb (revision 2) from 0 to 1
time="2023-07-14T01:13:06Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisWithinWindow"
time="2023-07-14T01:13:06Z" level=info msg="Deleting e2e-test-name"
--- FAIL: TestRollbackSuite/TestRollbackAnalysisWithinWindow (2.76s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestRollbackSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 44s]
Raw output
Failed
=== RUN TestRollbackSuite
time="2023-07-14T01:12:23Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2023-07-14T01:12:23Z" level=info msg="rollout.argoproj.io/window created\n"
--- FAIL: TestRollbackSuite (44.51s)
Check notice on line 0 in .github
github-actions / E2E Tests Published Test Results
5 skipped tests found
There are 5 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
Check notice on line 0 in .github
github-actions / E2E Tests Published Test Results
97 tests found
There are 97 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite