Add scs-0210-v2 and scs-0214-v1 zuul checks #714
Conversation
matofeder
force-pushed
the
add_scs_checks
branch
6 times, most recently
from
50db324
to
8c30a42
Compare
|
Build succeeded (e2e-quick-test pipeline). ✔️ k8s-cluster-api-provider-e2e-quick SUCCESS in 24m 06s Warning: Sonobouy results=== Collecting results === time="2024-03-04T15:56:30Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-03-04T15:56:30Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-03-04T15:56:30Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7393 Passed: 5 Failed: 0 Skipped: 7388Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 5 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 4 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-04 15:56:36 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. |
|
Build succeeded (e2e-test pipeline). ✔️ k8s-cluster-api-provider-e2e-conformance SUCCESS in 2h 14m 00s Warning: Sonobouy results=== Collecting results === time="2024-03-04T17:46:21Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-03-04T17:46:21Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-03-04T17:46:21Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: systemd-logs Status: passed Total: 4 Passed: 4 Failed: 0 Skipped: 0Plugin: e2e Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-04 17:46:27 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-04 17:46:27 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-04 17:46:27 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-04 17:46:27 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 1 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-04 17:46:27 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. All E2E namespaces deleted |
matofeder
force-pushed
the
add_scs_checks
branch
from
8c30a42
to
1df9f7e
Compare
|
Build failed (e2e-quick-test pipeline). ❌ k8s-cluster-api-provider-e2e-quick FAILURE in 34m 50s Warning: Sonobouy results=== Collecting results === time="2024-03-07T14:42:13Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-03-07T14:42:14Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-03-07T14:42:14Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7393 Passed: 5 Failed: 0 Skipped: 7388Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 5 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 4 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-07 14:42:22 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. |
matofeder
force-pushed
the
add_scs_checks
branch
from
1df9f7e
to
eebdcc6
Compare
matofeder
force-pushed
the
add_scs_checks
branch
from
eebdcc6
to
087b22d
Compare
Signed-off-by: Matej Feder <matej.feder@dnation.cloud>
matofeder
force-pushed
the
add_scs_checks
branch
from
d6ad8a1
to
e70b1cc
Compare
|
Build canceled (e2e-test pipeline). |
|
Build succeeded (e2e-quick-test pipeline). ✔️ k8s-cluster-api-provider-e2e-quick SUCCESS in 35m 04s Warning: SCS Compliance resultsTesting SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/src/github.com/SovereignCloudStack/k8s-cluster-api-provider/terraform/pr714-24c2fe.yaml.gx-scs-zuul. INFO: The K8s cluster version 1.28.7 of cluster 'pr714-24c2fe-admin@pr714-24c2fe' is still in the recency time window.... returned 0 errors, 0 aborts Testing standard Kubernetes node distribution and availability ... Testing standard CNCF Kubernetes conformance ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v2: PASSED Testing standard Kubernetes version policy ... Testing standard Kubernetes node distribution and availability ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v1: PASSED Sonobouy results=== Collecting results === time="2024-03-21T14:20:53Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-03-21T14:20:53Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-03-21T14:20:53Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7393 Passed: 5 Failed: 0 Skipped: 7388Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 6 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 5 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-21 14:21:01 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. |
|
Build failed (e2e-test pipeline). ❌ k8s-cluster-api-provider-e2e-conformance FAILURE in 2h 42m 19s |
There was a problem hiding this comment.
LGTM
I am just wondering, why we do not see Sonobouy results from the last failure #714 (comment)
Good point, this is because I moved |
This commit introduces the always block in the sonobuoy.yaml as well as in the scs_compliance.yaml and moves the "parse" tasks and "Insert ... results to the warning message..." tasks there. This should ensure that results from failed checks will be returned by Zuul. Signed-off-by: Matej Feder <matej.feder@dnation.cloud>
|
Build succeeded (e2e-quick-test pipeline). ✔️ k8s-cluster-api-provider-e2e-quick SUCCESS in 40m 54s Warning: SCS Compliance resultsTesting SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/src/github.com/SovereignCloudStack/k8s-cluster-api-provider/terraform/pr714-038f6c.yaml.gx-scs-zuul. INFO: The K8s cluster version 1.28.7 of cluster 'pr714-038f6c-admin@pr714-038f6c' is still in the recency time window.... returned 0 errors, 0 aborts Testing standard Kubernetes node distribution and availability ... Testing standard CNCF Kubernetes conformance ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v2: PASSED Testing standard Kubernetes version policy ... Testing standard Kubernetes node distribution and availability ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v1: PASSED Sonobouy results=== Collecting results === time="2024-03-22T08:34:00Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-03-22T08:34:00Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-03-22T08:34:00Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7393 Passed: 5 Failed: 0 Skipped: 7388Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-22 08:34:07 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-22 08:34:07 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-22 08:34:07 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-22 08:34:07 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 6 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-22 08:34:07 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. |
|
Build failed (e2e-test pipeline). ❌ k8s-cluster-api-provider-e2e-conformance FAILURE in 2h 40m 04s Warning: Sonobouy results=== Collecting results === time="2024-03-22T10:34:13Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-03-22T10:34:13Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-03-22T10:34:13Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: systemd-logs Status: passed Total: 6 Passed: 6 Failed: 0 Skipped: 0Plugin: e2e Failed tests: Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-03-22 10:34:21 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-03-22 10:34:21 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-03-22 10:34:21 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-03-22 10:34:21 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 1 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-03-22 10:34:21 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. All E2E namespaces deleted |
Closes #715