-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add server metadata, soft-anti-affinity and local ssd flavors for gx-scs #742
Conversation
Signed-off-by: Roman Hros <roman.hros@dnation.cloud>
Signed-off-by: Roman Hros <roman.hros@dnation.cloud>
Signed-off-by: Roman Hros <roman.hros@dnation.cloud>
Signed-off-by: Roman Hros <roman.hros@dnation.cloud>
Build failed (e2e-quick-test pipeline). ❌ k8s-cluster-api-provider-e2e-quick TIMED_OUT in 1h 04m 00s Warning: Sonobouy results=== Collecting results === time="2024-06-17T05:36:51Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-06-17T05:36:51Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-06-17T05:36:52Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7394 Passed: 5 Failed: 0 Skipped: 7389Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 6 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 5 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-17 05:36:57 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. |
Fault It seems like there are only two hosts available for "SCS-2V-4-20s" flavor right now, but we have 3 control-plane nodes with an anti-affinity policy here. |
Build succeeded (e2e-quick-test pipeline). ✔️ k8s-cluster-api-provider-e2e-quick SUCCESS in 39m 15s Warning: SCS Compliance resultsTesting SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/src/github.com/SovereignCloudStack/k8s-cluster-api-provider/terraform/pr742-dc6542.yaml.gx-scs-zuul. INFO: The K8s cluster version 1.28.11 of cluster 'pr742-dc6542-admin@pr742-dc6542' is still in the recency time window.... returned 0 errors, 0 aborts Testing standard Kubernetes node distribution and availability ... Testing standard CNCF Kubernetes conformance ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v2: PASSED Testing standard Kubernetes version policy ... Testing standard Kubernetes node distribution and availability ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v1: PASSED Sonobouy results=== Collecting results === time="2024-06-17T07:07:25Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-06-17T07:07:25Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-06-17T07:07:25Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7394 Passed: 5 Failed: 0 Skipped: 7389Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 7 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 6 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-17 07:07:31 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. Custom ENV config
|
After #742 (comment) I tried |
@frosty-geek, I tested the "SCS-2V-4-20s" flavor, but it seems like there are currently only two hosts available for that, is it true? |
I checked and yes atm that is correct, we're in the process of fixing that with a new hardware environment (scs2) which will hopefully hit ~mid july |
There is not enough hosts for local ssd flavors Signed-off-by: Roman Hros <roman.hros@dnation.cloud>
Build failed (e2e-quick-test pipeline). ❌ k8s-cluster-api-provider-e2e-quick FAILURE in 44m 50s Warning: SCS Compliance resultsTesting SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/src/github.com/SovereignCloudStack/k8s-cluster-api-provider/terraform/pr742-9516a8.yaml.gx-scs-zuul. INFO: The K8s cluster version 1.28.11 of cluster 'pr742-9516a8-admin@pr742-9516a8' is still in the recency time window.... returned 0 errors, 0 aborts Testing standard Kubernetes node distribution and availability ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. Testing standard CNCF Kubernetes conformance ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v2: PASSED Testing standard Kubernetes version policy ... Testing standard Kubernetes node distribution and availability ... CRITICAL: [Errno 2] No such file or directory: '/home/ubuntu/scs-compliance/Tests/kaas/k8s-node-distribution/k8s-node-distribution-check.py' Verdict for subject KaaS_V1, SCS Compatible KaaS, version v1: 1 ERRORS Sonobouy results=== Collecting results === time="2024-06-20T12:39:31Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-06-20T12:39:31Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-06-20T12:39:31Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7394 Passed: 5 Failed: 0 Skipped: 7389Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 7 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 2 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:True LastTransitionTime:2024-06-20 12:40:04 +0000 UTC Reason:ContentDeletionFailed Message:Failed to delete all resource types, 1 remaining: unexpected items still remain in namespace: sonobuoy for gvr: /v1, Resource=pods} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 1 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-20 12:39:37 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. |
Signed-off-by: Roman Hros <roman.hros@dnation.cloud>
3cb7595
to
053c40a
Compare
Build failed (e2e-test pipeline). ❌ k8s-cluster-api-provider-e2e-conformance FAILURE in 2h 38m 37s Warning: SCS Compliance resultsINFO: Forced version v2 not (yet) stable Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/src/github.com/SovereignCloudStack/k8s-cluster-api-provider/terraform/pr742-1d3dfd.yaml.gx-scs-zuul. INFO: The K8s cluster version 1.28.11 of cluster 'pr742-1d3dfd-admin@pr742-1d3dfd' is still in the recency time window.... returned 0 errors, 0 aborts Testing standard Kubernetes node distribution and availability ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. Testing standard CNCF Kubernetes conformance ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v2: 1 ERRORS Sonobouy results=== Collecting results === time="2024-06-21T14:48:51Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-06-21T14:48:51Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-06-21T14:48:51Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7394 Passed: 384 Failed: 0 Skipped: 7010Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 5 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 4 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-21 14:48:56 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. All E2E namespaces deleted |
Build canceled (e2e-test pipeline). |
Build succeeded (e2e-test pipeline). ✔️ k8s-cluster-api-provider-e2e-conformance SUCCESS in 2h 47m 02s Warning: SCS Compliance resultsINFO: Forced version v2 not (yet) stable Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/src/github.com/SovereignCloudStack/k8s-cluster-api-provider/terraform/pr742-e24d5b.yaml.gx-scs-zuul. INFO: The K8s cluster version 1.28.11 of cluster 'pr742-e24d5b-admin@pr742-e24d5b' is still in the recency time window.... returned 0 errors, 0 aborts Testing standard Kubernetes node distribution and availability ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. Testing standard CNCF Kubernetes conformance ... Verdict for subject KaaS_V1, SCS Compatible KaaS, version v2: PASSED Sonobouy results=== Collecting results === time="2024-06-24T12:35:07Z" level=info msg="delete request issued" dry-run=false kind=namespace namespace=sonobuoy time="2024-06-24T12:35:07Z" level=info msg="delete request issued" dry-run=false kind=clusterrolebindings names="[sonobuoy-serviceaccount-sonobuoy]" time="2024-06-24T12:35:07Z" level=info msg="delete request issued" dry-run=false kind=clusterroles names="[sonobuoy-serviceaccount-sonobuoy]" Plugin: e2e Status: passed Total: 7394 Passed: 384 Failed: 0 Skipped: 7010Plugin: systemd-logs Run Details: Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 7 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has status {Phase:Terminating Conditions:[{Type:NamespaceDeletionDiscoveryFailure Status:False LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:ResourcesDiscovered Message:All resources successfully discovered} {Type:NamespaceDeletionGroupVersionParsingFailure Status:False LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:ParsedGroupVersions Message:All legacy kube types successfully parsed} {Type:NamespaceDeletionContentFailure Status:False LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:ContentDeleted Message:All content successfully deleted, may be waiting on finalization} {Type:NamespaceContentRemaining Status:True LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:SomeResourcesRemain Message:Some resources are remaining: pods. has 6 resource instances} {Type:NamespaceFinalizersRemaining Status:False LastTransitionTime:2024-06-24 12:35:13 +0000 UTC Reason:ContentHasNoFinalizers Message:All content-preserving finalizers finished}]} Namespace "sonobuoy" has been deleted Deleted all ClusterRoles and ClusterRoleBindings. All E2E namespaces deleted |
Soft-anti-affinity was used in #742 (comment) but control planes were scheduled on the same host. It was not the case in #742 (comment). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Tested by the e2e pipeline and works as expected.
The change looks good to me
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
Fixes #741