Skip to content

Commit

Permalink
sdcicd-1198 add test skips to conformance job
Browse files Browse the repository at this point in the history
  • Loading branch information
ritmun committed Apr 26, 2024
1 parent 6c71971 commit c8c9ca3
Show file tree
Hide file tree
Showing 2 changed files with 43 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,46 @@ tests:
env:
CONFIGS: aws,stage,blocking-suite
INSTALL_LATEST_NIGHTLY: "4.15"
OCP_TEST_SKIP_REGEX: Managed cluster should have same number of Machines and
Nodes\| Managed cluster should [apigroup:config.openshift.io] start all core
operators\| Services should fail health check node port if there are only
terminating endpoints\| Services should function for node-Service\|Services
should function for client IP based session affinity\| Services should function
for client IP based session affinity\|Pods should function for node-pod communication
\| Netpol NetworkPolicy between server and client should enforce ingress policy
allowing any port traffic to a server on a specific protocol\| Services should
function for endpoint-Service \| Pods Extended Pod Container lifecycle evicted
pods should be terminal\| Deployment should not disrupt a cloud load-balancer's
connectivity during rollout\| Services should serve endpoints on same port
and different protocol for internal traffic on Type LoadBalancer\| Services
should be rejected for evicted pods (no endpoints exist)\| Prometheus [apigroup:image.openshift.io]
when installed on the cluster should start and expose a secured proxy and
unsecured metrics\| oc builds complex build webhooks CRUD\| oc basics can
show correct whoami result\| OAuth server has the correct token and certificate
fallback semantics\| oc basics can get version information from API\| Prometheus
[apigroup:image.openshift.io] when installed on the cluster should have a
AlertmanagerReceiversNotConfigured alert in firing state\| CPU Partitioning
cluster infrastructure should be configured correctly\| CPU Partitioning cluster
platform workloads should be annotated correctly for Deployments\| Managed
cluster should ensure platform components have system-* priority class associated\|
well-known endpoint should be reachable\| Managed cluster should set requests
but not limits\| users can manipulate groups\| Managed cluster should only
include cluster daemonsets that have maxUnavailable or maxSurge update of
10 percent or maxUnavailable of 33 percent\| Managed cluster should ensure
control plane pods do not run in best-effort QoS\| anonymous browsers should
get a 403 from \| oc builds complex build start-build \| CPU Partitioning
cluster platform workloads should be annotated correctly for DaemonSets \|
oc tag should work when only imagestreams api is available\| The HAProxy router
should expose prometheus metrics for a route\| Prometheus [apigroup:image.openshift.io]
when installed on the cluster shouldn't have failing rules evaluation \| local
kubeconfig "lb-ext.kubeconfig" should be present on all masters and work \|
oc adm must-gather runs successfully for audit logs \| OpenShift alerting
rules [apigroup:image.openshift.io] should have description and summary annotations\|
OpenShift alerting rules [apigroup:image.openshift.io] should have a valid
severity label \| OpenShift alerting rules [apigroup:image.openshift.io] should
have a runbook_url annotation if the alert is critical \| API LBs follow /readyz
of kube-apiserver and stop sending requests before server shutdowns for external
clients
SECRET_LOCATIONS: /usr/local/osde2e-common,/usr/local/osde2e-trt-credentials
SKIP_CLUSTER_HEALTH_CHECKS: "true"
SKIP_DESTROY_CLUSTER: "true"
Expand Down
3 changes: 3 additions & 0 deletions ci-operator/step-registry/osde2e/test/osde2e-test-ref.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,9 @@ ref:
- name: INSTALL_LATEST_NIGHTLY
default: ""
documentation: "Defines the version (major.minor) to install latest nightly image."
- name: OCP_TEST_SKIP_REGEX
default: ""
documentation: "Regex for ocp test specs to skip."
documentation: |-
Calls the service delivery osde2e framework to test all aspects of Managed OpenShift
Clusters (OSD, ROSA, ROSA HCP).
Expand Down

0 comments on commit c8c9ca3

Please sign in to comment.