You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We currently don't have a complete test suite set up for CodeFlare. This resulted in our 0.0.2 release being a broken release. We should come up with a test plan for the CodeFlare operator, have it reviewed by the team, and create follow-on tasks for the implementation.
Unit tests -- testing specific functions within your code, use whatever you want
e2e tests -- Use either envtest (for a scaled down k8s cluster), OpenShift Local, Kind, or a fullblow OpenShift/k8s cluster, make sure your controller/operator performs correctly after a series of inputs.
Scorecard tests -- Deploy your operator via OLM, run through inbuilt tests + a number of custom test cases with inputs/expected outputs. We should investigate using kuttl for the custom test cases.
Integration tests -- Deploy your Operator on an actual OpenShift environment, Run through a number of test cases with inputs/expected outputs. We should think about wider integrations (such as that with ODH through the distributed workloads component) here too.
The text was updated successfully, but these errors were encountered:
The most basic form of operator e2e test that any contributor should run before pushing the bundle is described in testing-operator-deployment-on-openshift which is basically:
Create the bundle and push new bundle image to a registry.
Create a local file based catalog and push the image a registry. A free registry for temporarily store the bundle and catalog images.
Create og, catsrc, and sub on a local OCP cluster.
The most basic form of operator e2e test that any contributor should run before pushing the bundle is described in testing-operator-deployment-on-openshift which is basically:
Create the bundle and push new bundle image to a registry.
Create a local file based catalog and push the image a registry. A free registry for temporarily store the bundle and catalog images.
Create og, catsrc, and sub on a local OCP cluster.
We currently don't have a complete test suite set up for CodeFlare. This resulted in our 0.0.2 release being a broken release. We should come up with a test plan for the CodeFlare operator, have it reviewed by the team, and create follow-on tasks for the implementation.
Unit tests -- testing specific functions within your code, use whatever you want
e2e tests -- Use either envtest (for a scaled down k8s cluster), OpenShift Local, Kind, or a fullblow OpenShift/k8s cluster, make sure your controller/operator performs correctly after a series of inputs.
Scorecard tests -- Deploy your operator via OLM, run through inbuilt tests + a number of custom test cases with inputs/expected outputs. We should investigate using kuttl for the custom test cases.
Integration tests -- Deploy your Operator on an actual OpenShift environment, Run through a number of test cases with inputs/expected outputs. We should think about wider integrations (such as that with ODH through the distributed workloads component) here too.
The text was updated successfully, but these errors were encountered: