Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(make): add e2e test options #2393

Merged
merged 1 commit into from
Oct 6, 2021

Conversation

njhale
Copy link
Member

@njhale njhale commented Oct 4, 2021

  • Add more config options to the e2e and e2e-local test options; e.g.
    E2E_TEST_SEED for reproducing test runs
  • Refactor e2e-local target to extend the e2e target

Signed-off-by: Nick Hale njohnhale@gmail.com

@openshift-ci
Copy link

openshift-ci bot commented Oct 4, 2021

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: njhale

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 4, 2021
@@ -22,5 +22,5 @@ jobs:
run: |
kind create cluster
kind export kubeconfig
- name: Run e2e tests
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These aren't really running e2e tests so much as they're ensuring we can deploy OLM to a specific target; how valuable is this?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had previously attempted to remove these checks entirely but there was some pushback in #olm-dev as they're mainly in place to ensure there's no regression when running OLM on various cluster environments.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But for context, I had renamed this check and simply misjudged what these checks were trying to accomplish when splitting up that e2e-tests GHA workflow into their own workflows.

Comment on lines +130 to +131
E2E_INSTALL_NS ?= operator-lifecycle-manager
E2E_TEST_NS ?= operators
Copy link
Member Author

@njhale njhale Oct 4, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reminder: we need to set the downstream-specific namespaces in the root Makefile downstream before invoking this target; e.g. E2E_INSTALL_NS=openshift-operator-lifecycle-manager E2E_TEST_NS=openshift-operators $(MAKE) ...

@timflannagan
Copy link
Contributor

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Oct 4, 2021
@timflannagan
Copy link
Contributor

CSV metric is preserved - #2390

@openshift-bot
Copy link
Contributor

/retest-required

Please review the full test history for this PR and help us cut down flakes.

1 similar comment
@openshift-bot
Copy link
Contributor

/retest-required

Please review the full test history for this PR and help us cut down flakes.

@timflannagan
Copy link
Contributor

Hold so the bot doesn't go crazy.

/hold

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Oct 5, 2021
- Add more config options to the e2e and e2e-local test options; e.g.
  E2E_TEST_SEED for reproducing test runs
- Refactor e2e-local target to extend the e2e target

Signed-off-by: Nick Hale <njohnhale@gmail.com>
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Oct 5, 2021
@timflannagan
Copy link
Contributor

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Oct 6, 2021
@njhale njhale merged commit 07dd3a0 into operator-framework:master Oct 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants