Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip running acceptance tests in GH workflows for PR that does not change SBO nor the testing framework #1150

Merged

Conversation

pmacik
Copy link
Contributor

@pmacik pmacik commented May 25, 2022

Signed-off-by: Pavel Macík pavel.macik@gmail.com

Changes

Currently, the acceptance tests are executed for any and each PR - even for those that for example affects only the docs. In such cases there is no need to actually execute the acceptnace tests as the resulting SBO images as well as the testing framework (incl. scenarios) are exactly the same as those already tested and merged in master.

Not running the acceptance tests for PRs that do not inflict any testable changes would save time significantly to merge such PRs as well as saving resources

Ref: https://issues.redhat.com/browse/APPSVC-1116

Submitter Checklist

As the author of this PR, please check off the items in this checklist:

  • Docs
    included if any changes are user facing
  • Tests
    included if any functionality added or changed. For bugfixes please include tests that can catch regressions
  • All acceptance test scenarios included in the PR which verifies a bugfix or a requested feature reported by a non-member are tagged with @external-feedback tag.
  • Follows the commit message standard

@pmacik pmacik added kind/enhancement New feature or request kind/test ci CI related issues labels May 25, 2022
@pmacik
Copy link
Contributor Author

pmacik commented May 25, 2022

/hold

@pmacik pmacik changed the title Do not run acceptance tests for PR that does not change SBO or testing framework WIP: Do not run acceptance tests for PR that does not change SBO or testing framework May 25, 2022
@pmacik pmacik force-pushed the gha-optional-at branch 6 times, most recently from 61c51f9 to db30a9b Compare May 25, 2022 11:04
@pmacik pmacik changed the title WIP: Do not run acceptance tests for PR that does not change SBO or testing framework Do not run acceptance tests for PR that does not change SBO or testing framework May 25, 2022
@pmacik pmacik changed the title Do not run acceptance tests for PR that does not change SBO or testing framework WIP: Do not run acceptance tests for PR that does not change SBO or testing framework May 25, 2022
@pmacik pmacik changed the title WIP: Do not run acceptance tests for PR that does not change SBO or testing framework WIP: Skip running acceptance tests for PR that does not change SBO or testing framework May 25, 2022
@pmacik pmacik changed the title WIP: Skip running acceptance tests for PR that does not change SBO or testing framework WIP: Skip running acceptance tests for PR that does not change SBO nor the testing framework May 25, 2022
@pmacik
Copy link
Contributor Author

pmacik commented May 25, 2022

/retest

1 similar comment
@pmacik
Copy link
Contributor Author

pmacik commented May 25, 2022

/retest

@pmacik pmacik force-pushed the gha-optional-at branch 7 times, most recently from 49275e8 to 5645687 Compare May 25, 2022 15:20
@pmacik pmacik force-pushed the gha-optional-at branch 3 times, most recently from e93ea2f to fe421ef Compare May 25, 2022 15:28
@pmacik pmacik changed the title WIP: Skip running acceptance tests for PR that does not change SBO nor the testing framework Skip running acceptance tests for PR that does not change SBO nor the testing framework May 25, 2022
@pmacik
Copy link
Contributor Author

pmacik commented May 25, 2022

/unhold

… testing framework

Signed-off-by: Pavel Macík <pavel.macik@gmail.com>
@sadlerap
Copy link
Contributor

Some questions:

  1. This only affects github jobs, not prow jobs, correct?
  2. I noticed that the jobs ran as normal for this PR. Is that expected? If so, how can I test these changes?

@pmacik
Copy link
Contributor Author

pmacik commented May 25, 2022

Yes, this PR only affects GH Actions, Prow jobs (OpenShift CI) are separated in openshift/release#28875

So, until the above PR is merged, the Prow jobs would run as before.

@pmacik pmacik changed the title Skip running acceptance tests for PR that does not change SBO nor the testing framework Skip running acceptance tests in GH workflows for PR that does not change SBO nor the testing framework May 25, 2022
@codecov
Copy link

codecov bot commented May 25, 2022

Codecov Report

Merging #1150 (589d65e) into master (7c2b9fe) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #1150   +/-   ##
=======================================
  Coverage   57.84%   57.84%           
=======================================
  Files          31       31           
  Lines        2697     2697           
=======================================
  Hits         1560     1560           
  Misses        976      976           
  Partials      161      161           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7c2b9fe...589d65e. Read the comment docs.

Copy link
Contributor

@sadlerap sadlerap left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@openshift-ci
Copy link
Contributor

openshift-ci bot commented May 25, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sadlerap

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-robot openshift-merge-robot merged commit ad9085f into redhat-developer:master May 25, 2022
@pmacik pmacik deleted the gha-optional-at branch August 12, 2022 15:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci CI related issues kind/enhancement New feature or request kind/test lgtm
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants