Skip to content
This repository has been archived by the owner on Oct 24, 2023. It is now read-only.

test: update kubernetes e2e to use GINKGO_FAIL_FAST parameter value #3660

Merged
merged 4 commits into from Aug 24, 2020

Conversation

haofan-ms
Copy link
Contributor

@haofan-ms haofan-ms commented Aug 3, 2020

Reason for Change:

Update kubernetes e2e to use GINKGO_FAIL_FAST parameter value

Issue Fixed:

Requirements:

Notes:

@acs-bot acs-bot added the size/S label Aug 3, 2020
@codecov
Copy link

codecov bot commented Aug 3, 2020

Codecov Report

Merging #3660 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #3660   +/-   ##
=======================================
  Coverage   73.17%   73.17%           
=======================================
  Files         147      147           
  Lines       25322    25322           
=======================================
  Hits        18529    18529           
  Misses       5655     5655           
  Partials     1138     1138           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9289247...5618271. Read the comment docs.

@@ -114,7 +114,7 @@ docker run --rm \
-e CUSTOM_KUBE_PROXY_IMAGE="${CUSTOM_KUBE_PROXY_IMAGE}" \
-e IS_JENKINS="${IS_JENKINS}" \
-e SKIP_TEST="${SKIP_TESTS}" \
-e GINKGO_FAIL_FAST=true \
-e GINKGO_FAIL_FAST="${GINKGO_FAIL_FAST}" \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The problem with using any other value than true is that the "focus" and "skip" options stop working. So if you want to use fail fase = false, beware that you won't be able to use focus/skip.

Also, if we make this change, let's make sure to set the default to true at the top of the script, e.g.:

GINKGO_FAIL_FAST="${GINKGO_FAIL_FAST:-true}"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Jack, I am a little confused here. I see on the GINKGO doc it says "When using the command line flags you can specify one or both of --focus and --skip. If both are specified the constraints will be ANDed together." But I am not sure why the GINKGO_FAIL_FAST is also affecting the other two.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Feel free to test and see if my recollection is mistaken!

Copy link
Contributor Author

@haofan-ms haofan-ms Aug 7, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I definitely think you are right, because for now we are suffering the other problem you mentioned, which is GINKGO_SKIP not working (Sorry I failed to see your comments earlier). But it's just confusing me why the design of GINKGO features is like this and it's not documented.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Relevant fix for the conflict between "--failFast" and "--focus/--skip" is in #3738

@jadarsie jadarsie mentioned this pull request Aug 21, 2020
4 tasks
@haofan-ms haofan-ms changed the title fix: update kubernetes e2e to use GINKGO_FAIL_FAST parameter value test: update kubernetes e2e to use GINKGO_FAIL_FAST parameter value Aug 21, 2020
Copy link
Member

@jackfrancis jackfrancis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@acs-bot acs-bot added the lgtm label Aug 24, 2020
@jackfrancis jackfrancis merged commit 0441db3 into Azure:master Aug 24, 2020
@acs-bot
Copy link

acs-bot commented Aug 24, 2020

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: haofan-ms, jackfrancis

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants