Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

formulae: adjust testing behaviour. #446

Merged
merged 1 commit into from Jul 29, 2020
Merged

formulae: adjust testing behaviour. #446

merged 1 commit into from Jul 29, 2020

Conversation

MikeMcQuaid
Copy link
Member

  • when testing a formula as a dependent of another: retry the test on failures (requires test: add flag to retry. brew#8135)
  • when testing a added/modified formula:
    • don't retry the test (we want to know if it's flaky)
    • don't try to test dependents if the test fails

This should improve both the reliability and performance of PRs with large numbers of dependents.

- when testing a formula as a dependent of another: retry the test on
  failures (requires Homebrew/brew#8135)
- when testing a added/modified formula:
    - don't retry the test (we want to know if it's flaky)
    - don't try to test dependents if the test fails

This should improve both the reliability and performance of PRs with
large numbers of dependents.
@MikeMcQuaid MikeMcQuaid merged commit 7c3ccb3 into Homebrew:master Jul 29, 2020
@MikeMcQuaid MikeMcQuaid deleted the check-retry-tests branch July 29, 2020 11:21
test "brew", "test", "--verbose", formula_name

steps.last.passed?
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Considering it is called test_passed_or_missing, don't we want:

Suggested change
steps.last.passed?
steps.last.passed?
else
true

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, it was there in a previous iteration, I swear 😅.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Homebrew Homebrew locked as resolved and limited conversation to collaborators Dec 12, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants