Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a way to run tests in a user-specified order #47

Open
mjambon opened this issue Mar 27, 2024 · 0 comments
Open

Add a way to run tests in a user-specified order #47

mjambon opened this issue Mar 27, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@mjambon
Copy link
Member

mjambon commented Mar 27, 2024

Use cases include:

  • alphabetic ordering (or other normalization)
  • random order to check that tests are independent of one another
  • grouping by "speed": running the tests that are more likely to fail first = decreasing (duration * probability of failure); combined with an option to abort as soon as one test fails (Add an option for early abort #3).

It's not clear how this should be done. One idea is to pass an identifier for the desired order (./test --sort alpha) on the command line and expect the user code to consult this identifier and sort the test list accordingly (match order with "alpha" -> List.sort ... tests).

@mjambon mjambon added the enhancement New feature or request label Mar 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Development

No branches or pull requests

1 participant