Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split the integration tests into "fast" and "slow" sets #1554

Open
odisseus opened this issue Aug 28, 2020 · 0 comments
Open

Split the integration tests into "fast" and "slow" sets #1554

odisseus opened this issue Aug 28, 2020 · 0 comments
Labels
enhancement New feature or request infrastructure Relates to infrastructure around Fury minor An annoyance, but not serious testing Relates to testing and testability
Projects
Milestone

Comments

@odisseus
Copy link
Collaborator

Some integration tests are decidedly slower than others. As far as I know, slowness is mostly caused by compilation (especially if external layers are involved) and also by importing of said layers, but the certain way to check that is inspecting the timestamps in the CI logs.

I think the tests should be split into two sets: the fast ones (those that take less than 10 seconds in CI) and the slow ones. The CI runner should start the slow set after the fast set passes.

There should also be a single command to run all the sets (fast, slow, and pending) in succession.

@odisseus odisseus added enhancement New feature or request infrastructure Relates to infrastructure around Fury minor An annoyance, but not serious testing Relates to testing and testability labels Aug 28, 2020
@propensive propensive added this to scoped in release via automation Aug 31, 2020
@propensive propensive modified the milestones: Tisiphone, 1.0.0 Aug 31, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request infrastructure Relates to infrastructure around Fury minor An annoyance, but not serious testing Relates to testing and testability
Projects
release
  
scoped
Development

No branches or pull requests

2 participants