Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: run spec tests against all pg versions, even if one of them fails #1628

Merged
merged 4 commits into from
Oct 16, 2020

Conversation

wolfgangwalther
Copy link
Member

Sometimes the spec tests fail only for older pg versions. It would be cool, if the spec tests would still be run against all versions, even if one of them fails, to get a quick overview of the problem with different versions.

This change tries to do that. I will temporarily push a couple of errors after the first build to confirm it is working as expected.

@wolfgangwalther
Copy link
Member Author

This is only about the nix-build-test step and it works well:

  • when the build fails no tests are run
  • when the build succeeds all tests are run, even if some of them fail

I left the commits in here, so you can still see the pipeline results easily. Please squash this when merging.

Ready to merge.

@steve-chavez
Copy link
Member

Sometimes the spec tests fail only for older pg versions. It would be cool, if the spec tests would still be run against all versions, even if one of them fails, to get a quick overview of the problem with different versions.

Yeah! This is the way it used to work before as well with different circle jobs for each pg test.

Nice improvement :)

Merging.. 🚀

@steve-chavez steve-chavez merged commit 7809708 into PostgREST:master Oct 16, 2020
@wolfgangwalther wolfgangwalther deleted the improve-ci-spec-tests branch October 16, 2020 17:37
monacoremo pushed a commit to monacoremo/postgrest that referenced this pull request Jul 17, 2021
…PostgREST#1628)

- when the build fails no tests are run(circleci-agent step halt)
- when the build succeeds all tests are run, even if some of them fail(when: always)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants