Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[System Tests] Fix not continuing to run when one job in matrix fails #2209

Conversation

Tankilevitch
Copy link
Contributor

@Tankilevitch Tankilevitch commented Aug 3, 2022

  • Github actions introduced a way to control concurrency so changed to use that instead of the softprops/turnstyle@v1 action
  • Allow other system tests to run even if one of them failed. Used : fail-fast: false.

Comment on lines 159 to 163
continue-on-error: true
strategy:
max-parallel: 1
matrix:
test_component: [api,runtimes,feature_store,projects,model_monitoring,examples,demos,backward_compatibility]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use:

strategy:
  fail-fast: false

You won't need that last step verify-all-system-tests-succeeded as if one of the matrix steps fails, the job will fail but all the matrix steps will run. and continue-on-error is mainly for the next jobs (of which there aren't any), not within the matrix. See:
https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idstrategyfail-fast

Copy link
Member

@quaark quaark left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great stuff!

@Tankilevitch Tankilevitch merged commit ed54118 into mlrun:development Aug 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants