-
Notifications
You must be signed in to change notification settings - Fork 647
[CI] Fail tests validation run if vscode extensions tests fail #9691
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR introduces changes in the CI workflow to ensure that the tests validation run fails if any dependency job fails, including the VS Code extensions tests.
- Update the command to package the VSIX file
- Reformat the dependency list for better readability
- Add an explicit step to exit with an error when any dependency fails
Comments suppressed due to low confidence (1)
.github/workflows/tests.yml:210
- The command 'np' looks like a typo for 'npx', which could unintentionally cause the VSIX packaging to fail. Consider reverting to 'npx' if this is not an intentional change.
run: np @vscode/vsce package --yarn --pre-release -o out/aspire-extension.vsix
…obs instead of using special files
@@ -178,7 +178,7 @@ jobs: | |||
requiresTestSdk: true | |||
|
|||
endtoend_tests: | |||
name: EndToEnd ${{ matrix.os }} | |||
name: EndToEnd Linux |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Assuming in the future we plan on adding the windows and osx matrix and then we'll revert this back?
- name: Compute result | ||
- name: Fail if any dependency failed | ||
# 'skipped' can be when a transitive dependency fails and the dependent job gets 'skipped'. | ||
# For example, one of setup_* jobs failing and the Integration test jobs getting 'skipped' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we have a list of all potential values for result? Wondering if it would be best to compare if result does not equal success
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor comments but looks good otherwise. Thanks for simplifying this.
Instead of using special
test-job-result
files, use a simplified condition that checks the results of all the jobs and fails the run if any of them has failed. This simplifies the whole thing and automatically adds support for the vscode extensions job.This also means that the number of artifacts produced is reduced by a lot.
Fixes #9690