Skip to content

[CI] Fail tests validation run if vscode extensions tests fail #9691

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Jun 5, 2025

Conversation

radical
Copy link
Member

@radical radical commented Jun 4, 2025

Instead of using special test-job-result files, use a simplified condition that checks the results of all the jobs and fails the run if any of them has failed. This simplifies the whole thing and automatically adds support for the vscode extensions job.

This also means that the number of artifacts produced is reduced by a lot.

Fixes #9690

@github-actions github-actions bot added the area-engineering-systems infrastructure helix infra engineering repo stuff label Jun 4, 2025
@radical radical marked this pull request as ready for review June 4, 2025 20:03
@Copilot Copilot AI review requested due to automatic review settings June 4, 2025 20:03
@radical radical added the NO-MERGE The PR is not ready for merge yet (see discussion for detailed reasons) label Jun 4, 2025
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces changes in the CI workflow to ensure that the tests validation run fails if any dependency job fails, including the VS Code extensions tests.

  • Update the command to package the VSIX file
  • Reformat the dependency list for better readability
  • Add an explicit step to exit with an error when any dependency fails
Comments suppressed due to low confidence (1)

.github/workflows/tests.yml:210

  • The command 'np' looks like a typo for 'npx', which could unintentionally cause the VSIX packaging to fail. Consider reverting to 'npx' if this is not an intentional change.
run: np @vscode/vsce package --yarn --pre-release -o out/aspire-extension.vsix

@radical radical changed the title [CI] Fail tests validation run if vscode extensions tests fail IGNORE: [CI] Fail tests validation run if vscode extensions tests fail Jun 4, 2025
@radical radical force-pushed the vscode-tests-ci branch from 8ff22af to e5f53ea Compare June 4, 2025 22:18
@radical radical changed the title IGNORE: [CI] Fail tests validation run if vscode extensions tests fail [CI] Fail tests validation run if vscode extensions tests fail Jun 4, 2025
@radical radical removed the NO-MERGE The PR is not ready for merge yet (see discussion for detailed reasons) label Jun 4, 2025
@radical radical added the NO-MERGE The PR is not ready for merge yet (see discussion for detailed reasons) label Jun 4, 2025
@radical radical force-pushed the vscode-tests-ci branch from d412c17 to 4d81bf6 Compare June 4, 2025 23:23
@radical radical removed the NO-MERGE The PR is not ready for merge yet (see discussion for detailed reasons) label Jun 4, 2025
@radical radical enabled auto-merge (squash) June 5, 2025 04:25
@@ -178,7 +178,7 @@ jobs:
requiresTestSdk: true

endtoend_tests:
name: EndToEnd ${{ matrix.os }}
name: EndToEnd Linux
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Assuming in the future we plan on adding the windows and osx matrix and then we'll revert this back?

- name: Compute result
- name: Fail if any dependency failed
# 'skipped' can be when a transitive dependency fails and the dependent job gets 'skipped'.
# For example, one of setup_* jobs failing and the Integration test jobs getting 'skipped'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have a list of all potential values for result? Wondering if it would be best to compare if result does not equal success

Copy link
Member

@joperezr joperezr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor comments but looks good otherwise. Thanks for simplifying this.

@radical radical merged commit 8dd1bbc into dotnet:main Jun 5, 2025
499 of 502 checks passed
@radical radical deleted the vscode-tests-ci branch June 5, 2025 20:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-engineering-systems infrastructure helix infra engineering repo stuff
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CI] Fail tests validation if the new VS Code tests run fails
2 participants