Skip to content

Conversation

@MariusStorhaug
Copy link
Member

@MariusStorhaug MariusStorhaug commented Feb 22, 2025

Description

This pull request includes several updates to the GitHub Actions workflow configuration and test files to improve the handling and reporting of test outcomes and conclusions.

Enhancements to GitHub Actions workflow:

  • .github/workflows/Action-Test.yml
    • Added outputs for outcome and conclusion to multiple jobs, including ActionTest1Simple, ActionTest1SimpleFailure, ActionTest2Standard, and ActionTest3Advanced.
    • Introduced a new job CatchJob to aggregate and display the results of all test jobs in a table format, and to check if all jobs passed their expected outcomes and conclusions.

Updates to individual test cases:

  • action.yml: Added a new step to check the Passed status of tests and exit with an error if the tests did not pass, which in turn makes the caller be able to distinguish if the job failed and allows them to act accordingly. We are using this mechanism in the CatchJob step of the Action-Test workflow to aggregate all status.
  • tests/1-Simple-Failure/Failure.Tests.ps1: Added a new test case to intentionally fail by asserting that true should be false, which is required for testing failure scenarios.

Type of change

  • 📖 [Docs]
  • 🪲 [Fix]
  • 🩹 [Patch]
  • ⚠️ [Security fix]
  • 🚀 [Feature]
  • 🌟 [Breaking change]

Checklist

  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas

@MariusStorhaug MariusStorhaug self-assigned this Feb 22, 2025
… outcome and conclusion logs, and aggregate results in a summary table
…s as GitHub outputs, and modify grouping logic in Helpers and main scripts for expanded path handling
…ce outcome/conclusion handling for improved clarity and reporting
@MariusStorhaug MariusStorhaug merged commit 2ace31a into main Feb 22, 2025
10 checks passed
@MariusStorhaug MariusStorhaug deleted the generatefailure branch February 22, 2025 13:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

🩹 [Patch]: Should the task fail by default, but be configurable?

2 participants