Skip to content

Conversation

Copilot
Copy link
Contributor

@Copilot Copilot AI commented Aug 7, 2025

The BDD tests in the staging workflow were previously only generating warnings when they failed, with a message indicating that failures were "expected". Since the tests now pass consistently, this PR updates the workflow to properly gate on BDD test failures.

Changes Made

Before:

  • BDD test failures showed ⚠️ BDD tests failed (this is expected as step definitions are not yet implemented)
  • Used separate bdd_exit_code variable that didn't affect the overall workflow result
  • Comment indicated "don't fail on BDD tests for now"

After:

  • BDD test failures now show ❌ BDD tests failed (no longer suggesting failures are expected)
  • BDD test failures now properly set exit_code=1 to fail the entire workflow
  • Removed the comment about not failing on BDD tests
  • Simplified variable naming (bdd_result instead of bdd_exit_code)

Testing

The workflow logic was validated with test scenarios covering:

  • BDD tests pass → workflow succeeds
  • BDD tests fail → workflow fails
  • Basic tests fail, BDD tests pass → workflow fails (maintains existing behavior)
  • Both test types fail → workflow fails

The service cleanup and exit code handling remain unchanged, ensuring the staging service is properly stopped regardless of test outcomes.

Fixes #243.


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Copy link
Contributor Author

Copilot AI commented Aug 7, 2025

@dannystaple 👋 This repository doesn't have Copilot instructions. With Copilot instructions, I can understand the repository better, work faster and produce higher quality PRs.

I can generate a .github/copilot-instructions.md file for you automatically. Click here to open a pre-filled issue and assign it to me. I'll write the instructions, and then tag you for review.

Co-authored-by: dannystaple <426859+dannystaple@users.noreply.github.com>
@Copilot Copilot AI changed the title [WIP] Make the bdd tests exit code gating Make BDD tests exit code gating in staging workflow Aug 7, 2025
Copilot finished work on behalf of dannystaple August 7, 2025 14:38
@Copilot Copilot AI requested a review from dannystaple August 7, 2025 14:38
Copy link
Contributor

github-actions bot commented Aug 7, 2025

🦙 MegaLinter status: ❌ ERROR

Descriptor Linter Files Fixed Errors Warnings Elapsed time
❌ ACTION actionlint 5 6 0 0.07s
✅ BASH bash-exec 1 0 0 0.0s
✅ BASH shellcheck 1 0 0 0.04s
⚠️ BASH shfmt 1 1 0 0.01s
❌ C cppcheck 8 8 0 0.26s
❌ CPP cppcheck 8 8 0 0.27s
✅ JSON npm-package-json-lint yes no no 0.37s
✅ JSON v8r 12 0 0 8.01s
❌ MARKDOWN markdown-link-check 736 213 0 35.31s
✅ REPOSITORY gitleaks yes no no 12.81s
✅ REPOSITORY git_diff yes no no 0.33s
✅ REPOSITORY grype yes no no 36.23s
✅ REPOSITORY secretlint yes no no 43.14s
✅ REPOSITORY syft yes no no 1.96s
✅ REPOSITORY trivy-sbom yes no no 3.24s
✅ REPOSITORY trufflehog yes no no 4.65s
✅ XML xmllint 1 0 0 192.14s
✅ YAML v8r 13 0 0 7.11s

See detailed report in MegaLinter reports

MegaLinter is graciously provided by OX Security

@dannystaple dannystaple marked this pull request as ready for review August 7, 2025 20:29
@dannystaple dannystaple merged commit fd452e8 into master Aug 7, 2025
8 checks passed
@dannystaple dannystaple deleted the copilot/fix-243 branch August 7, 2025 20:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Make the bdd tests exit code gating
2 participants