Skip to content

ci: fail nightly integration workflow when zero sandbox tests execute #58

Description

@teesofttech

Why

The scheduled Integration Tests workflow reports success while running 2 PeachPayments tests with 0 passed and 2 skipped. The integration GitHub environment currently has no secrets, so the nightly green check does not validate a gateway.

Scope

  • Add a preflight that validates required secrets for the selected provider.
  • Fail or mark the job neutral/incomplete when zero tests execute successfully.
  • Make the gateway workflow-dispatch input actually filter provider tests.
  • Publish a provider-by-provider result summary.
  • Reduce the schedule or split jobs if credentials are intentionally unavailable.

Acceptance criteria

  • A run with no configured provider credentials cannot conclude as a successful integration test.
  • At least one real sandbox create/verify flow passes on scheduled runs.
  • Manual selection runs only the requested provider.
  • The job summary shows passed, failed, and skipped counts per provider.
  • Secrets remain scoped to the integration environment.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: ci/cdGitHub Actions, release automation, and deploymentarea: testingAutomated test architecture and coveragebugSomething isn't workingpriority: P0Release blocker or urgent security/correctness risk

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions