Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Feb 10, 2026

Fix Workflow Compiler Integration Tests

The tests TestCompileWorkflowWithRuntimesAppliedToSteps and TestCompileWorkflowWithGoRuntimeWithoutGoMod are failing because they check for outdated action SHA hashes that no longer match the current action pins.

Root Cause

  • Action pins were updated in pkg/workflow/data/action_pins.json
  • Tests have hardcoded SHA values that are now outdated:
    • actions/setup-node: Old SHA 395ad3262231945c25e8478fd5baf05154b1d79f → Current SHA 6044e13b5dc448c55e2357c09f80417699197238 (v6.2.0)
    • actions/setup-go: Old SHA 4dc6199c7b1a012772edbd06daecab0f50c9053c → Current SHA 7a3fe6cf4cb3a834922a1244abfce67bcef6a0c5 (v6.2.0)

Plan

  • Analyze workflow logs and identify root cause
  • Update test to use current action pin SHA for setup-node
  • Update test to use current action pin SHA for setup-go
  • Run tests to verify fixes
  • Run full test suite to ensure no regressions
Original prompt

Fix the failing GitHub Actions workflow Integration: Workflow Compiler
Analyze the workflow logs, identify the root cause of the failure, and implement a fix.
Job ID: 63122570022
Job URL: https://github.com/github/gh-aw/actions/runs/21870140293/job/63122570022


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
@pelikhan pelikhan marked this pull request as ready for review February 10, 2026 15:14
Copilot AI review requested due to automatic review settings February 10, 2026 15:14
@pelikhan pelikhan merged commit a137a7b into pinsupdate Feb 10, 2026
@pelikhan pelikhan deleted the copilot/fix-github-actions-workflow-060f18ce-b517-44d2-b34f-0a1b271bb746 branch February 10, 2026 15:14
Copilot AI requested a review from pelikhan February 10, 2026 15:15
Copilot stopped work on behalf of pelikhan due to an error February 10, 2026 15:15
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates workflow compiler integration tests to align with the current pinned SHAs in pkg/workflow/data/action_pins.json, fixing failures caused by outdated hardcoded hashes.

Changes:

  • Update expected actions/setup-node pinned SHA in TestCompileWorkflowWithRuntimesAppliedToSteps.
  • Update expected actions/setup-go pinned SHA in TestCompileWorkflowWithGoRuntimeWithoutGoMod.
Comments suppressed due to low confidence (1)

pkg/workflow/runtime_integration_test.go:360

  • This test hardcodes the actions/setup-go pinned SHA, which will require future manual updates whenever action_pins.json changes. To keep the test stable while still validating pinning, compute the expected SHA/reference from the pins (e.g., resolve actions/setup-go@v6 through GetActionPinWithData) and assert against the computed value.
	if !strings.Contains(lockStr, "actions/setup-go@7a3fe6cf4cb3a834922a1244abfce67bcef6a0c5") {
		t.Error("Expected actions/setup-go action in lock file")
	}

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.


// Verify that Node.js setup step is included with version 22
if !strings.Contains(lockStr, "actions/setup-node@395ad3262231945c25e8478fd5baf05154b1d79f") {
if !strings.Contains(lockStr, "actions/setup-node@6044e13b5dc448c55e2357c09f80417699197238") {
Copy link

Copilot AI Feb 10, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These integration assertions hardcode the pinned commit SHA. This has already proven brittle when action_pins.json changes; consider deriving the expected SHA via the same pin-resolution code used by the compiler (e.g., resolve actions/setup-node@v6 through GetActionPinWithData / pins data) and asserting against that value instead of an inlined hash.

This issue also appears on line 358 of the same file.

Suggested change
if !strings.Contains(lockStr, "actions/setup-node@6044e13b5dc448c55e2357c09f80417699197238") {
if !strings.Contains(lockStr, "actions/setup-node@") {

Copilot uses AI. Check for mistakes.
pelikhan added a commit that referenced this pull request Feb 10, 2026
* updated pins

* [WIP] Fix integration tests for updated pins (#14791)

* Initial plan

* Initial plan for fixing integration tests

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

* Update integration tests with new action pins

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

* [WIP] Fix failing GitHub Actions workflow Integration: Workflow Compiler (#14792)

* Initial plan

* Update action pin SHAs in runtime integration tests

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

* [WIP] Fix failing GitHub Actions workflow runtime and setup (#14796)

* Initial plan

* Fix TestRuntimeSetupIntegration by updating setup-node SHA

Update the test expectation to use the current SHA for actions/setup-node@v6.2.0
(6044e13b5dc448c55e2357c09f80417699197238) instead of the outdated SHA
(395ad3262231945c25e8478fd5baf05154b1d79f). The action_pins.json file was
recently updated with newer action SHAs, and this test needed to be synchronized.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

* Add retry logic for transient GitHub API errors in live integration test (#14799)

* Initial plan

* Add retry logic for transient GitHub API errors in frontmatter hash test

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

* Address code review feedback: extract retry config constants and scope core mock

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: Peli de Halleux <pelikhan@users.noreply.github.com>

---------

Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants