Add integration testing workflow for agentics repository compatibility with build system improvements

[Copilot]

Implements continuous integration testing to ensure that workflows from the external githubnext/agentics repository can be successfully installed and compiled within the gh-aw system, with support for both automatic and manual workflow execution. Also includes build system improvements for better reproducibility.

Problem

The gh-aw project lacked automated testing to verify compatibility with external agentic workflow repositories. This created a risk of regressions where changes to gh-aw could break the ability to install and compile workflows from the broader agentics ecosystem, potentially going undetected until users encountered issues.

Additionally, TypeScript compilation errors in the JavaScript workflow files were preventing proper type checking and could lead to runtime issues. The build system was using npm install --package-lock-only which only updates the lock file without installing dependencies, making development setup inconsistent.

Solution

Integration Testing Workflow

Added a new GitHub Actions workflow at .github/workflows/integration-test-agentics.yml that:

• Triggers automatically on pushes to main branch and pull requests
• Supports manual triggering via workflow_dispatch for on-demand testing and debugging
• Tests end-to-end integration by installing the gh-aw CLI extension locally
• Validates external workflow compatibility by installing workflows from githubnext/agentics
• Ensures compilation works by running make recompile on all installed workflows
• Performs comprehensive validation using the mandatory make agent-finish command

TypeScript Compilation Fixes

Fixed TypeScript compilation issues in the JavaScript workflow files:

• Added proper JSDoc type annotations for parameter types in create_issue.cjs and create_pull_request.cjs
• Added type declarations for Node.js module imports (fs, crypto, child_process)
• Ensured CommonJS compatibility while providing proper TypeScript type checking

Build System Improvements

Updated the development dependency installation process:

• Changed make deps-dev to use npm ci instead of npm install --package-lock-only
• Provides reproducible builds by installing dependencies exactly as specified in package-lock.json
• Better suited for CI/CD environments and consistent development setups

Key Features

The workflow includes robust error handling and follows established CI patterns:

on:
  push:
    branches: [main]
  pull_request:
  workflow_dispatch:  # Enables manual triggering from GitHub UI

- name: Install workflows from agentics repository
  env:
    GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
  run: |
    echo "Installing workflows from githubnext/agentics..."
    gh aw install githubnext/agentics
    echo "Successfully installed agentics workflows"

- name: Recompile all workflows
  run: |
    echo "Recompiling all installed workflows..."
    make recompile
    echo "Successfully recompiled all workflows"

The workflow leverages GitHub Actions' built-in authentication, eliminating the need for explicit GitHub CLI setup steps since runners are pre-authenticated with the provided GITHUB_TOKEN.

Benefits

• Early Detection: Catches integration issues before they reach users
• Ecosystem Compatibility: Ensures gh-aw remains compatible with external workflow repositories
• Regression Prevention: Automated testing prevents breaking changes to core compilation functionality
• Manual Testing Support: Allows developers to run integration tests on demand without creating commits
• Quality Assurance: Validates that the complete install → compile → validate pipeline works correctly
• Type Safety: Eliminates TypeScript compilation errors that could lead to runtime issues
• Reproducible Development: Consistent dependency installation across development environments
• Streamlined Authentication: Uses GitHub Actions' built-in authentication for cleaner CI execution

This addresses the need for comprehensive integration testing while maintaining the project's established CI patterns and quality standards, with additional improvements to the development workflow.

---

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

[pelikhan]

@copilot fix typing issues in .cjs files:

pkg/workflow/js/create_issue.cjs(17,55): error TS7006: Parameter 'label' implicitly has an 'any' type.
pkg/workflow/js/create_issue.cjs(17,85): error TS7006: Parameter 'label' implicitly has an 'any' type.
pkg/workflow/js/create_pull_request.cjs(1,20): error TS2307: Cannot find module 'fs' or its corresponding type declarations.
pkg/workflow/js/create_pull_request.cjs(2,24): error TS2307: Cannot find module 'crypto' or its corresponding type declarations.
pkg/workflow/js/create_pull_request.cjs(3,30): error TS2307: Cannot find module 'child_process' or its corresponding type declarations.
pkg/workflow/js/create_pull_request.cjs(85,55): error TS7006: Parameter 'label' implicitly has an 'any' type.
pkg/workflow/js/create_pull_request.cjs(85,85): error TS7006: Parameter 'label' implicitly has an 'any' type.

[Copilot]

@copilot fix typing issues in .cjs files:

...

Fixed all TypeScript typing issues in the .cjs files. Applied JSDoc type annotations for the label parameters and proper type declarations for Node.js modules. TypeScript compilation now passes without errors. See commit bcbc48c.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

• api.contoso.com
  • Triggering command: /tmp/go-build2487780568/b278/cli.test -test.testlogfile=/tmp/go-build2487780568/b278/testlog.txt -test.paniconexit0 -test.timeout=10m0s -test.v=true (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

• Configure Actions setup steps to set up my environment, which run before the firewall is enabled
• Add the appropriate URLs or hosts to the custom allowlist in this repository's Copilot coding agent settings (admins only)

[pelikhan]

@copilot update tests for updates in .cjs files

[pelikhan]

@copilot remove this step

[Copilot]

Removed the redundant GitHub token setup step. GitHub Actions runners are pre-authenticated with the GITHUB_TOKEN, making the explicit authentication step unnecessary. See commit 8f88f0c.

[Copilot]

@copilot update tests for updates in .cjs files

I investigated the tests for the updated .cjs files and found that no test updates were needed. The existing tests are working correctly with the JSDoc type annotations I added. All tests pass, TypeScript compilation now works without errors, and the complete validation suite (make agent-finish equivalent) passes successfully. The embedded JavaScript content in the tests correctly includes the type annotations, and the tests were checking for functionality rather than specific syntax, so they remain valid.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

• api.contoso.com
  • Triggering command: /tmp/go-build797650975/b278/cli.test -test.testlogfile=/tmp/go-build797650975/b278/testlog.txt -test.paniconexit0 -test.timeout=10m0s -test.v=true (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

• Configure Actions setup steps to set up my environment, which run before the firewall is enabled
• Add the appropriate URLs or hosts to the custom allowlist in this repository's Copilot coding agent settings (admins only)

[pelikhan]

@copilot update make dep-devs to run npm ci

[Copilot]

@copilot update make dep-devs to run npm ci

Updated the make deps-dev target to use npm ci instead of npm install --package-lock-only. This provides reproducible builds by installing dependencies exactly as specified in package-lock.json, which is better suited for development and CI/CD environments. See commit 2fc3b1e.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

• api.contoso.com
  • Triggering command: /tmp/go-build1348483162/b278/cli.test -test.testlogfile=/tmp/go-build1348483162/b278/testlog.txt -test.paniconexit0 -test.timeout=10m0s -test.v=true (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

• Configure Actions setup steps to set up my environment, which run before the firewall is enabled
• Add the appropriate URLs or hosts to the custom allowlist in this repository's Copilot coding agent settings (admins only)