Skip to content

Create test agentic workflows for Claude and Gemini engines#23

Merged
pelikhan merged 4 commits intomainfrom
copilot/fix-22
Aug 13, 2025
Merged

Create test agentic workflows for Claude and Gemini engines#23
pelikhan merged 4 commits intomainfrom
copilot/fix-22

Conversation

Copy link
Contributor

Copilot AI commented Aug 13, 2025

This PR adds test agentic workflows for Claude and Gemini engines, complementing the existing test-codex.md workflow.

Changes Made

New Workflow Files

test-claude.md

  • Uses Claude engine with claude-3-5-sonnet-20241022 model
  • Triggers on branches containing "claude"
  • Configured with Claude-specific GitHub Action: anthropics/claude-code-base-action@beta
  • Requires ANTHROPIC_API_KEY secret for authentication
  • Includes full MCP tool support and allow-listing

test-gemini.md

  • Uses Gemini engine with default model
  • Triggers on branches containing "gemini"
  • Configured with Gemini-specific GitHub Action: google-github-actions/run-gemini-cli@v1
  • Requires GEMINI_API_KEY secret for authentication
  • Leverages built-in GitHub integration

Consistent Functionality

Both new workflows maintain the same structure and capabilities as the original test-codex.md:

  • Code Review Assistant: Analyzes pull request changes and provides comprehensive summaries
  • MCP Tools: Includes time tool for timestamping analysis
  • GitHub Permissions: Same access levels for contents, pull-requests, issues, and actions
  • Error Handling: Robust error handling with fallback summaries
  • Security: Full XPIA protection and security guidelines

Validation

  • All workflows compile successfully and pass schema validation
  • Generated .lock.yml files are properly formatted GitHub Actions workflows
  • Comprehensive test suite passes with new workflows detected
  • CLI properly recognizes and manages all three test workflows

This enables testing of all three supported agentic engines (Codex, Claude, and Gemini) with consistent PR analysis functionality.

Fixes #22.

Warning

Firewall rules blocked me from connecting to one or more addresses

I tried to connect to the following addresses, but was blocked by firewall rules:

  • api.contoso.com
    • Triggering command: /tmp/go-build2994974611/b255/cli.test -test.testlogfile=/tmp/go-build2994974611/b255/testlog.txt -test.paniconexit0 -test.timeout=10m0s -test.v=true (dns block)
    • Triggering command: /tmp/go-build1221384000/b255/cli.test -test.testlogfile=/tmp/go-build1221384000/b255/testlog.txt -test.paniconexit0 -test.timeout=10m0s -test.v=true (dns block)
    • Triggering command: /tmp/go-build953520881/b255/cli.test -test.testlogfile=/tmp/go-build953520881/b255/testlog.txt -test.paniconexit0 -test.timeout=10m0s -test.v=true (dns block)

If you need me to access, download, or install something from one of these locations, you can either:


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] test agentic workflow for Claude and Gemini Create test agentic workflows for Claude and Gemini engines Aug 13, 2025
Copilot AI requested a review from pelikhan August 13, 2025 05:24
@pelikhan pelikhan marked this pull request as ready for review August 13, 2025 05:26
@pelikhan pelikhan merged commit a45f1c4 into main Aug 13, 2025
6 checks passed
@pelikhan pelikhan deleted the copilot/fix-22 branch August 13, 2025 05:30
@dsyme
Copy link
Contributor

dsyme commented Aug 13, 2025

Could you change these test workflows to not use any part of "agentics" framework please? Make them as simple as possible too, minimum needed to test MCP support is working, and minimal security

The reason is the agentics cabal (includes) will change over time

https://github.com/githubnext/gh-aw/pull/23/files

pelikhan added a commit that referenced this pull request Aug 23, 2025
…) (#211)

* Initial plan

* Remove auto-compile feature and auto-compile-workflow.yml template



---------

Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test agentic workflow for Claude and Gemini

3 participants