Skip to content

add smoke-copilot-small workflow to validate model: small alias resolution#44288

Merged
pelikhan merged 5 commits into
mainfrom
copilot/fix-model-alias-resolution
Jul 8, 2026
Merged

add smoke-copilot-small workflow to validate model: small alias resolution#44288
pelikhan merged 5 commits into
mainfrom
copilot/fix-model-alias-resolution

Conversation

Copilot AI commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

The Copilot CLI validates model names before making API calls, rejecting meta-aliases like small as "retired or unsupported" — even though small is a valid gh-aw alias (smallminihaiku/gpt-5-mini). This smoke workflow surfaces the failure and serves as a regression gate once the resolution path is confirmed working end-to-end.

Changes

  • .github/workflows/smoke-copilot-small.md — new smoke workflow using engine.model: small; writes a haiku to disk, verifies line count, and creates a result issue. Triggered by /smoke-copilot-small, workflow_dispatch, or the smoke label.
  • .github/workflows/smoke-copilot-small.lock.yml — compiled lock file; the embedded AWF config includes "small":["mini"] confirming firewall-side alias resolution is already wired.
  • docs/src/content/docs/agent-factory-status.mdx — added status table row (alphabetically between Copilot SDK and Create Cross-Repo PR).

Copilot AI and others added 2 commits July 8, 2026 12:33
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
…tion

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix model alias not resolved for Github Copilot CLI add smoke-copilot-small workflow to validate model: small alias resolution Jul 8, 2026
Copilot AI requested a review from pelikhan July 8, 2026 12:39
@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

🤖 PR Triage

Field Value
Category test
Risk 🟢 low
Score 38 / 100
Recommended action 🕐 defer

Score breakdown: Impact 16 + Urgency 12 + Quality 10

Assessment: New smoke workflow for model: small alias resolution. Draft — surfaces a known failure; the underlying alias resolution path must be confirmed working before this test can pass.

Next step: Confirm model: smallmini resolution works end-to-end, then undraft and review.

Generated by 🔧 PR Triage Agent · 64.6 AIC · ⌖ 20.4 AIC · ⊞ 5.4K ·

@pelikhan pelikhan marked this pull request as ready for review July 8, 2026 12:59
Copilot AI review requested due to automatic review settings July 8, 2026 12:59

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds a dedicated Copilot smoke workflow to exercise the engine.model: small alias path end-to-end (surfacing Copilot CLI preflight validation issues) and wires it into the repo’s command/label routing and status documentation.

Changes:

  • Add new smoke workflow (smoke-copilot-small) using model: small, with a minimal task set and issue-based result reporting.
  • Register /smoke-copilot-small (and smoke label routing) via the centralized command router, and add the workflow to the Agent Factory status table.
  • Regenerate a large set of existing *.lock.yml workflows as part of compilation output.
Show a summary per file
File Description
docs/src/content/docs/agent-factory-status.mdx Adds “Smoke Copilot Small” row to the status table.
.github/workflows/agentic_commands.yml Registers the new slash command + smoke label routing for the workflow.
.github/workflows/smoke-copilot-small.md New smoke workflow spec using engine.model: small.
.github/workflows/smoke-copilot-small.lock.yml Generated lock workflow for the new smoke test.
.github/workflows/workflow-generator.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/weekly-safe-outputs-spec-review.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/weekly-issue-summary.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/weekly-blog-post-writer.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/stale-repo-identifier.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/smoke-copilot.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/smoke-copilot-aoai-entra.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/smoke-copilot-aoai-apikey.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/smoke-agent-scoped-approved.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/smoke-agent-public-none.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/smoke-agent-public-approved.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/smoke-agent-all-none.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/smoke-agent-all-merged.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/skillet.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/security-review.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/scout.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/refiner.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/q.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/pr-triage-agent.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/pr-sous-chef.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/pr-nitpick-reviewer.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/pr-code-quality-reviewer.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/plan.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/org-health-report.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/mattpocock-skills-reviewer.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/issue-triage-agent.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/issue-monster.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/issue-arborist.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/impeccable-skills-reviewer.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/grumpy-reviewer.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/discussion-task-miner.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/dataflow-pr-discussion-dataset.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/daily-team-status.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/daily-issues-report.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/daily-doc-updater.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/daily-agent-of-the-day-blog-writer.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/contribution-check.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/auto-triage-issues.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).
.github/workflows/ai-moderator.lock.yml Regenerated lock content (includes MCP/guard policy related step changes).

Review details

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 42/43 changed files
  • Comments generated: 4
  • Review effort level: Low

script: |
const determineAutomaticLockdown = require('${{ runner.temp }}/gh-aw/actions/determine_automatic_lockdown.cjs');
await determineAutomaticLockdown(github, context, core);
- name: Parse integrity filter lists
script: |
const determineAutomaticLockdown = require('${{ runner.temp }}/gh-aw/actions/determine_automatic_lockdown.cjs');
await determineAutomaticLockdown(github, context, core);
- name: Parse integrity filter lists
script: |
const determineAutomaticLockdown = require('${{ runner.temp }}/gh-aw/actions/determine_automatic_lockdown.cjs');
await determineAutomaticLockdown(github, context, core);
- name: Parse integrity filter lists
# /smoke-copilot-aoai-entra -> smoke-copilot-aoai-entra [issue_comment,issues,pull_request,pull_request_comment] reaction=eyes
# /smoke-copilot-arm -> smoke-copilot-arm [issue_comment,issues,pull_request,pull_request_comment] reaction=eyes
# /smoke-copilot-sdk -> smoke-copilot-sdk [issue_comment,issues,pull_request,pull_request_comment] reaction=eyes
# /smoke-copilot-small -> smoke-copilot-small [issue_comment,issues,pull_request,pull_request_comment] reaction=eyes
@pelikhan

pelikhan commented Jul 8, 2026

Copy link
Copy Markdown
Collaborator

@copilot merge main and recompile

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI commented Jul 8, 2026

Copy link
Copy Markdown
Contributor Author

@copilot merge main and recompile

Done — ran make merge-main which fetched and merged the latest main, then recompiled all 259 workflow lock files (0 errors, 186 warnings). Pre-PR validation passes.

@pelikhan pelikhan merged commit 9c0ce8f into main Jul 8, 2026
@pelikhan pelikhan deleted the copilot/fix-model-alias-resolution branch July 8, 2026 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Model alias not resolved to correct model for Github Copilot CLI

3 participants