Skip to content

Sync eng/common directory with azure-sdk-tools for PR 16402#48176

Merged
helen229 merged 2 commits into
mainfrom
sync-eng-common-feat/rename-azsdk-evals-to-evals-16402
Jul 21, 2026
Merged

Sync eng/common directory with azure-sdk-tools for PR 16402#48176
helen229 merged 2 commits into
mainfrom
sync-eng-common-feat/rename-azsdk-evals-to-evals-16402

Conversation

@azure-sdk-automation

Copy link
Copy Markdown
Contributor

Sync eng/common directory with azure-sdk-tools for PR Azure/azure-sdk-tools#16402 See eng/common workflow

Copilot AI review requested due to automatic review settings July 21, 2026 17:58
@azure-sdk-automation
azure-sdk-automation Bot requested a review from a team as a code owner July 21, 2026 17:58
@azure-sdk-automation
azure-sdk-automation Bot requested a review from helen229 July 21, 2026 17:58
@azure-sdk-automation azure-sdk-automation Bot added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Jul 21, 2026
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
9 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot could not run the full agentic suite for this review because it was automatically requested on a bot-authored pull request. Request a review from Copilot under Reviewers to retry with the full agentic suite. Improved support for bot-authored pull requests is coming soon.

Updates the eval suite layout from the legacy azsdk-evals/evals/... paths to a top-level evals/ folder with tools/ and workflows/ subtrees, and aligns scripts/tests/pipelines to the new globs.

Changes:

  • Updated default glob patterns from evals/... to tools/... and workflows/... across scripts and pipeline templates.
  • Refactored test fixtures to use the new folder structure and adjusted assertions accordingly.
  • Updated pipeline triggers/parameters and the relative-link allowlist to reference evals/**.

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
eng/common/scripts/eval/test/init-eval-git-fixtures.test.ts Updates fixture tree + invariant scan roots to evals/tools + evals/workflows.
eng/common/scripts/eval/test/collect-stimuli.test.ts Updates synthetic eval locations and expected -e paths for the new globs.
eng/common/scripts/eval/lib/glob.ts Updates JSDoc example glob to match the new layout.
eng/common/scripts/eval/init-eval-git-fixtures.ts Changes DEFAULT_PATTERNS to tools/* and workflows/mock/*.
eng/common/scripts/eval/collect-stimuli.ts Changes DEFAULT_PATTERNS to tools/* and workflows/mock/*.
eng/common/scripts/allow-relative-links.txt Switches allowlisted suite folder from azsdk-evals/** to evals/**.
eng/common/pipelines/workflow-eval.yml Updates triggers and vallyRoot to target evals/**.
eng/common/pipelines/templates/stages/archetype-eval.yml Updates default evalGlobs to new patterns.
eng/common/pipelines/live-eval.yml Updates vallyRoot and live evalGlobs to workflows/live/*.

Comment thread eng/common/scripts/eval/test/init-eval-git-fixtures.test.ts
Comment thread eng/common/scripts/eval/test/init-eval-git-fixtures.test.ts
Comment thread eng/common/scripts/eval/test/collect-stimuli.test.ts
@helen229
helen229 merged commit 61acdbf into main Jul 21, 2026
21 checks passed
@helen229
helen229 deleted the sync-eng-common-feat/rename-azsdk-evals-to-evals-16402 branch July 21, 2026 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants