Move cobalt cloud jobs from benchmarks-ci-azure-eastus2 into benchmarks-ci-azure#2166
Merged
LoopedBard3 merged 1 commit intoaspnet:mainfrom Apr 29, 2026
Merged
Conversation
LoopedBard3
force-pushed
the
MoveEastUS2ToMainAzure
branch
3 times, most recently
from
66cef0b to
0cf702f
Compare
- Merge cobalt cloud machines into benchmarks_ci_azure.json with machine_group support - Regenerate benchmarks-ci-azure.yml using crank-scheduler (14 groups, handles machine conflicts) - Update benchmarks.template.liquid header with scheduler instructions - Remove separate eastus2 pipeline files (benchmarks-ci-azure-eastus2.yml, benchmarks.matrix.azure.eastus2.yml, benchmarks_ci_azure_eastus2.json) - Remove benchmarks.matrix.azure.yml (replaced by JSON + scheduler approach) - Remove cobaltcloud service bus queue (cobalt jobs now use azure/azurearm64 queues) - Remove EAST US 2 MACHINES header from azure.profile.yml Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
LoopedBard3
force-pushed
the
MoveEastUS2ToMainAzure
branch
from
0cf702f to
ba9a434
Compare
Contributor
Author
|
Verified that the pipeline still runs: https://dev.azure.com/dnceng/internal/_build/results?buildId=2963441&view=results As part of this, I will also have the benchmarks-ci-azure-eastus2 pipeline deleted. |
There was a problem hiding this comment.
Pull request overview
Consolidates the former benchmarks-ci-azure-eastus2 (cobalt cloud) pipeline into the main Azure CI pipeline by moving cobalt machines/scenarios into benchmarks_ci_azure.json, regenerating the combined benchmarks-ci-azure.yml, and removing the now-redundant eastus2/matrix files.
Changes:
- Merge cobalt cloud machines + scenarios into
build/benchmarks_ci_azure.jsonusingmachine_group. - Regenerate
build/benchmarks-ci-azure.ymlto include cobalt jobs and updated scheduling/serialization. - Remove separate eastus2 pipeline/config/matrix YAML files and clean up
azure.profile.ymlsection header.
Reviewed changes
Copilot reviewed 8 out of 8 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
| build/benchmarks_ci_azure_eastus2.json | Deleted legacy eastus2-only scheduler config. |
| build/benchmarks_ci_azure.json | Adds machine_group to existing machines and introduces cobalt cloud machines + scenario targeting. |
| build/benchmarks.template.liquid | Updates header comments to document crank-scheduler-based YAML generation. |
| build/benchmarks.matrix.azure.yml | Deleted legacy matrix definition (superseded by JSON + scheduler). |
| build/benchmarks.matrix.azure.eastus2.yml | Deleted legacy eastus2 matrix definition. |
| build/benchmarks-ci-azure.yml | Regenerated combined Azure pipeline including cobalt jobs and new dependsOn sequencing. |
| build/benchmarks-ci-azure-eastus2.yml | Deleted legacy eastus2 pipeline. |
| build/azure.profile.yml | Removes the “EAST US 2 MACHINES” section header comment. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
sebastienros
approved these changes
Apr 29, 2026
LoopedBard3
added a commit
to LoopedBard3/Benchmarks
that referenced
this pull request
Apr 29, 2026
Reflects main branch changes from PR aspnet#2166: - Merged cobalt-cloud-lin pods (eastus2) into azure config - Removed separate benchmarks_ci_azure_eastus2_pods.json - Fixed IDNA pod load profiles to match updated main: - idna-amd-lin now uses idna-amd-win as load - idna-intel-lin now uses idna-intel-win as load - idna-amd-win now uses idna-intel-lin as load - idna-intel-win now uses idna-amd-lin as load - Added cobalt-cloud-lin-azl3-dual pod for type-2 scenarios (uses cobalt-cloud-lin-db as load instead of client) - Total runs: 26 (matches main azure pipeline) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
LoopedBard3
added a commit
to LoopedBard3/Benchmarks
that referenced
this pull request
Apr 29, 2026
Reflects main branch changes from PR aspnet#2166: - Merged cobalt-cloud-lin pods (eastus2) into azure config - Removed separate benchmarks_ci_azure_eastus2_pods.json - Kept IDNA pod load profiles on linux machines (load jobs require linux), reverting the main branch profile change - Added cobalt-cloud-lin-azl3-dual pod for type-2 scenarios (uses cobalt-cloud-lin-db as load instead of client) - Total runs: 26 (matches main azure pipeline) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The cobalt cloud machines were moved from eastus2 to westus2, co-located with the other Azure benchmark machines. This merges the separate eastus2 pipeline back into the main Azure CI pipeline.
Changes
benchmarks_ci_azure.jsonwithmachine_groupsupport for proper schedulingbenchmarks-ci-azure.ymlusing the crank-scheduler (14 groups with intelligentdependsOnto avoid machine conflicts)benchmarks.template.liquidheader with crank-scheduler usage instructionsEAST US 2 MACHINESsection header fromazure.profile.ymlbenchmarks-ci-azure-eastus2.yml,benchmarks.matrix.azure.eastus2.yml,benchmarks_ci_azure_eastus2.jsonbenchmarks.matrix.azure.yml(replaced by JSON + crank-scheduler approach)azure/azurearm64queuesHow the generated pipeline works (Used approach in #2106)
benchmarks_ci_azure.json(machines + scenarios) and producesbenchmarks-ci-azure.ymlvia the liquid templatedependsOnNotes
azure.profile.ymlstill referencecobaltcloudlin*relay endpoints onaspnetperf.servicebus.windows.net— these are Azure Relay Hybrid Connection URLs that require infrastructure-level reconfiguration