Skip to content

feat: add filter option to runner-model-sweep subcommand#226

Merged
cquil11 merged 4 commits into
mainfrom
filter-runner-model-sweep
Nov 12, 2025
Merged

feat: add filter option to runner-model-sweep subcommand#226
cquil11 merged 4 commits into
mainfrom
filter-runner-model-sweep

Conversation

@cquil11
Copy link
Copy Markdown
Collaborator

@cquil11 cquil11 commented Nov 12, 2025

Adds a argument --runner-node-filter to the subcommand runner-model-sweep in utils/generate_sweep_configs.py.
This allows developers to filter for specific runner nodes when running the runner-model-sweep command.
For instance, if I want to sweep across all MI325X runners, but only those that contain the string amd, I can run the following command

❯ python3 utils/matrix-logic/generate_sweep_configs.py runner-model-sweep --runner-type mi325x --runner-node-filter mi325x-amd --runner-config .github/configs/runners.yaml --config-files .github/configs/amd-master.yaml | jq length
2

without filter:

❯ python3 utils/matrix-logic/generate_sweep_configs.py runner-model-sweep --runner-type mi325x --runner-config .github/configs/runners.yaml --config-files .github/configs/amd-master.yaml | jq length
10

Add corresponding PyTests for this file; tests pass:

❯ pytest test_generate_sweep_configs.py
============================================================================================ test session starts ============================================================================================
platform darwin -- Python 3.13.7, pytest-8.4.2, pluggy-1.6.0 -- /opt/homebrew/opt/python@3.13/bin/python3.13
cachedir: .pytest_cache
rootdir: /Users/quilicic/InferenceMAX/utils/matrix-logic
configfile: pytest.ini
collected 78 items                                                                                                                                                                                          

.
.
.

============================================================================================ 78 passed in 0.25s =============================================================================================

@cquil11 cquil11 marked this pull request as ready for review November 12, 2025 20:25
@cquil11 cquil11 requested a review from a team as a code owner November 12, 2025 20:25
Copilot AI review requested due to automatic review settings November 12, 2025 20:25
@github-actions
Copy link
Copy Markdown
Contributor

📊 Line Count Report

File: utils/matrix-logic/generate_sweep_configs.py

Total Lines: 968

Base Lines: 956

Change: +12 lines 📈

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds a --runner-node-filter argument to the runner-model-sweep subcommand, enabling developers to filter specific runner nodes by substring matching. This allows for more targeted testing of runner nodes within a runner type.

Key changes:

  • Added --runner-node-filter argument to the runner-model-sweep subcommand CLI
  • Implemented filtering logic in generate_runner_model_sweep_config() to filter runner nodes by substring match
  • Added comprehensive test coverage for the new filtering functionality

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
utils/matrix-logic/generate_sweep_configs.py Added CLI argument and filtering logic for runner node selection
utils/matrix-logic/test_generate_sweep_configs.py Added test cases covering filter scenarios: single match, multiple matches, no matches, and default behavior

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread utils/matrix-logic/generate_sweep_configs.py Outdated
Comment thread utils/matrix-logic/generate_sweep_configs.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@github-actions
Copy link
Copy Markdown
Contributor

📊 Line Count Report

File: utils/matrix-logic/generate_sweep_configs.py

Total Lines: 968

Base Lines: 956

Change: +12 lines 📈

Copy link
Copy Markdown
Collaborator

@functionstackx functionstackx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cquil11 cquil11 merged commit a5646c5 into main Nov 12, 2025
6 checks passed
@cquil11 cquil11 deleted the filter-runner-model-sweep branch November 12, 2025 20:28
cquil11 added a commit that referenced this pull request Nov 12, 2025
* add new mi325x scripts and configs

* adding ability to filter runner node on runner-model-sweep in god file

* rebase with main

* Update utils/matrix-logic/generate_sweep_configs.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants