Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
90 commits
Select commit Hold shift + click to select a range
a2d19cd
Base version update to what is pushed as latest to enable PR for base…
markurtz Sep 19, 2025
cd5a92d
Base version update to what is pushed as latest to enable PR for base…
markurtz Sep 19, 2025
8d6e19a
core changes for refactor including pyproject.toml updates and renami…
markurtz Sep 19, 2025
669848d
remove improper readdition of pyhumps
markurtz Sep 19, 2025
6b6ed98
refactors for the utility modules
markurtz Sep 19, 2025
d15cf17
Remove old pydantic file that is now replaced
markurtz Sep 19, 2025
5b83c2d
fixes from copilot review
markurtz Sep 19, 2025
c84299b
add refactored scheduler package and tests
markurtz Sep 19, 2025
a7ae737
Standardize on plural for modules/packages and update from copilot re…
markurtz Sep 19, 2025
02554b0
backend refactor implementations
markurtz Sep 19, 2025
a88605e
fixes from copilot review and standardize backend package to backends…
markurtz Sep 19, 2025
452eb65
remove renaming changes from benchmark package til after that PR is u…
markurtz Sep 19, 2025
7829fb8
Add in benchmark package refactor
markurtz Sep 19, 2025
4834767
fixes and rebase
markurtz Sep 19, 2025
61736f5
fixes from copilot review
markurtz Sep 19, 2025
a28bbe3
Mock server implementation for guidellm
markurtz Sep 19, 2025
bb98193
fixes from copilot review
markurtz Sep 19, 2025
a9a082a
Any missing changes / working state for refactor
markurtz Sep 19, 2025
6d0d4c2
add in the perf extras
markurtz Sep 19, 2025
bfc8e50
Complete CSV output
jaredoconnell Sep 8, 2025
c12c4f8
[GuideLLM Refactor] Core: Reintroduce changes from main (#364)
sjmonson Sep 24, 2025
ab5466b
[GuideLLM Refactor] Fix from-file (#366)
jaredoconnell Sep 24, 2025
78615f7
[GuideLLM Refactor] Entrypoint: Reintroduce changes from main (#363)
sjmonson Sep 25, 2025
3ac1537
Update GenerativeTextScenario to match current def
sjmonson Sep 11, 2025
c47a1f6
Add workaround for https://github.com/pydantic/pydantic/issues/9541
sjmonson Sep 12, 2025
965aca2
Rename rate_type -> profile in builtin scenarios
sjmonson Sep 24, 2025
d9a4df2
Always parse rate as list[float]
sjmonson Sep 12, 2025
03f9085
Fix bug where empty constraints in sweep caused error
jaredoconnell Sep 25, 2025
9c401da
Update HTML processing references for latest data output
jaredoconnell Sep 10, 2025
54556ae
Fix injection of data into the HTML output
jaredoconnell Sep 26, 2025
3f1ff7a
[GuideLLM Refactor] core updates for pyproject.toml and settings.py (…
markurtz Sep 29, 2025
4c70b5b
[GuideLLM Refactor] utility package updates, rewrites, and tests expa…
markurtz Sep 29, 2025
ad14178
[GuideLLM Refactor] scheduler package updates, rewrites, and tests ex…
markurtz Sep 29, 2025
8f48cf9
[GuideLLM Refactor] backend package updates, rewrites, and tests expa…
markurtz Sep 29, 2025
18e95be
[GuideLLM Refactor] benchmark package updates and rewrites (#356)
markurtz Sep 29, 2025
da02ee8
[GuideLLM Refactor] mock server package creation (#357)
markurtz Sep 29, 2025
46a2c1e
[GuideLLM Refactor] Edge case errors (#376)
jaredoconnell Sep 29, 2025
447101b
Merge branch 'features/refactor/base' into features/refactor/working
jaredoconnell Sep 29, 2025
47088f9
[GuideLLM Refactor] entrypoints and working state (base to create PRs…
markurtz Sep 29, 2025
6d31244
Merge branch 'main' into features/refactor/base
markurtz Sep 29, 2025
2c6637d
Share type alises between entrypoints and scenario
jaredoconnell Sep 29, 2025
2c70edd
Pluralize type.py > types.py
sjmonson Sep 30, 2025
4bff34a
Convert new types to TypeAliasTypes
sjmonson Sep 30, 2025
3057229
Address Copilot review
sjmonson Sep 30, 2025
27d5702
[GuideLLM Refactor] Scenarios reenablement (#362)
sjmonson Sep 30, 2025
33effe6
add custom dict camelize logic (#246)
DaltheCow Aug 21, 2025
edd6317
Update imports in src/guidellm/benchmark/output.py
jaredoconnell Sep 30, 2025
89113d8
[GuideLLM Refactor] Features/refactor fix html (#377)
jaredoconnell Sep 30, 2025
32e4909
Progress towards fixing output tests
jaredoconnell Oct 1, 2025
bbc88e4
Implement workaround for duplicate fields
jaredoconnell Oct 1, 2025
ff9a61a
Fix leftover debugging code and fix linter errors
jaredoconnell Oct 3, 2025
46b5e87
[GuideLLM Refactor] Fix output tests (#387)
jaredoconnell Oct 3, 2025
11d585c
Fixed type errors in utility classes registry and singleton
jaredoconnell Oct 1, 2025
c84d160
Fix type errors in utils package
jaredoconnell Oct 8, 2025
5101d70
Fix linting errors
jaredoconnell Oct 8, 2025
61fa01f
Fix test
jaredoconnell Oct 8, 2025
db43ccd
Use preferred operator for type check
jaredoconnell Oct 8, 2025
d88cab3
Merge branch 'features/refactor/base' into features/refactor/fix-csv
jaredoconnell Oct 8, 2025
80df98b
Fix and enable CSV output test
jaredoconnell Oct 8, 2025
a10e61a
Add a script to generate pylock from scratch
sjmonson Oct 9, 2025
eb8e84e
Bump minimal python version to 3.10
sjmonson Oct 9, 2025
9292e38
Bump min python to 3.10 in CI
sjmonson Oct 9, 2025
d40a657
Update docs to reflect bumping min pyhton
sjmonson Oct 9, 2025
eff0f46
Add force update stratagy to lockfile script
sjmonson Oct 9, 2025
bde3ae8
Optimize use of lowercase in src/guidellm/utils/registry.py
jaredoconnell Oct 9, 2025
61c58ec
[GuideLLM Refactor] Complete CSV output (#378)
jaredoconnell Oct 9, 2025
51c1681
[GuideLLM Refactor] Bump minimum python version to 3.10 (#397)
jaredoconnell Oct 9, 2025
a65b5b1
Reapply Fix errors with metric accumulation (#266)
sjmonson Aug 20, 2025
e1fb966
Disable base class initialization
sjmonson Oct 7, 2025
a9aad63
Test cleanup
sjmonson Oct 6, 2025
440b4e3
Fix backend tests
sjmonson Oct 6, 2025
272304c
Initial scheduler test fixes
sjmonson Oct 6, 2025
544c888
Fix MeasuredRequestTimings tests
sjmonson Oct 7, 2025
5032e9e
Patch time.time in workgroup lifecycle test
sjmonson Oct 7, 2025
4971e56
Tear down worker process group in instance fixture
sjmonson Oct 7, 2025
5676895
Match main tests to current CLI
sjmonson Oct 8, 2025
5f36174
Various small fixes to utils tests
sjmonson Oct 8, 2025
1556236
Fix typing import for python3.10
sjmonson Oct 8, 2025
0a64090
[GuideLLM Refactor] Fixes for various failing unit tests (#394)
jaredoconnell Oct 9, 2025
538c194
[GuideLLM Refactor] fix util package types (#393)
jaredoconnell Oct 9, 2025
87ba006
Fixed quality errors
jaredoconnell Oct 9, 2025
1bd8846
Run auto-formatter
jaredoconnell Oct 9, 2025
1e8974c
Fix remaining ruff errors
jaredoconnell Oct 10, 2025
d0dad5a
Fix unit tests
jaredoconnell Oct 10, 2025
8f6fdfa
Features/refactor/quality fixes (#402)
jaredoconnell Oct 10, 2025
b243664
Move asyncio timeout to common location
sjmonson Oct 10, 2025
cfcbd13
Fix duplicate timeout in openai backend tests
sjmonson Oct 10, 2025
9ca2dba
Force time zone in tests
jaredoconnell Oct 10, 2025
8d20525
Fix function doc
sjmonson Oct 10, 2025
f9fb29c
[GuideLLM Refactor] Fixes for asyncio and timezone tests (#405)
sjmonson Oct 10, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions .github/workflows/development.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -44,7 +44,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -79,7 +79,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9"]
python: ["3.10"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -114,7 +114,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -149,7 +149,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
python: ["3.10", "3.11", "3.12", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -45,7 +45,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
python: ["3.10", "3.11", "3.12", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -80,7 +80,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9"]
python: ["3.10"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -115,7 +115,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -150,7 +150,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/nightly.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9"]
python: ["3.10"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand All @@ -26,7 +26,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -61,7 +61,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -96,7 +96,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.13"]
python: ["3.10", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -142,7 +142,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9"]
python: ["3.10"]
steps:
- name: Checkout code
uses: actions/checkout@v4
Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/release-candidate.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9"]
python: ["3.10"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand All @@ -26,7 +26,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
python: ["3.10", "3.11", "3.12", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -61,7 +61,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
python: ["3.10", "3.11", "3.12", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -96,7 +96,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
python: ["3.10", "3.11", "3.12", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -142,7 +142,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9"]
python: ["3.10"]
steps:
- name: Checkout code
uses: actions/checkout@v4
Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9"]
python: ["3.10"]
steps:
- name: Checkout code
uses: actions/checkout@v4
Expand Down Expand Up @@ -55,7 +55,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9"]
python: ["3.10"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand All @@ -71,7 +71,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
python: ["3.10", "3.11", "3.12", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -106,7 +106,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
python: ["3.10", "3.11", "3.12", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down Expand Up @@ -141,7 +141,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: ["3.9", "3.10", "3.11", "3.12", "3.13"]
python: ["3.10", "3.11", "3.12", "3.13"]
steps:
- uses: actions/checkout@v4
- name: Set up Python
Expand Down
2 changes: 1 addition & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ There are many ways to contribute to GuideLLM:

Before contributing, ensure you have the following installed:

- Python 3.9 or higher
- Python 3.10 or higher
- pip (Python package manager)
- Tox
- Git
Expand Down
2 changes: 1 addition & 1 deletion DEVELOPING.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ Thank you for your interest in contributing to GuideLLM! This document provides

Before you begin, ensure you have the following installed:

- Python 3.9 or higher
- Python 3.10 or higher
- pip (Python package manager)
- Tox
- Git
Expand Down
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
Scale Efficiently: Evaluate and Optimize Your LLM Deployments for Real-World Inference
</h3>

[![GitHub Release](https://img.shields.io/github/release/vllm-project/guidellm.svg?label=Version)](https://github.com/vllm-project/guidellm/releases) [![Documentation](https://img.shields.io/badge/Documentation-8A2BE2?logo=read-the-docs&logoColor=%23ffffff&color=%231BC070)](https://github.com/vllm-project/guidellm/tree/main/docs) [![License](https://img.shields.io/github/license/vllm-project/guidellm.svg)](https://github.com/vllm-project/guidellm/blob/main/LICENSE) [![PyPI Release](https://img.shields.io/pypi/v/guidellm.svg?label=PyPI%20Release)](https://pypi.python.org/pypi/guidellm) [![Python Versions](https://img.shields.io/badge/Python-3.9--3.13-orange)](https://pypi.python.org/pypi/guidellm) [![Nightly Build](https://img.shields.io/github/actions/workflow/status/vllm-project/guidellm/nightly.yml?branch=main&label=Nightly%20Build)](https://github.com/vllm-project/guidellm/actions/workflows/nightly.yml)
[![GitHub Release](https://img.shields.io/github/release/vllm-project/guidellm.svg?label=Version)](https://github.com/vllm-project/guidellm/releases) [![Documentation](https://img.shields.io/badge/Documentation-8A2BE2?logo=read-the-docs&logoColor=%23ffffff&color=%231BC070)](https://github.com/vllm-project/guidellm/tree/main/docs) [![License](https://img.shields.io/github/license/vllm-project/guidellm.svg)](https://github.com/vllm-project/guidellm/blob/main/LICENSE) [![PyPI Release](https://img.shields.io/pypi/v/guidellm.svg?label=PyPI%20Release)](https://pypi.python.org/pypi/guidellm) [![Python Versions](https://img.shields.io/badge/Python-3.10--3.13-orange)](https://pypi.python.org/pypi/guidellm) [![Nightly Build](https://img.shields.io/github/actions/workflow/status/vllm-project/guidellm/nightly.yml?branch=main&label=Nightly%20Build)](https://github.com/vllm-project/guidellm/actions/workflows/nightly.yml)

## Overview

Expand All @@ -36,7 +36,7 @@ Scale Efficiently: Evaluate and Optimize Your LLM Deployments for Real-World Inf
Before installing, ensure you have the following prerequisites:

- OS: Linux or MacOS
- Python: 3.9 – 3.13
- Python: 3.10 – 3.13

The latest GuideLLM release can be installed using pip:

Expand Down
2 changes: 1 addition & 1 deletion docs/install.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ Before installing GuideLLM, ensure you have the following prerequisites:

- **Operating System:** Linux or MacOS

- **Python Version:** 3.9 – 3.13
- **Python Version:** 3.10 – 3.13

- **Pip Version:** Ensure you have the latest version of pip installed. You can upgrade pip using the following command:

Expand Down
Loading