Search results

Multi-turn benchmarking

Status: Open.

#199 In neuralmagic/guidellm;

· markurtz opened on Jun 24, 2025

Simplifying the readme towards expected use cases and examples; expand out docs particularly for configuration options

Status: Open.

#198 In neuralmagic/guidellm;

· markurtz opened on Jun 24, 2025

Add new benchmark mode to search for peak goodput under an SLO

enhancementNew feature or requestNew feature or request

featureFeature addition with a set PRD for the releaseFeature addition with a set PRD for the release

Status: Open.

#197 In neuralmagic/guidellm;

· dagrayvid opened on Jun 24, 2025

Long running test spawn too many threads

bugSomething isn't workingSomething isn't working

priority-high

Status: Open.

Bug

#196 In neuralmagic/guidellm;

· sjmonson opened on Jun 24, 2025

test with ollama backend failed.

Status: Open.

#193 In neuralmagic/guidellm;

· alexhegit opened on Jun 19, 2025

How to use the <code>/v1/chat/completions</code> endpoint?

Status: Open.

#192 In neuralmagic/guidellm;

· snehalpatel-8451 opened on Jun 18, 2025

Improve performance of synthetic dataset prompt creation to match a given number of tokens

Status: Open.

#187 In neuralmagic/guidellm;

· markurtz opened on Jun 13, 2025

Ensure prefixes cannot be cached for synthetic datasets

Status: Open.

Feature

#186 In neuralmagic/guidellm;

· markurtz opened on Jun 13, 2025

Map out issues around potential max and convergence issues for rates

Status: Open.

#180 In neuralmagic/guidellm;

· markurtz opened on Jun 3, 2025

Token Efficiency Benchmarking

Status: Open.

#179 In neuralmagic/guidellm;

· ashishkamra opened on May 31, 2025

Add support for a Python vLLM backend

featureFeature addition with a set PRD for the releaseFeature addition with a set PRD for the release

good first issueGood for newcomersGood for newcomers

priority-high

Status: Open.

Feature

#178 In neuralmagic/guidellm;

· rgreenberg1 opened on May 29, 2025

Re-load and re-display a saved benchmark.json report

priority-medium

UIFront-end workstreamFront-end workstream

Status: Open.

Feature

#175 In neuralmagic/guidellm;

· rgreenberg1 opened on May 29, 2025