issues Search Results · repo:kubernetes-sigs/inference-perf language:Python
Filter by
80 results
(68 ms)80 results
inkubernetes-sigs/inference-perf (press backspace or delete to remove)!-- Please use this template while reporting a bug and provide as much info as possible.
What happened:
inference-perf --config_file config.yml with local dataset failed
What you expected to happen: ...
kind/bug
needs-triage
liyuerich
- 2
- Opened yesterday
- #176
!-- Please only use this template for submitting enhancement requests --
What would you like to be added: Currently we support only normal distribution for input and output tokens. Lot of the
real world ...
needs-triage
achandrasekar
- Opened 3 days ago
- #174
!-- Please only use this template for submitting enhancement requests --
What would you like to be added:
support to set an SLO threshold level and then calculate the goodput, rather than measuring the ...
needs-triage
- Opened 8 days ago
- #169
What would you like to be added:
Add a config option to perform a sweep of request rates. Like:
sweep:
type = linear | geomspace
num_stages
duration
If load: stages are specified, it should ...
kind/feature
jjk-g
- 1
- Opened 8 days ago
- #167
When config.metrics.prometheus.google_managed: True I m seeing the following logs for every request:
2025/07/31 16:56:46 2025-07-31 16:56:46,380 - inference_perf.client.metricsclient.prometheus_client.base ...
kind/bug
Bslabe123
- 2
- Opened 8 days ago
- #166
What would you like to be added:
A config value to write the full config yaml to the output directory or bucket.
Why is this needed:
Running many different configurations leaves you with many output ...
good first issue
- 1
- Opened 8 days ago
- #165
!-- Please use this template while reporting a bug and provide as much info as possible.
What happened:
Docs here says that it will show reports to stdout but only sees logger s output in stdout.
The ...
kind/bug
ExplorerRay
- 3
- Opened 10 days ago
- #163
!-- Please only use this template for submitting enhancement requests --
What would you like to be added: Revise Dockerfile and try to minimize image size.
Why is this needed: This can reduce the time ...
- 3
- Opened 10 days ago
- #161
!-- Please use this template while reporting a bug and provide as much info as possible.
What happened: Run inference-perf --config config.yml with following errors
Traceback (most recent call last): ...
kind/bug
- 5
- Opened 11 days ago
- #159
set config.yml as api type: chat and streaming: true
img width= 1381 height= 719 alt= Image src=
https://github.com/user-attachments/assets/fbdf0b01-c812-4f2d-857b-b178b501ab21 /
raceback (most recent ...
priority/backlog
- Opened 15 days ago
- #156
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Restrict your search to the title by using the in:title qualifier.Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.