Skip to content

Issues: kubernetes-sigs/gateway-api-inference-extension

v0.4 Release Tracker
#681 opened Apr 13, 2025 by kfswain
Open 4
Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
105 Open 195 Closed
105 Open 195 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Track Enhancement Proposals Similar to KEPs and GEPs kind/documentation Categorizes issue or PR as related to documentation.
#116 opened Dec 19, 2024 by robscott
Integrate with TGI model server help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.
#171 opened Jan 8, 2025 by liu-cong
e2e test deploys a pinned epp image help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.
#244 opened Jan 29, 2025 by ahg-g
Consider adding mTLS support for extension<->proxy configuration kind/feature Categorizes issue or PR as related to a new feature.
#260 opened Jan 30, 2025 by ahg-g
Update RELEASE.md kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt.
#284 opened Feb 4, 2025 by danehans
Add an integration test on traffic splitting behavior
#324 opened Feb 12, 2025 by liu-cong
Add integration tests on error cases help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt.
#325 opened Feb 12, 2025 by liu-cong
5 tasks
Consolidate test object creation under the wrappers pkg help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt.
#353 opened Feb 17, 2025 by ahg-g
Emit events to indicate InferencePool and InferenceModel status
#382 opened Feb 20, 2025 by ahg-g
@kfswain
Add LoadBalancingPolicy field in InferencePool
#404 opened Feb 25, 2025 by Kuromesi
Add a helm chart to parameterize the benchmark guide so users don't need to fork the repo help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#528 opened Mar 18, 2025 by liu-cong
Record the limitation that only a single EPP replica has been tested so far triage/accepted Indicates an issue or PR is ready to be actively worked on.
#572 opened Mar 25, 2025 by ahg-g
Metric showing latency to make a placement decision kind/bug Categorizes issue or PR as related to a bug. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#581 opened Mar 26, 2025 by smarterclayton
lora-syncer tool's error handling needs improvement kind/bug Categorizes issue or PR as related to a bug. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#584 opened Mar 26, 2025 by kfswain
Add a metric to track InferenceModels ready to serve by the epp good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#598 opened Mar 28, 2025 by ahg-g
A metric in LoRA syncer tracking loaded adapters triage/accepted Indicates an issue or PR is ready to be actively worked on.
#600 opened Mar 28, 2025 by ahg-g
CRDs + examples should be validated with presubmits help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#679 opened Apr 11, 2025 by robscott
Pod Metrics test flaked kind/bug Categorizes issue or PR as related to a bug. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#719 opened Apr 21, 2025 by kfswain
Refactor Ext-proc server logic to better reflect EPP Layers triage/accepted Indicates an issue or PR is ready to be actively worked on.
#733 opened Apr 23, 2025 by kfswain
@kfswain
Add Performance Benchmarking to Release Doc documentation Improvements or additions to documentation triage/accepted Indicates an issue or PR is ready to be actively worked on.
#787 opened May 6, 2025 by danehans
Add Inference Extension to vLLM Integrations Doc needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one.
#794 opened May 7, 2025 by danehans
Proposal: Add Explicit Status Conditions to InferencePool API Spec needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one.
#806 opened May 8, 2025 by SinaChavoshi
Clarify expected cardinality between Gateway, Endpoint Selection Extension, and Backend Pod kind/documentation Categorizes issue or PR as related to documentation. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
#197 opened Jan 15, 2025 by robscott
1
Make metrics stale time configurable kind/feature Categorizes issue or PR as related to a new feature.
#336 opened Feb 14, 2025 by spacewander
1
InferenceModel status conditions update
#380 opened Feb 20, 2025 by ahg-g
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.