Skip to content

Pull requests: triton-inference-server/server

New pull request New
52 Open 3,557 Closed
52 Open 3,557 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add support for response sender in the default mode
#7311 opened Jun 1, 2024 by kthui • Draft
ci: Support BF16 data type in TensorRT backend
#7310 opened May 31, 2024 by pskiran1 • Draft
1 of 20 tasks
build: Update vllm version to v0.4.3 (latest) module: backends Issues related to the backends PR: build Changes that affect the build system or external dependencies
#7309 opened May 31, 2024 by oandreeva-nv Loading…
6 of 20 tasks
1
fix: Fix L0_input_validation--base PR: fix A bug fix
#7304 opened May 30, 2024 by yinggeh Loading…
8 of 20 tasks
@yinggeh
3
Add test for improper response sending from model
#7292 opened May 29, 2024 by kthui Loading…
12
Add testing for libtorch cudnn
#7286 opened May 28, 2024 by Tabrizian Loading…
Fix gRPC streaming non-decoupled segfault if sending response and final flag separately
#7265 opened May 24, 2024 by kthui Loading…
13
Added new flag for GPU peer access API control
#7261 opened May 23, 2024 by indrajit96 Loading…
6
Update expected error message
#7258 opened May 22, 2024 by kthui Loading…
3
Ci updates
#7241 opened May 17, 2024 by nvda-mesharma Loading…
Jetpack 5.1.2 Patch 2
#7217 opened May 14, 2024 by fpetrini15 • Draft
7
Remove unnecessary wait in case of failed stub creation
#7192 opened May 7, 2024 by indrajit96 Loading…
9
Add testing for L0_iterative_tutorial
#7176 opened May 1, 2024 by Tabrizian Loading…
9
Raise MLFlow error when env TRITON_MODEL_REPO not set
#7147 opened Apr 22, 2024 by JonasGoebel Loading…
2
Change TensorRT-LLM
#7143 opened Apr 20, 2024 by mc-nv • Draft
1
Update L0_trace for DLIS-6462
#7134 opened Apr 18, 2024 by indrajit96 Loading…
6
Have ability to split the build in CI
#7076 opened Apr 5, 2024 by mc-nv Loading…
10
[Windows] Support CPU shared memory (Client/Frontend)
#7048 opened Mar 27, 2024 by fpetrini15 Loading…
68
added support to intel gpu in a custom build
#7047 opened Mar 27, 2024 by dtrawins Loading…
8
Update quickstart.md
#7033 opened Mar 26, 2024 by inf3rnus Loading…
debugging guide: fix verbose logging option
#6927 opened Feb 29, 2024 by catwell Loading…
Adding a readiness matrix of the various first party Backends
#6912 opened Feb 23, 2024 by zeryx Loading…
10
Fix inference command sample in README.md investigating The developement team is investigating this issue
#6868 opened Feb 6, 2024 by jasoncwik Loading…
5
Fix some small typos investigating The developement team is investigating this issue
#6857 opened Feb 1, 2024 by seiteta Loading…
3
OpenVINO 2023.3
#6827 opened Jan 24, 2024 by atobiszei Loading…
4
ProTip! Add no:assignee to see everything that’s not assigned.