Skip to content

triton-inference-server/server

Error
Looks like something went wrong!

About

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html

Topics

machine-learning cloud deep-learning gpu inference edge datacenter

Resources

Readme

License

BSD-3-Clause license

Security policy

Security policy
Activity
Custom properties

Stars

9.3k stars

Watchers

147 watching

Forks

1.6k forks
Report repository

Releases 79

Release 2.58.0 corresponding to NGC container 25.05 Latest
May 31, 2025
+ 78 releases

Contributors 140
+ 126 contributors

Languages