Skip to content

Commit

Permalink
Add mps doc to content + change title
Browse files Browse the repository at this point in the history
  • Loading branch information
mreso committed Mar 29, 2023
1 parent 7d23cb2 commit 6b5d8c8
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 1 deletion.
1 change: 1 addition & 0 deletions docs/contents.rst
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@
model_zoo
request_envelopes
server
mps
snapshot
sphinx/requirements
torchserve_on_win_native
Expand Down
2 changes: 1 addition & 1 deletion docs/mps.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Enabling NVIDIA MPS in TorchServe
# Running TorchServe with NVIDIA MPS
In order to deploy ML models, TorchServe spins up each worker in a separate processes, thus isolating each worker from the others.
Each process creates its own CUDA context to execute its kernels and access the allocated memory.

Expand Down

0 comments on commit 6b5d8c8

Please sign in to comment.