Skip to content

Commit

Permalink
doc: Fix typo and format (#4821)
Browse files Browse the repository at this point in the history
Fix typo and format

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>
  • Loading branch information
Sherlock113 committed Jun 20, 2024
1 parent 36654fd commit aa200ed
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion docs/source/guides/gpu-inference.rst
Original file line number Diff line number Diff line change
Expand Up @@ -133,7 +133,7 @@ To view GPU usage, use the ``nvidia-smi`` tool to see if a BentoML Service or Be

.. code-block:: bash
# Refresh the output of every second
# Refresh the output every second
watch -n 1 nvidia-smi
Example output:
Expand Down
2 changes: 1 addition & 1 deletion docs/source/use-cases/large-language-models/vllm.rst
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ Define a :doc:`BentoML Service </guides/services>` to customize the serving logi

.. note::

This example Service uses the model ``mistralai/Mistral-7B-Instruct-v0.2``, which requires you to [accept relevant conditions to gain access](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2). You can choose other models in the `BentoVLLM repository <https://github.com/bentoml/BentoVLLM>`_ or any other model supported by vLLM based on your needs.
This example Service uses the model ``mistralai/Mistral-7B-Instruct-v0.2``, which requires you to `accept relevant conditions to gain access <https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2>`_. You can choose other models in the `BentoVLLM repository <https://github.com/bentoml/BentoVLLM>`_ or any other model supported by vLLM based on your needs.

.. code-block:: python
:caption: `service.py`
Expand Down

0 comments on commit aa200ed

Please sign in to comment.