Skip to content

Commit

Permalink
Update with-python.md with CUDA 12.X instructions (#20442)
Browse files Browse the repository at this point in the history
### Description
with-python.md does not currently include installation instructions for
CUDA 12.X, so I added the instructions from
https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements.



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
  • Loading branch information
sophies927 committed Apr 23, 2024
1 parent be0c6c9 commit 82e2da0
Showing 1 changed file with 16 additions and 2 deletions.
18 changes: 16 additions & 2 deletions docs/get-started/with-python.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,14 +20,28 @@ Below is a quick guide to get the packages installed to use ONNX for model seria

There are two Python packages for ONNX Runtime. Only one of these packages should be installed at a time in any one environment. The GPU package encompasses most of the CPU functionality.

### Install ONNX Runtime CPU

Use the CPU package if you are running on Arm CPUs and/or macOS.

```bash
pip install onnxruntime
```

### Install ONNX Runtime GPU (CUDA 11.x)

The default CUDA version for ORT is 11.8.

```bash
pip install onnxruntime-gpu
```

Use the CPU package if you are running on Arm CPUs and/or macOS.
### Install ONNX Runtime GPU (CUDA 12.x)

For Cuda 12.x, please use the following instructions to install from [ORT Azure Devops Feed](https://aiinfra.visualstudio.com/PublicPackages/_artifacts/feed/onnxruntime-cuda-12/PyPI/onnxruntime-gpu/overview)

```bash
pip install onnxruntime
pip install onnxruntime-gpu --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-12/pypi/simple/
```

## Install ONNX for model export
Expand Down

0 comments on commit 82e2da0

Please sign in to comment.