Reference by: Managing Multiple CUDA + cuDNN Installations
/
Download CUDA Installer Download Link
-
Check GPU driver version and CUDA upper limit
user@admin1:~$ nvidia-smi +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 560.28.03 Driver Version: 560.28.03 CUDA Version: 12.6 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce RTX 3070 Off | 00000000:01:00.0 On | N/A | | 0% 55C P8 19W / 220W | 569MiB / 8192MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | 0 N/A N/A 1412 G /usr/lib/xorg/Xorg 277MiB | | 0 N/A N/A 1949 G /usr/bin/gnome-shell 79MiB | | 0 N/A N/A 6801 G ...93,262144 --variations-seed-version 87MiB | | 0 N/A N/A 153603 G ...irefox/4698/usr/lib/firefox/firefox 0MiB | | 0 N/A N/A 222999 G ...erProcess --variations-seed-version 53MiB | +-----------------------------------------------------------------------------------------+
- My driver version is
560.28.03and the highest cudatoolkit version I can install is12.6
- My driver version is
-
Check Architecture
user@admin1:~$ uname -m x86_64
-
Check Distribution and Version
user@admin1:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 22.04.4 LTS Release: 22.04 Codename: jammy
-
Download cuda_installer.run
-
It's better to install the
*.runfile
user@admin1:~/Downloads$ wget https://developer.download.nvidia.com/compute/cuda/12.1.0/local_installers/cuda_12.1.0_530.30.02_linux.run
-
-
Install cuda_installer.run
user@admin1:~/Downloads$ sudo sh cuda_12.1.0_530.30.02_linux.run --silent --toolkit --toolkitpath=/usr/local/cuda-12.1
-
--silent
This will force installer to do everything in a silence without any user-interaction. -
--toolkit
Install only the toolkit, no drivers, samples, documentation etc -
--toolkitpath
By default, it will install into the folder /usr/local/cuda-xx.x according to the version, but if you wish to install into a different folder you can specify it here. I have explicitly given it the default path just for demonstration.
-
IMPORTANT: The installer creates a symbolic link /usr/local/cuda that points to the actual installation folder /usr/local/cuda-12.1. The previous version of CUDA that stored in the symbolic link /usr/local/cuda will be replaced by /usr/local/cuda-12.1.
cuDNN package Download Link
-
Select the latest
cuDNN v8.9.7 (December 5th, 2023), for CUDA 12.x(Tar) package, since our CUDA Installer isCUDA 12.1
-
Extract files from the tar file
user@admin1:~/Downloads$ tar -xvf cudnn-linux-x86_64-8.9.7.29_cuda12-archive.tar.xz
-
Copy cuDNN files to CUDA toolkit directory
user@admin1:~/Downloads$ cd cudnn-linux-x86_64-8.9.7.29_cuda12-archive ### Get into the directory user@admin1:~/Downloads/cudnn-linux-x86_64-8.9.7.29_cuda12-archive$ sudo cp -P include/cudnn*.h /usr/local/cuda-12.1/include ### # Copy include files user@admin1:~/Downloads/cudnn-linux-x86_64-8.9.7.29_cuda12-archive$ sudo cp -P lib/libcudnn* /usr/local/cuda-12.1/lib64 ### Copy lib files (it could be lib or lib64)
user@admin1:~/Downloads$ sudo chmod a+r /usr/local/cuda-12.1/include/cudnn*.h ### Set read permissions of files for all users user@admin1:~/Downloads$ sudo chmod a+r /usr/local/cuda-12.1/lib64/libcudnn* ### Set read permissions of files for all users
-
Update Environment Variables
-
update the
.bashrc or .bash_profile or .zshrc or .profilehidden fileuser@admin1:~/home$ nano ~/.bashrc
#.bashrc ### Append this 3 line at the bottom of the `.bashrc` export PATH=/usr/local/cuda/bin:$PATH export CUDA_HOME=/usr/local/cuda export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH
-
-
Version Control of CUDA
-
update-alternativescommand can help for managing symbolic linksuser@admin1:~$ sudo apt-get install update-alternatives ### Install package
-
Check current status,
update-alternatives --display <name>user@admin1:~$ sudo update-alternatives --display cuda cuda - manual mode link best version is /usr/local/cuda-11.7 link currently points to /usr/local/cuda-12.6 link cuda is /usr/local/cuda /usr/local/cuda-11.7 - priority 11 /usr/local/cuda-12.6 - priority 9
-
Add new link,
update-alternatives --install <link> <name> <path> <priority>user@admin1:~$ sudo update-alternatives --install /usr/local/cuda cuda /usr/local/cuda-12.1 10
-
<link> : Symbolic link --> /usr/local/cuda
-
<name> : Name of symbolic link --> cuda
-
<path> : Installation path of
cuda-12.1--> /usr/local/cuda-12.1 -
<priority> : Selection priority rank --> 10
-
-
Select CUDA version,
update-alternatives --config <name>user@admin1:~$ sudo update-alternatives --config cuda There are 3 choices for the alternative cuda (providing /usr/local/cuda). Selection Path Priority Status ------------------------------------------------------------ 0 /usr/local/cuda-11.7 11 auto mode 1 /usr/local/cuda-11.7 11 manual mode 2 /usr/local/cuda-12.1 10 manual mode * 3 /usr/local/cuda-12.6 9 manual mode Press <enter> to keep the current choice[*], or type selection number:
-
Verify the CUDA version,
nvcc --versionuser@admin1:~$ nvcc -V nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2023 NVIDIA Corporation Built on Tue_Feb__7_19:32:13_PST_2023 Cuda compilation tools, release 12.1, V12.1.66 Build cuda_12.1.r12.1/compiler.32415258_0
-
Removing An Alternative,
sudo update-alternatives --remove <name> <path>user@admin1:~$ update-alternatives --list cuda ### List all cuda alternatives user@admin1:~$ sudo update-alternatives --remove cuda /usr/local/cuda-11.7 ### Remove an alternative
-
