-
Notifications
You must be signed in to change notification settings - Fork 34
Description
There is an issue with building CUDA recipes like ONNXRuntime_CUDA, (e.g., JuliaPackaging/Yggdrasil#10420), with CUDNN and/or TensorRT dependencies: The issue is that CUDNN and TensorRT artifacts are only available for a single CUDA 11-minor version (CUDA 11.0), and a single CUDA 12-minor version (CUDA 12.0), so when building for e.g. CUDA 11.8, or 12.6, there are no artifacts for the platform being built.
When the end user installs e.g. ONNXRuntime_CUDA, the CUDA platform augmentation block allows the install of CUDNN 12.0 with ONNXRuntime_CUDA for CUDA 12.6.
The reason there are only CUDA 11.0 and CUDA 12.0 artifacts for CUDNN and TensorRT is that the CUDNN and TensorRT artifacts are just copies of a single set of CUDA 11/12 binary releases from nvidia.
Similar issue for the Torch recipe.
Previously discussed in relation to ONNXRuntime: JuliaPackaging/Yggdrasil#7561 (comment)