[ITensorGPU][Bug] Restrict to CUDA.jl v4.0.1 to fix compatibility issues with cuTENSOR

[kmp5VT]

Description

It looks like there is an issue with the updated version of cuTENSOR where it is not properly linking to the lib binaries. To get around that issue, use an older version of CUDA and cuTENSOR

[mtfishman]

I was wondering what was going on with the CI, glad you figured out the cause.

Instead of changing the compat entries in ITensorGPU/test/Project.toml, I think it makes more sense to change them in ITensorGPU/Project.toml. Otherwise we are just fixing the tests, but we're still allowing people to install a version of cuTENSOR that we know breaks ITensorGPU.

I think this should work:

cuTENSOR = "1.0.0 - 1.0.1"

to not allow upgrading to the problematic cuTENSOR v1.0.2 (the notation for compat entries is specified here: https://pkgdocs.julialang.org/v1/compatibility/).

EDIT: The simpler fix implemented in this PR is restricting CUDA.jl compat to be below v4.1, i.e.:

CUDA = "4.0 - 4.0.1"

Also, I don't see any issues about this in CUDA.jl, should we raise an issue over there?

[codecov-commenter]

Codecov Report

Merging #1107 (eecb117) into main (3f2ab60) will decrease coverage by 31.58%.
The diff coverage is n/a.

❗ Current head eecb117 differs from pull request most recent head 8a9938d. Consider uploading reports for the commit 8a9938d to get more accurate results

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

@@             Coverage Diff             @@
##             main    #1107       +/-   ##
===========================================
- Coverage   85.11%   53.53%   -31.58%     
===========================================
  Files          86       85        -1     
  Lines        8305     7770      -535     
===========================================
- Hits         7069     4160     -2909     
- Misses       1236     3610     +2374     

see 65 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

[mtfishman]

@kshyatt FYI it looks like CUDA.jl v4.1 breaks compatibility with cuTENSOR. I think basically CUDA.jl v4.1 bumps to CUDA 12.1 [1] but CUDA 12.1 isn't supported by cuTENSOR [2].

[1] JuliaGPU/CUDA.jl#1793
[2] https://docs.nvidia.com/cuda/cutensor/index.html#support

[mtfishman]

Looks like this issue reported about CUDA.jl v4 and cuDNN may be related: JuliaGPU/CUDA.jl#1850