Run the CUDA tests with a few configurations

[tcojean]

Use amdci to run some CUDA tests.

Thanks to the new card, we can use amdci to run some CUDA tests.
In order to not overload the machines, I only use it with CUDA 11.0 for now.

[yhmtsai]

CUDA_ARCH should be 61?
or, we can also add this argument to image but it needs to handle the CUDA_VISIBLE_DEVICES carefully.

[pratikvn]

LGTM!

[thoasm]

LGTM!

[tcojean]

I was a bit too quick in the setup on the machine. We are missing the nvidia-container runtime, thus the GPUs are not correctly passed to the containers.

[yhmtsai]

in cuda/hip container, do they both only see only one device?
If so, we may introduce the device_number inside the image such that it uses the number to set the visible device.
otherwise,

if [ -n "${CUDA_ARCH}" ]; then
    CUDA_ARCH_STR=-DGINKGO_CUDA_ARCHITECTURES=${CUDA_ARCH};
    CUDA_HOST_STR=-DCMAKE_CUDA_HOST_COMPILER=$(which ${CXX_COMPILER});
    export CUDA_VISIBLE_DEVICES=$((RANDOM % 2));
fi

sometimes it will fail.

[upsj]

Since it's likely we will soon move to another system, can we just remove the CUDA device randomization altogether?

[yhmtsai]

Will the old machine with 2 gpus not come back?
Sure, we can delete them now.
if we need them again, we can add more general rules for setting it.

[codecov]

Codecov Report

Merging #781 (bbe132a) into develop (b621017) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop     #781   +/-   ##
========================================
  Coverage    94.26%   94.26%           
========================================
  Files          400      400           
  Lines        31578    31579    +1     
========================================
+ Hits         29767    29768    +1     
  Misses        1811     1811           

Impacted Files	Coverage Δ
omp/reorder/rcm_kernels.cpp	97.53% <0.00%> (-0.61%)	⬇️
core/base/extended_float.hpp	92.23% <0.00%> (+0.97%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b621017...bbe132a. Read the comment docs.

[sonarcloud]

Kudos, SonarCloud Quality Gate passed!

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
No Duplication information