Do not build CUDA libs in Python jobs

[jjacobelli]

This PR should prevent building CUDA libs in Python jobs and speed up CI

[codecov-commenter]

Codecov Report

Merging #2039 (37b8912) into branch-22.02 (2e781c1) will not change coverage.
The diff coverage is n/a.

❗ Current head 37b8912 differs from pull request most recent head 1977c0c. Consider uploading reports for the commit 1977c0c to get more accurate results

@@              Coverage Diff              @@
##           branch-22.02    #2039   +/-   ##
=============================================
  Coverage         73.26%   73.26%           
=============================================
  Files               151      151           
  Lines              9736     9736           
=============================================
  Hits               7133     7133           
  Misses             2603     2603           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2e781c1...1977c0c. Read the comment docs.

[jjacobelli]

@gpucibot merge