Rebuild for CUDA 12 w/arch + Windows support #227

regro-cf-autotick-bot · 2024-02-14T00:06:58Z

This PR has been triggered in an effort to update cuda120.

Notes and instructions for merging this PR:

Please merge the PR only after the tests have passed.
Feel free to push to the bot's branch to update this PR if needed.

Please note that if you close this PR we presume that the feedstock has been rebuilt, so if you are going to perform the rebuild yourself don't close this PR until the your rebuild has been merged.

Here are some more details about this specific migrator:

The transition to CUDA 12 SDK includes new packages for all CUDA libraries and build tools. Notably, the cudatoolkit package no longer exists, and packages should depend directly on the specific CUDA libraries (libcublas, libcusolver, etc) as needed. For an in-depth overview of the changes and to report problems see this issue. Please feel free to raise any issues encountered there. Thank you! 🙏

If this PR was opened in error or needs to be updated please add the bot-rerun label to this PR. The bot will close this PR and schedule another one. If you do not have permissions to add this label, you can use the phrase @conda-forge-admin, please rerun bot in a PR comment to have the conda-forge-admin add it for you.

_{This PR was created by the regro-cf-autotick-bot. The regro-cf-autotick-bot is a service to automatically track the dependency graph, migrate packages, and propose package version updates for conda-forge. Feel free to drop us a line if there are any issues! This PR was generated by https://github.com/regro/cf-scripts/actions/runs/7893793235, please use this URL for debugging.}

The transition to CUDA 12 SDK includes new packages for all CUDA libraries and build tools. Notably, the cudatoolkit package no longer exists, and packages should depend directly on the specific CUDA libraries (libcublas, libcusolver, etc) as needed. For an in-depth overview of the changes and to report problems [see this issue]( conda-forge/conda-forge.github.io#1963 ). Please feel free to raise any issues encountered there. Thank you! 🙏

…nda-forge-pinning 2024.02.13.22.01.17

conda-forge-webservices · 2024-02-14T00:07:05Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

ngam · 2024-03-05T07:58:28Z

recipe/meta.yaml

+    - cudnn             # [cuda_compiler_version != "None"]
+    - nccl              # [cuda_compiler_version != "None"]
+    - cuda-cupti-dev    # [(cuda_compiler_version or "").startswith("12")]
+    - cuda-cudart-dev   # [(cuda_compiler_version or "").startswith("12")]
+    - cuda-nvml-dev     # [(cuda_compiler_version or "").startswith("12")]
+    - cuda-nvtx-dev     # [(cuda_compiler_version or "").startswith("12")]
+    - libcublas-dev     # [(cuda_compiler_version or "").startswith("12")]
+    - libcusolver-dev   # [(cuda_compiler_version or "").startswith("12")]
+    - libcurand-dev     # [(cuda_compiler_version or "").startswith("12")]
+    - libcufft-dev      # [(cuda_compiler_version or "").startswith("12")]
+    - libcusparse-dev   # [(cuda_compiler_version or "").startswith("12")]


Does anyone know if any of these has the ptxas binary in it?

in the nvidia channel, ptxas used to be in cuda-nvcc. Either ptxas or nvlink is needed for jaxlib to actually function ...

I guess it is still in cuda-nvcc in conda-forge (see https://github.com/conda-forge/cuda-nvcc-feedstock), via some transitive dependency that ends in https://conda-metadata-app.streamlit.app/?q=conda-forge%2Fnoarch%2Fcuda-nvcc-impl_linux-64-12.0.76-h59595ed_2.conda .

Well, alright, that's good to know, but also note I think we only have cuda-nvcc for 12+, meaning one would need to get cuda-nvcc from the nvda channel. Surprised not many people are complaining...

ngam · 2024-03-05T07:59:13Z

recipe/build.sh

+    if [[ ${cuda_compiler_version} == 11.8 ]]; then
        export TF_CUDA_COMPUTE_CAPABILITIES=sm_35,sm_50,sm_60,sm_62,sm_70,sm_72,sm_75,sm_80,sm_86,sm_87,sm_89,sm_90,compute_90
+	export TF_CUDA_PATHS="${CUDA_HOME},${PREFIX}"
+    elif [[ ${cuda_compiler_version} == 12* ]]; then
+        export TF_CUDA_COMPUTE_CAPABILITIES=sm_60,sm_70,sm_75,sm_80,sm_86,sm_89,sm_90,compute_90


should we reduce the target arches here to save a little of time? it likely won't be enough though ...

isuruf · 2024-03-13T15:43:40Z

@conda-forge/jaxlib, shall I set up a bigger runner for this repo using https://github.com/Quansight/open-gpu-server/ ?

xhochy · 2024-03-13T15:50:46Z

@conda-forge/jaxlib, shall I set up a bigger runner for this repo using https://github.com/Quansight/open-gpu-server/ ?

Yes, that would be interesting. It probably doesn't solve all the issues as also osx sometimes times out but relieves a bit of the pressure.

…irun

…nda-forge-pinning 2024.03.13.18.01.29

conda-forge-webservices · 2024-03-13T20:47:10Z

Hi! This is the friendly automated conda-forge-linting service.

I was trying to look for recipes to lint for you, but it appears we have a merge conflict.
Please try to merge or rebase with the base branch to resolve this conflict.

Please ping the 'conda-forge/core' team (using the @ notation in a comment) if you believe this is a bug.

…into rebuild-cuda120-0-3_hd740a2

conda-forge-webservices · 2024-03-13T20:56:42Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

conda-forge-webservices · 2024-03-15T02:20:40Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

I do have some suggestions for making it better though...

For recipe:

        'Test On Native Only' is deprecated.

This was used for disabling testing for cross-compiling.

This has been deprecated in favor of the top-level `test` field.
It is now mapped to `test: native_and_emulated`.

        Failed validating 'deprecated' in schema['properties']['test_on_native_only']:
            {'anyOf': [{'type': 'boolean'}, {'type': 'null'}],
             'default': False,
             'deprecated': True,
             'description': 'This was used for disabling testing for '
                            'cross-compiling.\n'
                            '\n'
                            '```warning\n'
                            'This has been deprecated in favor of the top-level '
                            '`test` field.\n'
                            'It is now mapped to `test: native_and_emulated`.\n'
                            '```',
             'title': 'Test On Native Only'}

        On instance['test_on_native_only']:
            True

isuruf · 2024-03-16T16:26:46Z

This should be good to go. I can resolve the conflicts and merge.

xhochy

Go for it!

conda-forge-webservices · 2024-03-16T22:06:45Z

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

ngam · 2024-03-17T07:35:51Z

We should add cuda-nvcc for cuda120 (can address in a follow-up pr; jaxlib cuda isn't functional without ptxas which comes from cuda-nvcc)

traversaro · 2024-03-17T22:14:39Z

We should add cuda-nvcc for cuda120 (can address in a follow-up pr; jaxlib cuda isn't functional without ptxas which comes from cuda-nvcc)

See also https://github.com/google/jax/blob/aaeeaf5f0caa497d2f6e33d995cdd88a07ee523a/jaxlib/setup.py#L81-L88 for a reference for this runtime dependency.

regro-cf-autotick-bot added 2 commits February 14, 2024 00:06

MNT: Re-rendered with conda-build 3.28.4, conda-smithy 3.30.4, and co…

459736d

…nda-forge-pinning 2024.02.13.22.01.17

regro-cf-autotick-bot requested review from ericmjl, ngam and xhochy as code owners February 14, 2024 00:06

CUDA 12 fixes

1e71a17

ngam reviewed Mar 5, 2024

View reviewed changes

automatic conda-forge administrator and others added 2 commits March 13, 2024 15:43

Enable cirun-openstack-cpu-large, cirun-openstack-cpu-2xlarge using C…

381dd73

…irun

MNT: Re-rendered with conda-build 24.1.2, conda-smithy 3.31.1, and co…

2199352

…nda-forge-pinning 2024.03.13.18.01.29

Merge branch 'main' of https://github.com/conda-forge/jaxlib-feedstock …

4004165

…into rebuild-cuda120-0-3_hd740a2

isuruf mentioned this pull request Mar 13, 2024

Update feedstock to use cirun-openstack-cpu-large, cirun-openstack-cpu-2xlarge with Cirun #237

Closed

1 task

isuruf added 3 commits March 14, 2024 11:43

Reduce CPU_COUNT

e4a3374

Reduce CPU_COUNT to 3

3258b98

Update meta.yaml

a6317cd

Update build.sh

434aab1

xhochy approved these changes Mar 16, 2024

View reviewed changes

Merge branch 'main' into rebuild-cuda120-0-3_hd740a2

abe25a3

isuruf merged commit f242323 into conda-forge:main Mar 16, 2024
2 of 27 checks passed

regro-cf-autotick-bot deleted the rebuild-cuda120-0-3_hd740a2 branch March 16, 2024 22:19

ngam mentioned this pull request Mar 17, 2024

JAX: Support CUDA 12 #223

Closed

traversaro mentioned this pull request Mar 17, 2024

Update repo for recent pixi, recent mujoco and use CUDA 12 traversaro/mujoco-mjx-pixi-example#7

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Rebuild for CUDA 12 w/arch + Windows support #227

Rebuild for CUDA 12 w/arch + Windows support #227

regro-cf-autotick-bot commented Feb 14, 2024

conda-forge-webservices bot commented Feb 14, 2024

ngam Mar 5, 2024

ngam Mar 5, 2024

traversaro Mar 7, 2024

ngam Mar 7, 2024

ngam Mar 5, 2024

isuruf commented Mar 13, 2024

xhochy commented Mar 13, 2024

conda-forge-webservices bot commented Mar 13, 2024

conda-forge-webservices bot commented Mar 13, 2024

conda-forge-webservices bot commented Mar 15, 2024

isuruf commented Mar 16, 2024

xhochy left a comment

conda-forge-webservices bot commented Mar 16, 2024

ngam commented Mar 17, 2024

traversaro commented Mar 17, 2024

Rebuild for CUDA 12 w/arch + Windows support #227

Rebuild for CUDA 12 w/arch + Windows support #227

Conversation

regro-cf-autotick-bot commented Feb 14, 2024

conda-forge-webservices bot commented Feb 14, 2024

ngam Mar 5, 2024

Choose a reason for hiding this comment

ngam Mar 5, 2024

Choose a reason for hiding this comment

traversaro Mar 7, 2024

Choose a reason for hiding this comment

ngam Mar 7, 2024

Choose a reason for hiding this comment

ngam Mar 5, 2024

Choose a reason for hiding this comment

isuruf commented Mar 13, 2024

xhochy commented Mar 13, 2024

conda-forge-webservices bot commented Mar 13, 2024

conda-forge-webservices bot commented Mar 13, 2024

conda-forge-webservices bot commented Mar 15, 2024

isuruf commented Mar 16, 2024

xhochy left a comment

Choose a reason for hiding this comment

conda-forge-webservices bot commented Mar 16, 2024

ngam commented Mar 17, 2024

traversaro commented Mar 17, 2024