Skip to content

[deps][ci] Introduce py312 + cuda13 depsets#61496

Merged
aslonnie merged 2 commits intomasterfrom
cuda13-image
Mar 5, 2026
Merged

[deps][ci] Introduce py312 + cuda13 depsets#61496
aslonnie merged 2 commits intomasterfrom
cuda13-image

Conversation

@jeffreywang-anyscale
Copy link
Contributor

@jeffreywang-anyscale jeffreywang-anyscale commented Mar 4, 2026

Description

vLLM is moving to py312 + cuda13, and we'd like to adapt ray-llm CI environment to match that.

Follow up

Introduce CUDA 13 images for ray-llm and core-gpu: #61497

Related issues

Link related issues: "Fixes #1234", "Closes #1234", or "Related to #1234".

Additional information

Optional: Add implementation details, API changes, usage examples, screenshots, etc.

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces support for Python 3.12 with CUDA 13 by updating dependency sets and removing the old py312 + cuda12.9 configurations. The changes across CI configuration files (.rayci.yml, .depsets.yaml) and various lock files are consistent with this goal. CI configurations are correctly updated to remove old build matrices, and dependency files are updated to use cu130. The lock files have been correctly regenerated and renamed. The changes appear to be correct and align with the PR's description.

Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
@jeffreywang-anyscale jeffreywang-anyscale added the go add ONLY when ready to merge, run all tests label Mar 4, 2026
@ray-gardener ray-gardener bot added the devprod label Mar 5, 2026
@aslonnie aslonnie merged commit f83a7fa into master Mar 5, 2026
7 checks passed
@aslonnie aslonnie deleted the cuda13-image branch March 5, 2026 04:43
manhld0206 pushed a commit to manhld0206/ray that referenced this pull request Mar 5, 2026
## Description
vLLM is moving to py312 + cuda13, and we'd like to adapt ray-llm CI
environment to match that.
- Add depsets for py312 + cuda13
- Remove py312 + cuda12.9 depsets and ray-llm CI / release images
introduced in ray-project#61116 and
ray-project#61149 respectively. Images are
removed together because they depend on py312 + cuda12.9 depsets.

### Follow up
Introduce CUDA 13 images for ray-llm and core-gpu:
ray-project#61497

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

---------

Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Signed-off-by: Mạnh Lê Đức <naruto12308@gmail.com>
bittoby pushed a commit to bittoby/ray that referenced this pull request Mar 6, 2026
## Description
vLLM is moving to py312 + cuda13, and we'd like to adapt ray-llm CI
environment to match that.
- Add depsets for py312 + cuda13
- Remove py312 + cuda12.9 depsets and ray-llm CI / release images
introduced in ray-project#61116 and
ray-project#61149 respectively. Images are
removed together because they depend on py312 + cuda12.9 depsets.

### Follow up
Introduce CUDA 13 images for ray-llm and core-gpu:
ray-project#61497

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

---------

Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Signed-off-by: bittoby <bittoby@users.noreply.github.com>
ParagEkbote pushed a commit to ParagEkbote/ray that referenced this pull request Mar 10, 2026
## Description
vLLM is moving to py312 + cuda13, and we'd like to adapt ray-llm CI
environment to match that.
- Add depsets for py312 + cuda13
- Remove py312 + cuda12.9 depsets and ray-llm CI / release images
introduced in ray-project#61116 and
ray-project#61149 respectively. Images are
removed together because they depend on py312 + cuda12.9 depsets.

### Follow up
Introduce CUDA 13 images for ray-llm and core-gpu:
ray-project#61497

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

---------

Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Signed-off-by: Parag Ekbote <thecoolekbote189@gmail.com>
aslonnie pushed a commit that referenced this pull request Mar 12, 2026
## Description
vLLM is moving to py312 + cuda13. To accommodate that, add CUDA 13 CI
and release images for ray-llm and core-gpu.

## Approach
### Ray-LLM on CUDA 13

- **CI:** `llmgpubuild-py312` build step using `cu130` base
(`.buildkite/llm.rayci.yml`)
- **Release images:** `ray-llm-anyscale` py3.12 + `cu13.0.0-cudnn` built
and published (`.buildkite/release/build.rayci.yml`)
- **BYOD type:** `llm-cu130` (requires Python 3.12)
- **Python:** 3.12

### Core-GPU (Compiled Graphs) on CUDA 13

- **CI:** `coregpu-cu130-build` + `core-multi-gpu-cu130-tests` steps
(`.buildkite/core.rayci.yml`)
- **Release images:** `ray-ml-anyscale` py3.10 + `cu13.0.0-cudnn` built
and published through the full ray-ml chain
- **BYOD type:** `gpu-cu130` (requires Python 3.10)
- **Release tests:** `compiled_graphs_GPU_cu130` and
`compiled_graphs_GPU_multinode_cu130` on L4 instances
- **Python:** 3.10


### Summary Table

| Workload  | BYOD Type   | Python | CUDA | Image Repo         |
|------------|------------|--------|------|-------------------|
| Ray-LLM    | llm-cu128  | 3.11   | 12.8 | anyscale/ray-llm  |
| Ray-LLM    | llm-cu130  | 3.12   | 13.0 | anyscale/ray-llm  |
| Core-GPU   | gpu        | 3.10   | 12.1 | anyscale/ray-ml   |
| Core-GPU   | gpu-cu130  | 3.10   | 13.0 | anyscale/ray-ml   |

## Prerequisite
#61496

## Follow up
- Add BYOD types (llm-cu130, gpu-cu130), release test entries, and
compute configs for compiled graph tests on CUDA 13.
- Switch ray-llm tests to the new py312 + cuda13 image & core-gpu tests
(compiled graphs) to run on the new cuda13 image.

## Related issues
This is the first step to resolve
#61384.

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

---------

Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Co-authored-by: Andrew Pollack-Gray <andrew@anyscale.com>
ryanaoleary pushed a commit to ryanaoleary/ray that referenced this pull request Mar 13, 2026
## Description
vLLM is moving to py312 + cuda13, and we'd like to adapt ray-llm CI
environment to match that.
- Add depsets for py312 + cuda13
- Remove py312 + cuda12.9 depsets and ray-llm CI / release images
introduced in ray-project#61116 and
ray-project#61149 respectively. Images are
removed together because they depend on py312 + cuda12.9 depsets.

### Follow up
Introduce CUDA 13 images for ray-llm and core-gpu:
ray-project#61497

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

---------

Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

devprod go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Ray fails to serialize self-reference objects

2 participants