Skip to content

[deps] Ray py3.14 dependencies and requirements for image building#63080

Merged
elliot-barn merged 4 commits into
masterfrom
elliot-barn-py314-image
May 10, 2026
Merged

[deps] Ray py3.14 dependencies and requirements for image building#63080
elliot-barn merged 4 commits into
masterfrom
elliot-barn-py314-image

Conversation

@elliot-barn
Copy link
Copy Markdown
Collaborator

@elliot-barn elliot-barn commented May 1, 2026

generating py3.14 lock file and allowing for py3.14 image builds

Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces initial support for Python 3.14 by updating the CI dependency configurations and adding a compiled requirements file. Feedback indicates that the new lock file likely wasn't re-compiled correctly for Python 3.14, as it contains environment markers that exclude the version and references Python 3.13 source paths. Additionally, the CI configuration should be expanded to include Python 3.14 in other dependency sets for project-wide consistency.

# via msrestazure
adlfs==2026.4.0
# via -r python/requirements/cloud-requirements.txt
aim==3.23.0 ; python_version < "3.12"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

critical

This lock file contains packages with environment markers that explicitly exclude Python 3.14 (e.g., aim==3.23.0 ; python_version < "3.12"). This indicates that the file was likely copied from an older Python version's lock file and not correctly re-compiled for 3.14 using uv pip compile --python-version 3.14.

Comment on lines +25 to +26
# -r python/requirements/ml/py313/core-requirements.txt
# -r python/requirements/ml/py313/train-requirements.txt
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

The # via comments in this file reference Python 3.13 requirement paths (e.g., python/requirements/ml/py313/core-requirements.txt). For a Python 3.14 lock file, these should point to the corresponding 3.14 requirement files to ensure dependency correctness and parity across environments.

Comment on lines +16 to +18
py314:
PYTHON_VERSION: "3.14"
PYTHON_SHORT: "314"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The py314 build argument set is only being used by ray_img_depset. To provide consistent Python 3.14 support across the project, it should also be added to the build_arg_sets of other depsets in this file, such as ray_base_extra_testdeps, ray_base_slim, and ray_base_deps.

Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
@elliot-barn elliot-barn changed the title [deps] generating py3.14 lock file [deps] Ray py3.14 image building May 4, 2026
Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
@elliot-barn elliot-barn marked this pull request as ready for review May 5, 2026 23:43
@ray-gardener ray-gardener Bot added the core Issues that should be addressed in Ray Core label May 6, 2026
@elliot-barn elliot-barn changed the title [deps] Ray py3.14 image building [deps] Ray py3.14 dependencies and requirements for image building May 6, 2026
@elliot-barn elliot-barn requested a review from aslonnie May 6, 2026 20:00
@aslonnie aslonnie requested a review from a team May 6, 2026 23:15
rm /tmp/miniforge.sh
$HOME/anaconda3/bin/conda install -y libgcc-ng python=$PYTHON_VERSION
$HOME/anaconda3/bin/conda install -y -c conda-forge libffi=3.4.2
$HOME/anaconda3/bin/conda install -y -c conda-forge libffi=3.4.6
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why libffi change is required?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

python 3.14.0 requires libffi >=3.4.6,<3.5.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aslonnie aslonnie added the go add ONLY when ready to merge, run all tests label May 6, 2026
Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
@elliot-barn elliot-barn merged commit 62b0069 into master May 10, 2026
6 checks passed
@elliot-barn elliot-barn deleted the elliot-barn-py314-image branch May 10, 2026 21:37
dancingactor pushed a commit to dancingactor/ray that referenced this pull request May 13, 2026
…ay-project#63080)

generating py3.14 lock file and allowing for py3.14 image builds

---------

Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
am-kinetica pushed a commit to kineticadb/ray that referenced this pull request May 14, 2026
…ay-project#63080)

generating py3.14 lock file and allowing for py3.14 image builds

---------

Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
Signed-off-by: anindyam1969 <amukherjee@kinetica.com>
Lucas61000 pushed a commit to Lucas61000/ray that referenced this pull request May 15, 2026
…ay-project#63080)

generating py3.14 lock file and allowing for py3.14 image builds

---------

Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Issues that should be addressed in Ray Core go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants