Skip to content

Commit

Permalink
[SPARK-46078][PYTHON][TESTS] Upgrade pytorch for Python 3.12
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?

This PR proposes to upgrade PyTorch for Python 3.12

This PR is dependent on #45113

### Why are the changes needed?

To use the official releases.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Will be verified in CI. Seems like their support on Mac is not out yet.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #45119 from HyukjinKwon/SPARK-46078.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
  • Loading branch information
HyukjinKwon committed Feb 16, 2024
1 parent 7668eb5 commit 3a146ce
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions dev/infra/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -133,9 +133,7 @@ RUN apt-get update && apt-get install -y \
&& rm -rf /var/lib/apt/lists/*
RUN curl -sS https://bootstrap.pypa.io/get-pip.py | python3.12
# TODO(SPARK-46647) Add unittest-xml-reporting into Python 3.12 image when it supports Python 3.12
# TODO(SPARK-46078) Use official one instead of nightly build when it's ready
RUN python3.12 -m pip install $BASIC_PIP_PKGS $CONNECT_PIP_PKGS lxml && \
python3.12 -m pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cpu && \
python3.12 -m pip install torchvision --index-url https://download.pytorch.org/whl/cpu && \
python3.12 -m pip install torch torchvision --index-url https://download.pytorch.org/whl/cpu && \
python3.12 -m pip install torcheval && \
python3.12 -m pip cache purge

0 comments on commit 3a146ce

Please sign in to comment.