Project Limit Request: torch - 300-500 GB

[atalman]

Project URL

https://pypi.org/project/torch/

Does this project already exist?

• Yes

New limit

300-500

Update issue title

• I have updated the title.

Which indexes

PyPI

About the project

PyTorch is a Python package that provides two high-level features:

Tensor computation (like NumPy) with strong GPU acceleration
Deep neural networks built on a tape-based autograd system
You can reuse your favorite Python packages such as NumPy, SciPy, and Cython to extend PyTorch when needed.

Our trunk health (Continuous Integration signals) can be found at hud.pytorch.org.

How large is each release?

6GB

Current limits

Project size: 139.7 GiB
Project total size limit: 160.0 GiB

Limit will be reached within 3 releases (in 3 month)

How frequently do you make a release?

Once a Month

Code of Conduct

• I agree to follow the PSF Code of Conduct

[atalman]

cc @malfet @seemethere

[malfet]

I have an idea how one can decrease a size of each release: by separating python independent and python dependent part of the package

[atalman]

To Pypi team: The work of decreasing size of each release will be prioritized now. However we still need size increase to unblock current releases for year 2024

[atalman]

After release 2.3 is completed:
Project size: 144.8 GiB
Project total size limit: 160.0 GiB

[atalman]

After deleting *.post2 releases.

Current limit on pypi:
Project size: 141.4 GiB
Project total size limit: 160.0 GiB

[DEKHTIARJonathan]

Hi @cmaureir, if you could help to get the ball moving, it would be immensely useful

[cmaureir]

Hello @atalman @DEKHTIARJonathan @malfet
I've set the project limit for torch to 300 GB on PyPI. Please be mindful this is now one of the largest projects on PyPI, but I understand how important is for the Python ecosystem.
I would appreciate you can keep this in mind for future releases, and see if other options to split the package further on, or explore the Python Limited API to reduce the amount of wheels for each release.

Have a nice week 💯

[gottbrath]

Thank you for addressing this before we had to delete back versions. We're looking at the wheel-next and other options that will allow us to be more space efficient.

[atalman]

Thank you @cmaureir for looking into this issue!