jaxlib versions deprecated from PyPi repository

[sergiuiacob1]

Description

This is the second / third time I've experienced CI pipelines failing suddenly over night due to jaxlib / jax / iree libraries having versions deprecated in the PyPi repository. Not to mention the amount of breaking changes that happen between version bumps, which means upgrading is not so straightforward.

This breaks long-living projects and should be treated more seriously. Specifically in my case, jaxlib==0.3.15 is not available anymore.

In my case, upgrading is very time consuming – looking for a solution to install 0.3.15 from an archive, if there's any

What jax/jaxlib version are you using?

0.3.15

Which accelerator(s) are you using?

CPU

Additional system info

NVIDIA GPU info

[sergiuiacob1]

For iree, there's this: https://iree.dev/pip-release-links.html

Is there something like this for jaxlib?

[yudonglee]

+1， why jaxlib's 0.3.25 is deprecated ? It's not too old. Could you just recover it please ?

[hawkinsp]

Simple: we ran out of space on Pypi. This happens regularly: for pretty much every new release, we have to delete one or more old releases.

Older jax releases are available in this GCS bucket: https://storage.googleapis.com/jax-releases/jax_releases.html

i.e.: pip install jax==VERSION -f https://storage.googleapis.com/jax-releases/jax_releases.html

Perhaps it's time to ask pypi again for more space. They weren't very excited about giving us more last time we asked.

[cemlyn007]

I think in the future it would have been nice to have had a heads up!

[jakevdp]

I think in the future it would have been nice to have had a heads up!

What medium would have worked to give you this heads-up? A pinned discussion? A CHANGELOG entry?

[cemlyn007]

I check the CHANGELOG regularly thanks to GitHub notifications as I'm always excited to see what is happening with JAX, but to be honest we might just install jaxlib using https://storage.googleapis.com/jax-releases/jax_releases.html that Hawkins pointed out since this is a friction point with PyPi having a storage limit!

Do you think https://storage.googleapis.com/jax-releases/jax_releases.html will be more stable than PyPi going forward?

[jakevdp]

We plan to keep wheels indefinitely on https://storage.googleapis.com/jax-releases/jax_releases.html, and unless something changes you can expect all older wheels to eventually be removed from PyPI as we run out of space.

[cemlyn007]

Okay great, hope you guys have a good weekend! 💯

[sergiuiacob1]

@hawkinsp @jakevdp Thank you for your answers and for your contributions. The link above to the GCS bucket should do for now.

One improvement which could be done here is make the jax/jaxlib library output a "This version will be deprecated after Date" message at startup, but I realize that may not be so foreseeable unless there's a fixed release schedule.

That being said, I consider this issue done, thank you!

[lucaslingle]

@hawkinsp @jakevdp

I am looking at the Google Storage bucket linked above and I don't see anything hosted for Jax 0.2.*.

The LRA codebase raises an error indicating a breaking change when I used Jax 0.3.*, and the LRA repo provides a loosely-specified dependency of jax>=0.2.4, so including Jax 0.2.* on the aforementioned Google Storage bucket would be very helpful.

Can you make these versions available as well? Thank you!

[jakevdp]

This question is answered here: #18993 (comment)

All previous jaxlib versions are available at the cloud storage bucket. Note that there was never a v0.2.X release of jaxlib (it went straight from jaxlib 0.1.76 to jaxlib 0.3.0).