Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pin Python dependency versions #60491

Closed
wants to merge 14 commits into from
Closed

Pin Python dependency versions #60491

wants to merge 14 commits into from

Conversation

venkat2469
Copy link
Contributor

No description provided.

astunparse ~= 1.6.3
flatbuffers ~= 23.1.21
flatbuffers == 23.3.3
google_pasta ~= 0.2
h5py ~= 3.8.0 # Earliest version for Python 3.11
# TODO(b/262592253): Support older versions of NumPy for Python 3.10 and lower
# to support TFX. Remove when Apache Beam upgrades to newer NumPy.
numpy ~= 1.22.0; python_version < '3.11'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to change this to ==

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You need to change the above numpy too. The above should be 1.22.4, the below should probably be 1.23.2

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Still need to change this numpy.

astunparse ~= 1.6.3
flatbuffers ~= 2.0
flatbuffers == 23.3.3
google_pasta ~= 0.2
h5py ~= 3.8.0 # Earliest version for Python 3.11
# TODO(b/262592253): Support older versions of NumPy for Python 3.10 and lower
# to support TFX. Remove when Apache Beam upgrades to newer NumPy.
numpy ~= 1.22.0; python_version < '3.11'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to be ==

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Still need to handle this numpy

Copy link
Collaborator

@mihaimaruseac mihaimaruseac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

astunparse ~= 1.6.3
flatbuffers ~= 23.1.21
flatbuffers == 23.3.3
google_pasta ~= 0.2
h5py ~= 3.8.0 # Earliest version for Python 3.11
# TODO(b/262592253): Support older versions of NumPy for Python 3.10 and lower
# to support TFX. Remove when Apache Beam upgrades to newer NumPy.
numpy ~= 1.22.0; python_version < '3.11'
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You need to change the above numpy too. The above should be 1.22.4, the below should probably be 1.23.2

Copy link
Collaborator

@mihaimaruseac mihaimaruseac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't forget about the other files.

astunparse ~= 1.6.3
flatbuffers ~= 23.1.21
flatbuffers == 23.3.3
google_pasta ~= 0.2
h5py ~= 3.8.0 # Earliest version for Python 3.11
# TODO(b/262592253): Support older versions of NumPy for Python 3.10 and lower
# to support TFX. Remove when Apache Beam upgrades to newer NumPy.
numpy ~= 1.22.0; python_version < '3.11'
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Still need to change this numpy.

scipy ~= 1.7.2; python_version < '3.11'
grpcio == 1.49.1 # Earliest version for Python 3.11
portpicker == 1.4.0
scipy == 1.7.3; python_version < '3.11'
scipy ~= 1.9.2; python_version >= '3.11' # Earliest version for Python 3.11
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't forget about this scipy

Comment on lines 35 to 39
<<<<<<< HEAD
scipy ~= 1.7.3; python_version < '3.11'
=======
scipy == 1.7.3; python_version < '3.11'
>>>>>>> refs/remotes/origin/venkat-patch-12
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This has conflict markers

@@ -4,9 +4,9 @@
certifi ~= 2022.12.07
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This also needs to change

astunparse ~= 1.6.3
flatbuffers ~= 2.0
flatbuffers == 23.3.3
google_pasta ~= 0.2
h5py ~= 3.8.0 # Earliest version for Python 3.11
# TODO(b/262592253): Support older versions of NumPy for Python 3.10 and lower
# to support TFX. Remove when Apache Beam upgrades to newer NumPy.
numpy ~= 1.22.0; python_version < '3.11'
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Still need to handle this numpy

scipy ~= 1.7.2; python_version < '3.11'
grpcio == 1.49.1 # Earliest version for Python 3.11
portpicker == 1.4.0
scipy == 1.7.3; python_version < '3.11'
scipy ~= 1.9.2; python_version >= '3.11' # Earliest version for Python 3.11
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't forget about this scipy

jax ~= 0.3.24
jaxlib ~= 0.3.24 # Earliest version for Python 3.11
jax == 0.3.25
jaxlib == 0.3.25 # Earliest version for Python 3.11
# Needs to be addressed. Unblocked 2.4 branchcut cl/338377048
PyYAML ~= 6.0
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Needs pin

jax ~= 0.3.24
jaxlib ~= 0.3.24 # Earliest version for Python 3.11
jax == 0.3.25
jaxlib == 0.3.25 # Earliest version for Python 3.11
# Needs to be addressed. Unblocked 2.4 branchcut cl/338377048
PyYAML ~= 6.0
# For uploading
auditwheel ~= 5.0.0
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Needs pin

Comment on lines 50 to 51
lxml ~= 4.9.1
pylint ~= 2.13.9
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need pin

typing_extensions ~= 3.10.0.0
wheel ~= 0.38.1
wrapt ~= 1.14.1
numpy ~= 1.22.4; python_version < '3.11'
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

==

h5py ~= 3.8.0 # Earliest version for Python 3.11
absl-py == 1.0.0
astunparse == 1.6.3
flatbuffers == 23.1.21
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems wrong. From 2.0 to 23.1.21?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so can i use the same 2.0 ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You have to use the python wheel version number

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As for what number to use, you have to see what gets installed in the build log for the last nightly and use that one

@venkat2469 venkat2469 closed this May 4, 2023
@mihaimaruseac mihaimaruseac deleted the venkat-patch-12 branch May 4, 2023 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants