Add colocated python Dockerfile and build upload script#4084
Conversation
|
Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA). View this failed invocation of the CLA check for more information. For the most up to date status, view the checks section at the bottom of the pull request. |
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
e94fad5 to
23aa8b5
Compare
f4363cf to
d98ff72
Compare
d98ff72 to
460e239
Compare
460e239 to
3952f9b
Compare
3952f9b to
f989228
Compare
f989228 to
aff804a
Compare
|
@bvandermoon Can you please review this PR? |
|
Synced with @ycchenzheng offline and here are the next steps that we discussed:
|
Tracking future implementation in b/528026019 |
Description
This PR is to add colocated python image related Dockerfile and build&upload script.
src/dependencies/dockerfiles/colocated_python.Dockerfileis added to install all necessary dependencies for base imageus-docker.pkg.dev/cloud-tpu-v2-images/pathways-colocated-python/sidecarsrc/dependencies/scripts/build_upload_colocated_python_image.shwill automatically pick base docker image fromus-docker.pkg.dev/cloud-tpu-v2-images/pathways-colocated-python/sidecarthat matchesjaxversion insrc/dependencies/requirements/generated_requirements/tpu-requirements.txtExample usage:
FIXES: b/515481092
Tests
Tested colocated python images built by this change with different TPU versions & topologies
Example logs
Checklist
Before submitting this PR, please make sure (put X in square brackets):
gemini-reviewlabel.