-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CI build for AMD Tensorflow & Pytorch #53309
Conversation
Hi @dibryant. Thanks for your PR. I'm waiting for a openshift member to verify that this patch is reasonable to test. If it is, they should reply with Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
@dibryant,
Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
@dibryant,
Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
/ok-to-test |
@dibryant,
Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added some review commends. Once you pass this PR from a second iteration of fixes you will need to run on your PC make job
this will auto generate some files that will fix the complaining jobs
@@ -58,7 +58,7 @@ images: | |||
- context_dir: base/ubi9-python-3.9 | |||
dockerfile_path: Dockerfile | |||
to: base-ubi9-python-3.9 | |||
- context_dir: jupyter/minimal/ubi9-python-3.9 | |||
- context_dir: jupyter/minimal/ubi9-python-3.9 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Remove the space
- context_dir: jupyter/minimal/ubi9-python-3.9 | |
- context_dir: jupyter/minimal/ubi9-python-3.9 |
run_if_changed: (base\/ubi9-python-3.9\/*)|(jupyter\/tensorflow\/ubi9-python-3.9\/*)|(jupyter\/datacience\/ubi9-python-3.9\/*)|(jupyter\/tensorflow\/ubi9-python-3.9\/*) | ||
steps: | ||
dependencies: | ||
SOURCE_IMAGE_REF: jupyter-amd-tensorflow-ubi9-python-3.9 | ||
env: | ||
IMAGE_REPO: workbench-images | ||
IMAGE_TAG: YearIndex | ||
RELEASE_VERSION: jupyter-amd-tensorflow-ubi9-python-3.9 | ||
workflow: opendatahub-io-ci-image-mirror |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hmm what is that block? This is could be removed i guess, since you have already added on the lines 974-993
IMAGE_REPO: workbench-images | ||
IMAGE_TAG: YearIndex | ||
RELEASE_VERSION: jupyter-amd-tensorflow-ubi9-python-3.9 | ||
workflow: opendatahub-io-ci-image-mirror | ||
- as: notebooks-e2e-tests | ||
skip_if_only_changed: ^docs\/|.github\/workflows\/*|\\.(md)$|^(\.gitignore|LICENSE|OWNERS|PROJECT)$ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You will also need to add e2e test section:
This should be added under habana-notebooks-e2e-tests
job and you may call it as amd-notebooks-e2e-test
In there you will need to do something similar that we do for the rest.
@dibryant,
Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for the awesome work
some comments.
dockerfile_path: Dockerfile | ||
from: amd-jupyter-minimal-ubi9-python-3.9 | ||
to: amd-jupyter-datascience-ubi9-python-3.9 | ||
- context_dir: jupyter/tensorflow/ubi9-python-3.9 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- context_dir: jupyter/tensorflow/ubi9-python-3.9 | |
- context_dir: jupyter/amd/tensorflow/ubi9-python-3.9 |
dockerfile_path: Dockerfile | ||
from: amd-jupyter-datascience-ubi9-python-3.9 | ||
to: amd-jupyter-tensorflow-ubi9-python-3.9 | ||
- context_dir: jupyter/pytorch/ubi9-python-3.9 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- context_dir: jupyter/pytorch/ubi9-python-3.9 | |
- context_dir: jupyter/amd/pytorch/ubi9-python-3.9 |
- as: notebook-amd-jupyter-ds-ubi9-python-3-9-image-mirror | ||
postsubmit: true | ||
steps: | ||
dependencies: | ||
SOURCE_IMAGE_REF: amd-jupyter-datascience-ubi9-python-3.9 | ||
env: | ||
IMAGE_REPO: workbench-images | ||
IMAGE_TAG: YearIndex | ||
RELEASE_VERSION: amd-jupyter-datascience-ubi9-python-3.9 | ||
workflow: opendatahub-io-ci-image-mirror |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For now, we can drop the AMD data-science and minimal, as we are not gonna provide them in.
leaving this for future.
Remove these lines, and the minimal as well, as we don't really provide them to the user.
@@ -160,7 +160,19 @@ images: | |||
- context_dir: jupyter/minimal/ubi9-python-3.9 | |||
dockerfile_path: Dockerfile | |||
from: amd-c9s-python-3.9 | |||
to: amd-jupyter-minimal-c9s-python-3.9 | |||
to: amd-jupyter-minimal-ubi9-python-3.9 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
to: amd-jupyter-minimal-ubi9-python-3.9 | |
to: amd-jupyter-minimal-c9s-python-3.9 |
Even though we use the directory, ubi9-python-3.9
we are still basing these on centos , so we should use the centos in naming them
can you do this for the below ones as well.
26a52ab
to
4f31061
Compare
@dibryant,
Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
@dibryant,
Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
@dibryant: The following tests failed, say
Full PR test history. Your PR dashboard. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/lgtm
/approve
/unhold
/pj-rehearse ack
thanks 👍
[REHEARSALNOTIFIER]
A total of 53 jobs have been affected by this change. The above listing is non-exhaustive and limited to 25 jobs. A full list of affected jobs can be found here Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
/lgtm |
@harshad16: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: atheo89, dibryant, harshad16 The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Fixes for https://issues.redhat.com/browse/RHOAIENG-6377
Contributing to PR: opendatahub-io/notebooks#557
Adding CI builds for AMD Pytorch and Tensorflow.