Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add volumeop and volumesnapshot support #93

Merged
merged 8 commits into from
Apr 21, 2020

Conversation

Tomcli
Copy link
Member

@Tomcli Tomcli commented Apr 14, 2020

Which issue is resolved by this Pull Request:
Resolves #51 and resolves #86

Description of your changes:
Add volumeop support with some workaround on the unsupported Argo variables and extend task outputs using an extra step. Ideally we should improve the wrapper with multiple outputs. I will create an issue for the wrapper issue so we can improve it in the future.

Update resourceOp with vincent's latest changes to support volumeop and volumesnapshotop.

Environment tested:

  • Python Version (use python --version): 3.6.4
  • Tekton Version (use tkn version): 0.11
  • Kubernetes Version (use kubectl version): 1.15
  • OS (e.g. from /etc/os-release):

@kubeflow-bot
Copy link

This change is Reviewable

@Tomcli
Copy link
Member Author

Tomcli commented Apr 16, 2020

Vincent updated the resourceop task, so i will update the volumeop with the corresponding changes soon.
/hold

@Tomcli Tomcli changed the title Add volumeop support Add volumeop and volumesnapshot support Apr 16, 2020
@Tomcli
Copy link
Member Author

Tomcli commented Apr 16, 2020

FYI, don't test with the default image yet because there's a small bug in the wrapper code. Will unhold this once the image is updated.

@Tomcli
Copy link
Member Author

Tomcli commented Apr 17, 2020

/unhold
Note the volume snapshot is only available with feature gate because kfp is still using the alpha api which is also mentioned in the comments..

@Tomcli
Copy link
Member Author

Tomcli commented Apr 17, 2020

/assign @fenglixa

SUCCESS: volumeop_basic.py
SUCCESS: volumeop_dag.py
SUCCESS: volumeop_parallel.py
SUCCESS: volumeop_sequential.py
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a question here, does all these volumeop works now?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These pipelines should work as long as your default storageclass support readwritemany.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tested the basic and parallel one on my cluster and they are running as expected.

success_condition = op.resource.get('success_condition')
failure_condition = op.resource.get('failure_condition')
success_condition = op.resource.get('successCondition')
failure_condition = op.resource.get('failureCondition')
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, thanks.

@fenglixa
Copy link
Member

Thanks @Tomcli
/lgtm

@Tomcli
Copy link
Member Author

Tomcli commented Apr 21, 2020

/assign @animeshsingh @ckadner
Do you guys have any question/opinion on this PR?

Copy link
Collaborator

@animeshsingh animeshsingh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update the conflicts

@k8s-ci-robot k8s-ci-robot removed the lgtm label Apr 21, 2020
@animeshsingh
Copy link
Collaborator

/lgtm
/approve

@k8s-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: animeshsingh

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot merged commit a47ae08 into kubeflow:master Apr 21, 2020
@Tomcli Tomcli deleted the volumeop-support branch May 20, 2020 17:20
HumairAK referenced this pull request in red-hat-data-services/data-science-pipelines-tekton May 16, 2023
Add namespace and DSPA name in Reconciler logs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

support volumeSnapShotOp add support for dsl.volumeOps
6 participants