Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Argo workflow e2e test #777

Merged
merged 1 commit into from May 9, 2018
Merged

Argo workflow e2e test #777

merged 1 commit into from May 9, 2018

Conversation

ankushagarwal
Copy link
Contributor

@ankushagarwal ankushagarwal commented May 8, 2018

Fixes #740

This change is Reviewable

@ankushagarwal
Copy link
Contributor Author

/retest

@ankushagarwal ankushagarwal changed the title WIP Argo workflow e2e test Argo workflow e2e test May 9, 2018
@ankushagarwal
Copy link
Contributor Author

/cc @kunmingg @lluunn

@@ -162,7 +162,7 @@
{
name: "e2e",
dag: {
tasks: [
tasks: std.prune([
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do you need to prune here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For gke, the argo workflow step will be {}. prune removes that entry.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would prefer explicitly pruning the task list rather than relying on pruning at a higher level. I believe pruning at a higher level is not a good practice because sometimes there are parts of the manifest which require an explicit empty object, eg : https://github.com/kubeflow/kubeflow/blob/master/kubeflow/core/cert-manager.libsonnet#L7

{
name: "pytorchjob-deploy",
template: "pytorchjob-deploy",
dependencies: ["deploy-kubeflow"],
},
// Don't run argo test for gke since
// it runs in the same cluster as the
// test cluster. For minikube, we have
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Isn't it deployed in its own namespace, so it's okay to be in the same gke cluster?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Having multiple controllers for argo in the same cluster causes race conditions for argo workflows - we had a downtime in the test infrastructure because of this last week.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see

@lluunn
Copy link
Contributor

lluunn commented May 9, 2018

/lgtm
/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: lluunn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot merged commit a21aa3b into kubeflow:master May 9, 2018
@ankushagarwal ankushagarwal deleted the argo-test branch May 11, 2018 23:11
@jlewi jlewi mentioned this pull request Aug 23, 2018
saffaalvi pushed a commit to StatCan/kubeflow that referenced this pull request Feb 11, 2021
yanniszark pushed a commit to arrikto/kubeflow that referenced this pull request Feb 15, 2021
* feat: Add bayesian

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Fix requirement

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Update

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* feat: Add config in cm

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Use 120s as timeout

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Update

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Fix timeout

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Address comments

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Fix command

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Fix path

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Change the period

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Add version in requirements

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* pkg: Fix period

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Add build

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* fix: Fix inital delay

Signed-off-by: Ce Gao <gaoce@caicloud.io>
surajkota pushed a commit to surajkota/kubeflow that referenced this pull request Jun 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants