Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update E2E test to use kfctl.sh and delete gke/deploy.sh; #1331

Closed
jlewi opened this issue Aug 8, 2018 · 4 comments
Closed

Update E2E test to use kfctl.sh and delete gke/deploy.sh; #1331

jlewi opened this issue Aug 8, 2018 · 4 comments

Comments

@jlewi
Copy link
Contributor

jlewi commented Aug 8, 2018

We want to delete the deploy.sh scripts
https://github.com/kubeflow/kubeflow/blob/master/scripts/gke/deploy.sh

It is replaced by kfctl.sh

deploy.sh is still being used by our E2E test
https://github.com/kubeflow/kubeflow/blob/master/testing/workflows/components/workflows.jsonnet

We added a new E2E workflow for kfctl.sh
https://github.com/kubeflow/kubeflow/blob/master/testing/workflows/components/kfctl_test.jsonnet
but this test isn't running any validation steps (e.g. running a PyTorch or TFJob test).

Per #1325 we'd like to refactor our tests to make subgraphs/steps more reusable

@jlewi
Copy link
Contributor Author

jlewi commented Aug 20, 2018

#1342

Updated our tests to use kfctl.sh

deploy.sh is still being called by deploy_kubeflow_gcp.sh which is referenced in workflows.jsonnet.

I don't think its still being used though; so we could probably just delete it and remove the references.

jlewi added a commit to jlewi/kubeflow that referenced this issue Aug 23, 2018
* These scripts are no longer used to deploy KF on GKE in tests; we now
  use kfctl.

Related to: kubeflow#1331
k8s-ci-robot pushed a commit that referenced this issue Aug 23, 2018
* These scripts are no longer used to deploy KF on GKE in tests; we now
  use kfctl.

Related to: #1331
@jlewi
Copy link
Contributor Author

jlewi commented Aug 24, 2018

Post-submit run:
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/kubeflow_chainer-operator/21/kubeflow-chainer-operator-presubmit/57/

Looks like minikube broke because it depends on deploy_kubeflow.py which we deleted in #1406.

jlewi added a commit to jlewi/kubeflow that referenced this issue Aug 24, 2018
* In kubeflow#1406 we deleted deploy_kubeflow.py but this file is still used
  by the minikube test.

* Partially reverts commit a4e4a8e.

* Related to kubeflow#1331

* Trigger minikube on presubmits if files used by minikube E2E test are changed.
  run_e2e_workflow.py uses fnmatch so we can specify individual files
  or other expressions

* Fix kubeflow#1350 trigger minikube test on presubmit when test modified.
k8s-ci-robot pushed a commit that referenced this issue Aug 29, 2018
* Fix minikube test and trigger on presubmit when modified.

* In #1406 we deleted deploy_kubeflow.py but this file is still used
  by the minikube test.

* Partially reverts commit a4e4a8e.

* Related to #1331

* Trigger minikube on presubmits if files used by minikube E2E test are changed.
  run_e2e_workflow.py uses fnmatch so we can specify individual files
  or other expressions

* Fix #1350 trigger minikube test on presubmit when test modified.

* * deploy_kubeflow.py should be deploying the v1alpha2 operator of TFJob.

* * TFJob simple test should be using v1alpha2.

* Update the deploy script to properly wait for the job operator.
@jlewi
Copy link
Contributor Author

jlewi commented Sep 4, 2018

@jlewi jlewi closed this as completed Sep 4, 2018
@jlewi jlewi reopened this Sep 5, 2018
@jlewi
Copy link
Contributor Author

jlewi commented Sep 5, 2018

gke/deploy.sh wasn't actually deleted.
see #1481

jlewi added a commit to jlewi/kubeflow that referenced this issue Sep 5, 2018
saffaalvi pushed a commit to StatCan/kubeflow that referenced this issue Feb 11, 2021
* These scripts are no longer used to deploy KF on GKE in tests; we now
  use kfctl.

Related to: kubeflow#1331
saffaalvi pushed a commit to StatCan/kubeflow that referenced this issue Feb 11, 2021
)

* Fix minikube test and trigger on presubmit when modified.

* In kubeflow#1406 we deleted deploy_kubeflow.py but this file is still used
  by the minikube test.

* Partially reverts commit 166dcc2.

* Related to kubeflow#1331

* Trigger minikube on presubmits if files used by minikube E2E test are changed.
  run_e2e_workflow.py uses fnmatch so we can specify individual files
  or other expressions

* Fix kubeflow#1350 trigger minikube test on presubmit when test modified.

* * deploy_kubeflow.py should be deploying the v1alpha2 operator of TFJob.

* * TFJob simple test should be using v1alpha2.

* Update the deploy script to properly wait for the job operator.
saffaalvi pushed a commit to StatCan/kubeflow that referenced this issue Feb 11, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant