Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Argo rather than Airflow to run our E2E tests #358

Merged
merged 35 commits into from
Feb 4, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
50a42fd
Add an option to release.py to specify the tag for the image to use.
jlewi Jan 31, 2018
3921dc2
Start writing an Argo workflow to replace the Airflow workflow.
jlewi Jan 31, 2018
82fb9a0
Start working on the parameters.
jlewi Jan 31, 2018
b6c5efc
Add code to create symbolic link.
jlewi Jan 31, 2018
d986bf9
Pull in kubeflow_testing as a submodule so that we can use the python
jlewi Jan 31, 2018
ec01981
latest.
jlewi Jan 31, 2018
f43273b
Fix test util.
jlewi Jan 31, 2018
6ba2f44
Use service account.
jlewi Feb 1, 2018
47129b3
run gcloud auth login
jlewi Feb 1, 2018
3907f32
Fix the path.
jlewi Feb 1, 2018
8895927
Fix import.
jlewi Feb 1, 2018
d75180d
Exclude submodule.
jlewi Feb 1, 2018
94e8ee5
Fix namespace.
jlewi Feb 1, 2018
1568b01
Merge remote-tracking branch 'upstream/master' into argo_e2e
jlewi Feb 1, 2018
cb6d0c4
Add credentials.
jlewi Feb 1, 2018
6db9fbe
Fix the teardown step.
jlewi Feb 1, 2018
863e75b
Now that the python scripts are checked in
jlewi Feb 1, 2018
a6f0243
Remove kubeflow_testing as a submodule.
jlewi Feb 2, 2018
22cd048
Location of kubeflow/testing is changed.
jlewi Feb 2, 2018
55bc30f
Create a Dockerfile to use as our test worker which just launches
jlewi Feb 3, 2018
25223d5
Delete the airflow files.
jlewi Feb 3, 2018
97523fa
Fix the image.
jlewi Feb 3, 2018
081bd24
Fix image and address review comment.
jlewi Feb 3, 2018
425594c
Use the service account function.
jlewi Feb 3, 2018
9c100f9
Fix the workflow.
jlewi Feb 3, 2018
58a1e44
Fix it.
jlewi Feb 3, 2018
2e096cc
Fix paths.
jlewi Feb 3, 2018
5d87458
Fix path.
jlewi Feb 3, 2018
91a8c8e
Set workingDir.
jlewi Feb 3, 2018
754b50a
Fix path.
jlewi Feb 3, 2018
8851265
Fix the test.
jlewi Feb 3, 2018
52182fe
Fix lint.
jlewi Feb 3, 2018
8227da5
Fix lint.
jlewi Feb 4, 2018
a21a009
Autoformat jsonnet files.
jlewi Feb 4, 2018
6f85585
Fix the README.
jlewi Feb 4, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
340 changes: 0 additions & 340 deletions py/airflow.py

This file was deleted.

32 changes: 0 additions & 32 deletions py/airflow_test.py

This file was deleted.

6 changes: 5 additions & 1 deletion py/deploy.py
Original file line number Diff line number Diff line change
Expand Up @@ -88,7 +88,8 @@ def setup(args):
t = test_util.TestCase()
try:
start = time.time()
util.run(["helm", "install", chart, "-n", "tf-job", "--wait", "--replace",
util.run(["helm", "install", chart, "-n", "tf-job", "--namespace=default",
"--wait", "--replace",
"--set", "rbac.install=true,cloud=gke"])
util.wait_for_deployment(api_client, "default", "tf-job-operator")
except subprocess.CalledProcessError as e:
Expand Down Expand Up @@ -166,6 +167,9 @@ def add_common_args(parser):

def main(): # pylint: disable=too-many-locals
logging.getLogger().setLevel(logging.INFO) # pylint: disable=too-many-locals

util.maybe_activate_service_account()

# create the top-level parser
parser = argparse.ArgumentParser(
description="Setup clusters for testing.")
Expand Down