[Test Flakes] Bump the timeout waiting for the test workflows to complete

[jlewi]

In kubeflow/kubeflow#1109 we are seeing a lot of timeouts waiting for workflows to complete but the workflows end up completing.

So we should bump the timeout.

This will require pushing a new test image since the run_e2e_workflow.py code is baked into the docker image.

[jlewi]

/assign @jlewi

[jlewi]

I pushed a new test-ci-worker image.

v20180706-2f9a392-e3b0c4: digest: sha256:34b0e4c60c457f5fd3e00e0edd7f253d579b99383a4c377b74a9e4889be38f82 size: 5563
Pushed gcr.io/kubeflow-ci/test-worker with :v20180706-2f9a392-e3b0c4 tags
# Tagging into a new project can be very slow but it appears to work.
gcloud container images add-tag --quiet gcr.io/kubeflow-ci/test-worker:v20180706-2f9a392-e3b0c4 gcr.io/kubeflow-releasing/worker:v20180706-2f9a392-e3b0c4 --verbosity=info
INFO: Manifest exists, skipping blob uploads and pushing tag.
Created [gcr.io/kubeflow-releasing/worker:v20180706-2f9a392-e3b0c4].
INFO: Finished upload of: gcr.io/kubeflow-releasing/worker:v20180706-2f9a392-e3b0c4
Updated [gcr.io/kubeflow-ci/test-worker:v20180706-2f9a392-e3b0c4].
INFO: Display format "none".
echo created gcr.io/kubeflow-releasing/worker:v20180706-2f9a392-e3b0c4
created gcr.io/kubeflow-releasing/worker:v20180706-2f9a392-e3b0c4
gcloud container images add-tag --quiet gcr.io/kubeflow-ci/test-worker:v20180706-2f9a392-e3b0c4 gcr.io/kubeflow-ci/test-worker:latest --verbosity=info
INFO: Manifest exists, skipping blob uploads and pushing tag.
Created [gcr.io/kubeflow-ci/test-worker:latest].
INFO: Finished upload of: gcr.io/kubeflow-ci/test-worker:latest
Updated [gcr.io/kubeflow-ci/test-worker:v20180706-2f9a392-e3b0c4].
INFO: Display format "none".
echo created gcr.io/kubeflow-ci/test-worker:latest
created gcr.io/kubeflow-ci/test-worker:latest
# Tagging into a new project can be very slow but it appears to work.	
gcloud container images add-tag --quiet gcr.io/kubeflow-releasing/worker:v20180706-2f9a392-e3b0c4 gcr.io/kubeflow-releasing/worker:latest --verbosity=info
INFO: Manifest exists, skipping blob uploads and pushing tag.
Created [gcr.io/kubeflow-releasing/worker:latest].
INFO: Finished upload of: gcr.io/kubeflow-releasing/worker:latest
Updated [gcr.io/kubeflow-releasing/worker:v20180706-2f9a392-e3b0c4].
INFO: Display format "none".
echo created gcr.io/kubeflow-releasing/worker:latest
created gcr.io/kubeflow-releasing/worker:latest