Skip to content
Permalink
Browse files

Recreate the NFS share to fix out of space (#436)

* Recreate the NFS share to fix out of space

Fix #435

* Remove @zabbasi from the OWNERs file.
  • Loading branch information...
jlewi authored and k8s-ci-robot committed Aug 13, 2019
1 parent 52615d4 commit 8cbd626f678d2c830edc38d5990bc2e1c6e1eb70
Showing with 13 additions and 20 deletions.
  1. +0 −1 OWNERS
  2. +6 −18 images/gcb_build/image_build.json
  3. +6 −0 playbook.md
  4. +1 −1 test-infra/ks_app/environments/kubeflow-ci/params.libsonnet
1 OWNERS
@@ -6,5 +6,4 @@ approvers:
- kunmingg
- lluunn
- richardsliu
- zabbasi
- zhenghuiwang
@@ -1,41 +1,29 @@
{
"images": [
"gcr.io/kubeflow-releasing/test-worker:v20190421-c9a1370-dirty-3a99df",
"gcr.io/kubeflow-releasing/test-worker:latest"
"gcr.io/kubeflow-admin/test-worker:v20190723-0a32b01-dirty-b7e34b",
"gcr.io/kubeflow-admin/test-worker:latest"
],
"steps": [
{
"args": [
"pull",
"gcr.io/kubeflow-releasing/test-worker:latest"
],
"id": "pull-test-worker",
"name": "gcr.io/cloud-builders/docker",
"waitFor": [
"-"
]
},
{
"args": [
"build",
"-t",
"gcr.io/kubeflow-releasing/test-worker:v20190421-c9a1370-dirty-3a99df",
"gcr.io/kubeflow-admin/test-worker:v20190723-0a32b01-dirty-b7e34b",
"--label=git-versions=",
"--file=./Dockerfile",
"--cache-from=gcr.io/kubeflow-releasing/test-worker:latest",
"."
],
"id": "build-test-worker",
"name": "gcr.io/cloud-builders/docker",
"waitFor": [
"pull-test-worker"
"-"
]
},
{
"args": [
"tag",
"gcr.io/kubeflow-releasing/test-worker:v20190421-c9a1370-dirty-3a99df",
"gcr.io/kubeflow-releasing/test-worker:latest"
"gcr.io/kubeflow-admin/test-worker:v20190723-0a32b01-dirty-b7e34b",
"gcr.io/kubeflow-admin/test-worker:latest"
],
"id": "tag-test-worker",
"name": "gcr.io/cloud-builders/docker",
@@ -169,6 +169,12 @@ kubectl config set-context $(kubectl config current-context) --namespace=kubeflo
```

1. Make sure the `debug-worker-0` pod is able to successfully mount the PV

* You may need to restart the debug worker if it isn't running

```
ks apply kubeflow-ci -c debug-worker
```

* If you already deleted the pod `debug-worker-0` make sure it is restarted and is healthy. Otherwise, if it stalls in terminated state, force delete it as follows:

@@ -11,7 +11,7 @@ params {
exposeUi: true,
},
"nfs-external"+: {
nfsServer: '10.7.164.170',
nfsServer: '10.109.14.58',
},
},
}

0 comments on commit 8cbd626

Please sign in to comment.
You can’t perform that action at this time.