Skip to content
This repository has been archived by the owner on Oct 24, 2023. It is now read-only.

ci: Add alert on VHD space greater than 75% #1097

Merged
merged 2 commits into from Apr 19, 2019

Conversation

CecileRobertMichon
Copy link
Contributor

@CecileRobertMichon CecileRobertMichon commented Apr 18, 2019

Reason for Change:

Alert in release notes when a VHD build takes more than 75% space. Error when it's more than 90%.

Issue Fixed:

#1064

Requirements:

Notes:

@@ -383,6 +383,11 @@ done

df -h

# warn at 75% space taken
[ -s $(df -P | grep '/dev/sda1' | awk '0+$5 >= 30 {print}') ] || echo "WARNING: 75% of /dev/sda1 is used" >> ${RELEASE_NOTES_FILEPATH}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

put this to 30 on purpose so I could test it works as expected, will change to 75 after I get a signal from the VHD pipeline.

@codecov
Copy link

codecov bot commented Apr 18, 2019

Codecov Report

Merging #1097 into master will increase coverage by 0.87%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1097      +/-   ##
==========================================
+ Coverage   74.33%   75.21%   +0.87%     
==========================================
  Files         131      131              
  Lines       18259    19023     +764     
==========================================
+ Hits        13573    14308     +735     
- Misses       3905     3917      +12     
- Partials      781      798      +17

@CecileRobertMichon
Copy link
Contributor Author

/hold

@CecileRobertMichon
Copy link
Contributor Author

CecileRobertMichon commented Apr 18, 2019

Proof that this works when > the number %:

     Starting build on  Thu Apr 18 23:28:15 UTC 2019
     Using kernel:
     Linux version 4.15.0-1041-azure (buildd@lcy01-amd64-013) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.10)) #45-Ubuntu SMP Fri Mar 15 14:41:00 UTC 2019
     Components downloaded in this VHD build (some of the below components might get deleted during cluster provisioning if they are not needed):
       - apt-transport-https
       - blobfuse
       - ca-certificates
       - ceph-common
       - cgroup-lite
       - cifs-utils
       - conntrack
       - ebtables
       - ethtool
       - fuse
       - git
       - glusterfs-client
       - init-system-helpers
       - iproute2
       - ipset
       - iptables
       - jq
       - mount
       - nfs-common
       - pigz socat
       - util-linux
       - xz-utils
       - zip
       - etcd v3.2.25
       - moby v3.0.4
       - nvidia-docker2 nvidia-container-runtime
       - Azure CNI version 1.0.18
       - Azure CNI version 1.0.17
       - CNI plugin version 0.7.5
       - CNI plugin version 0.7.1
       - containerd version 1.2.4
       - containerd version 1.1.6
       - containerd version 1.1.5
       - img
     Docker images pre-pulled:
       - k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1
       - k8s.gcr.io/exechealthz-amd64:1.2
       - k8s.gcr.io/addon-resizer:1.8.4
       - k8s.gcr.io/addon-resizer:1.8.1
       - k8s.gcr.io/addon-resizer:1.7
       - k8s.gcr.io/heapster-amd64:v1.5.4
       - k8s.gcr.io/heapster-amd64:v1.5.3
       - k8s.gcr.io/heapster-amd64:v1.5.1
       - k8s.gcr.io/metrics-server-amd64:v0.2.1
       - k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.0
       - k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13
       - k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.5
       - k8s.gcr.io/kube-addon-manager-amd64:v9.0
       - k8s.gcr.io/kube-addon-manager-amd64:v8.9
       - k8s.gcr.io/kube-addon-manager-amd64:v8.8
       - k8s.gcr.io/kube-addon-manager-amd64:v8.7
       - k8s.gcr.io/kube-addon-manager-amd64:v8.6
       - k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.15.0
       - k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.10
       - k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.8
       - k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.5
       - k8s.gcr.io/pause-amd64:3.1
       - gcr.io/kubernetes-helm/tiller:v2.11.0
       - gcr.io/kubernetes-helm/tiller:v2.8.1
       - k8s.gcr.io/cluster-autoscaler:v1.14.0
       - k8s.gcr.io/cluster-autoscaler:v1.13.2
       - k8s.gcr.io/cluster-autoscaler:v1.13.1
       - k8s.gcr.io/cluster-autoscaler:v1.12.3
       - k8s.gcr.io/cluster-autoscaler:v1.12.2
       - k8s.gcr.io/cluster-autoscaler:v1.3.7
       - k8s.gcr.io/cluster-autoscaler:v1.3.4
       - k8s.gcr.io/cluster-autoscaler:v1.3.3
       - k8s.gcr.io/cluster-autoscaler:v1.2.2
       - k8s.gcr.io/cluster-autoscaler:v1.1.2
       - k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.10
       - k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.8
       - k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.7
       - k8s.gcr.io/coredns:1.3.1
       - k8s.gcr.io/coredns:1.2.6
       - k8s.gcr.io/coredns:1.2.2
       - k8s.gcr.io/rescheduler:v0.4.0
       - k8s.gcr.io/rescheduler:v0.3.1
       - microsoft/virtual-kubelet:latest
       - containernetworking/networkmonitor:v0.0.6
       - containernetworking/networkmonitor:v0.0.5
       - containernetworking/azure-npm:v1.0.18
       - nvidia/k8s-device-plugin:1.11
       - nvidia/k8s-device-plugin:1.10
       - docker.io/deis/hcp-tunnel-front:v1.9.2-v4.0.4
       - docker.io/deis/kube-svc-redirect:v1.0.2
       - mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7
       - mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8
       - gcr.io/google-containers/ip-masq-agent-amd64:v2.0.0
       - k8s.gcr.io/ip-masq-agent-amd64:v2.0.0
       - nginx:1.13.12-alpine
       - mcr.microsoft.com/k8s/kms/keyvault:v0.0.9
       - quay.io/coreos/flannel:v0.10.0
       - quay.io/coreos/flannel:v0.8.0
       - busybox
       - k8s.gcr.io/hyperkube-amd64:v1.14.1
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.14.1
       - k8s.gcr.io/hyperkube-amd64:v1.14.0
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.14.0
       - k8s.gcr.io/hyperkube-amd64:v1.13.5
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.13.5
       - k8s.gcr.io/hyperkube-amd64:v1.13.4
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.13.4
       - k8s.gcr.io/hyperkube-amd64:v1.12.7
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.12.7
       - k8s.gcr.io/hyperkube-amd64:v1.12.6
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.12.6
       - k8s.gcr.io/hyperkube-amd64:v1.11.9
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.11.9
       - k8s.gcr.io/hyperkube-amd64:v1.11.8
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.11.8
       - k8s.gcr.io/hyperkube-amd64:v1.10.13
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.10.13
       - k8s.gcr.io/hyperkube-amd64:v1.10.12
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.10.12
       - k8s.gcr.io/hyperkube-amd64:v1.9.11
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.9.11
       - k8s.gcr.io/hyperkube-amd64:v1.9.10
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.9.10
     WARNING: 75% of /dev/sda1 is used
     Install completed successfully on  Thu Apr 18 23:45:44 UTC 2019
     VSTS Build NUMBER: 20190418.14
     VSTS Build ID: 21571702
     Commit: 51ea2f550e30b62b5b20d1e16401f312360c0c20
     Feature flags:

With 75%:

     Starting build on  Fri Apr 19 01:11:39 UTC 2019
     Using kernel:
     Linux version 4.15.0-1041-azure (buildd@lcy01-amd64-013) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.10)) #45-Ubuntu SMP Fri Mar 15 14:41:00 UTC 2019
     Components downloaded in this VHD build (some of the below components might get deleted during cluster provisioning if they are not needed):
       - apt-transport-https
       - blobfuse
       - ca-certificates
       - ceph-common
       - cgroup-lite
       - cifs-utils
       - conntrack
       - cracklib-runtime
       - ebtables
       - ethtool
       - fuse
       - git
       - glusterfs-client
       - init-system-helpers
       - iproute2
       - ipset
       - iptables
       - jq
       - libpam-pwquality
       - libpwquality-tools
       - mount
       - nfs-common
       - pigz socat
       - util-linux
       - xz-utils
       - zip
       - etcd v3.2.25
       - moby v3.0.4
       - nvidia-docker2 nvidia-container-runtime
       - Azure CNI version 1.0.18
       - Azure CNI version 1.0.17
       - CNI plugin version 0.7.5
       - CNI plugin version 0.7.1
       - containerd version 1.2.4
       - containerd version 1.1.6
       - containerd version 1.1.5
       - img
     Docker images pre-pulled:
       - k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.1
       - k8s.gcr.io/exechealthz-amd64:1.2
       - k8s.gcr.io/addon-resizer:1.8.4
       - k8s.gcr.io/addon-resizer:1.8.1
       - k8s.gcr.io/addon-resizer:1.7
       - k8s.gcr.io/heapster-amd64:v1.5.4
       - k8s.gcr.io/heapster-amd64:v1.5.3
       - k8s.gcr.io/heapster-amd64:v1.5.1
       - k8s.gcr.io/metrics-server-amd64:v0.2.1
       - k8s.gcr.io/k8s-dns-kube-dns-amd64:1.15.0
       - k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13
       - k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.5
       - k8s.gcr.io/kube-addon-manager-amd64:v9.0
       - k8s.gcr.io/kube-addon-manager-amd64:v8.9
       - k8s.gcr.io/kube-addon-manager-amd64:v8.8
       - k8s.gcr.io/kube-addon-manager-amd64:v8.7
       - k8s.gcr.io/kube-addon-manager-amd64:v8.6
       - k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.15.0
       - k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.10
       - k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.8
       - k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.5
       - k8s.gcr.io/pause-amd64:3.1
       - gcr.io/kubernetes-helm/tiller:v2.11.0
       - gcr.io/kubernetes-helm/tiller:v2.8.1
       - k8s.gcr.io/cluster-autoscaler:v1.14.0
       - k8s.gcr.io/cluster-autoscaler:v1.13.2
       - k8s.gcr.io/cluster-autoscaler:v1.13.1
       - k8s.gcr.io/cluster-autoscaler:v1.12.3
       - k8s.gcr.io/cluster-autoscaler:v1.12.2
       - k8s.gcr.io/cluster-autoscaler:v1.3.7
       - k8s.gcr.io/cluster-autoscaler:v1.3.4
       - k8s.gcr.io/cluster-autoscaler:v1.3.3
       - k8s.gcr.io/cluster-autoscaler:v1.2.2
       - k8s.gcr.io/cluster-autoscaler:v1.1.2
       - k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.10
       - k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.8
       - k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.7
       - k8s.gcr.io/coredns:1.3.1
       - k8s.gcr.io/coredns:1.2.6
       - k8s.gcr.io/coredns:1.2.2
       - k8s.gcr.io/rescheduler:v0.4.0
       - k8s.gcr.io/rescheduler:v0.3.1
       - microsoft/virtual-kubelet:latest
       - containernetworking/networkmonitor:v0.0.6
       - containernetworking/networkmonitor:v0.0.5
       - containernetworking/azure-npm:v1.0.18
       - nvidia/k8s-device-plugin:1.11
       - nvidia/k8s-device-plugin:1.10
       - docker.io/deis/hcp-tunnel-front:v1.9.2-v4.0.4
       - docker.io/deis/kube-svc-redirect:v1.0.2
       - mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.7
       - mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.8
       - gcr.io/google-containers/ip-masq-agent-amd64:v2.0.0
       - k8s.gcr.io/ip-masq-agent-amd64:v2.0.0
       - nginx:1.13.12-alpine
       - mcr.microsoft.com/k8s/kms/keyvault:v0.0.9
       - quay.io/coreos/flannel:v0.10.0
       - quay.io/coreos/flannel:v0.8.0
       - busybox
       - k8s.gcr.io/hyperkube-amd64:v1.14.1
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.14.1
       - k8s.gcr.io/hyperkube-amd64:v1.14.0
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.14.0
       - k8s.gcr.io/hyperkube-amd64:v1.13.5
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.13.5
       - k8s.gcr.io/hyperkube-amd64:v1.13.4
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.13.4
       - k8s.gcr.io/hyperkube-amd64:v1.12.7
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.12.7
       - k8s.gcr.io/hyperkube-amd64:v1.12.6
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.12.6
       - k8s.gcr.io/hyperkube-amd64:v1.11.9
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.11.9
       - k8s.gcr.io/hyperkube-amd64:v1.11.8
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.11.8
       - k8s.gcr.io/hyperkube-amd64:v1.10.13
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.10.13
       - k8s.gcr.io/hyperkube-amd64:v1.10.12
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.10.12
       - k8s.gcr.io/hyperkube-amd64:v1.9.11
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.9.11
       - k8s.gcr.io/hyperkube-amd64:v1.9.10
       - k8s.gcr.io/cloud-controller-manager-amd64:v1.9.10
     Install completed successfully on  Fri Apr 19 01:29:18 UTC 2019
     VSTS Build NUMBER: 20190419.2
     VSTS Build ID: 21573956
     Commit: 6920085ba2bf99eaf8ea3f7e576847dfcd6ef788
     Feature flags:

@CecileRobertMichon
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@jackfrancis
Copy link
Member

/lgtm

@mboersma
Copy link
Member

/lgtm

@acs-bot
Copy link

acs-bot commented Apr 19, 2019

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: CecileRobertMichon, jackfrancis, mboersma

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • OWNERS [CecileRobertMichon,jackfrancis,mboersma]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@jackfrancis jackfrancis merged commit 28d8c54 into Azure:master Apr 19, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants