Skip to content

Resource Requirement

Ziming Miao edited this page Mar 26, 2019 · 16 revisions

CPU & memory requirement

For SingleBox installation, we reserve 40G memory for OS and Kubernetes, memory for user jobs is total_mem - 40g.

For cluster installation, each PAI-Worker reserve 16G memory for OS and K8S, memory for user jobs is total_mem - 16g.

Namespace Kind Name Memory Requests/G Memory Limits/G CPU Requests/core CPU Limits/core QosClass Master/Worker View the code here
kube-system Static Pod kube-scheduler 1 N/A 1 N/A Guaranteed Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/deployment/k8sPaiLibrary/template/scheduler.yaml.template#L39-L42
kube-system Static Pod kube-controller-manager 1 N/A 1 N/A Guaranteed Master https://github.com/Microsoft/pai/blob/master/deployment/k8sPaiLibrary/template/controller-manager.yaml.template#L41-L44
kube-system Static Pod kube-apiserver 1 N/A 1 N/A Guaranteed Master https://github.com/Microsoft/pai/blob/master/deployment/k8sPaiLibrary/template/apiserver.yaml.template#L50-L53
kube-system Deployments kubernetes-dashboard 1 N/A 1 N/A Burstable Master https://github.com/Microsoft/pai/blob/master/deployment/k8sPaiLibrary/template/dashboard-deployment.yaml.template#L46-L50
kube-system Daemon Sets kube-proxy N/A N/A N/A N/A BestEffort Master
default Static Pod etcd 1 N/A 1 N/A Guaranteed Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/deployment/k8sPaiLibrary/template/etcd.yaml.template#L55-L58
Total 5 0 5 0
default Daemon Sets frameworklauncher 1 4 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/yarn-frameworklauncher/deploy/yarn-frameworklauncher.yaml.template#L69-L73
default Daemon Sets hadoop-name-node 8 8 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/hadoop-node-manager/deploy/hadoop-node-manager.yaml.template#L69-L71
default Daemon Sets hadoop-jobhistory-service 1 2 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/hadoop-jobhistory/deploy/hadoop-jobhistory.yaml.template#L68-L72
default Daemon Sets hadoop-resource-manager 8 36 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/hadoop-resource-manager/deploy/hadoop-resource-manager.yaml.template#L72-L76
default Daemon Sets pylon 1 1 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/pylon/deploy/pylon.yaml.template#L73-L75
default Daemon Sets rest-server 0.5 0.5 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/rest-server/deploy/rest-server.yaml.template#L71-L73
default Daemon Sets webportal 0.5 0.5 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/webportal/deploy/webportal.yaml.template#L59-L61
default Daemon Sets zookeeper 1 10 1 1 Guaranteed Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/zookeeper/deploy/zookeeper.yaml.template#L52-L57
default Deployments end-to-end-test-deployment N/A N/A N/A N/A BestEffort Master
default Deployments grafana 0.25 0.25 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/grafana/deploy/grafana.yaml.template#L53-L55
default Deployments prometheus 0.25 10 N/A N/A Burstable Master https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/prometheus/deploy/prometheus-deployment.yaml.template#L40-L44
default Deployments watchdog 0.25 0.25 N/A N/A Burstable Master (optional) https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/watchdog/deploy/watchdog.yaml.template#L47-L49
default Daemon Sets drivers 0.25 2 N/A N/A Burstable Master & Worker https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/drivers/deploy/drivers.yaml.template#L64-L68
default Daemon Sets node-exporter(node-exporter, gpu-exporter) 0.25 0.25 N/A N/A Burstable Master & Worker https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/node-exporter/deploy/node-exporter.yaml.template#L98-L100
default Daemon Sets hadoop-data-node 1 4 N/A N/A Burstable Worker https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/hadoop-data-node/deploy/hadoop-data-node.yaml.template#L53-L57
default Daemon Sets hadoop-node-manager 4 4 N/A N/A Burstable Worker https://github.com/Microsoft/pai/blob/fd82bb0820127402f8d88aecd637f38de4bb4388/src/hadoop-node-manager/deploy/hadoop-node-manager.yaml.template#L69-L71
Total 27.25 82.75 1 1
Sum 32.25 82.75 6 1
You can’t perform that action at this time.