QuickStart Kubernetes Cluster

简介

• 快速搭建一个 Kubernetes 集群
• 搭建过程离线，无需访问互联网
• 一行命令，使用 ansible，全程自动化

限制条件

• Linux Kernel >= 4.9.17 , 推荐 Ubuntu 22.04

核心组件

• 容器引擎: containerd 2.0
• 容器平台: kubernetes v1.30
• 数据库: etcd v3.5
• 网络组件: cilium v1.14
• 扩展组件: coredns 1.11

准备 hosts 文件

请参考Ansible.md

# 单主节点集群
mkdir -p /etc/kubernetes/ansible && \
rm -rf /etc/kubernetes/ansible/ansible-kubernetes.ini && \
cat > /etc/kubernetes/ansible/ansible-kubernetes.ini <<-EOF
[master]
beagle-01 ansible_ssh_host=192.168.1.201 ansible_ssh_port=22 ansible_ssh_user=root

[node]
beagle-02 ansible_ssh_host=192.168.1.202 ansible_ssh_port=22 ansible_ssh_user=root
beagle-03 ansible_ssh_host=192.168.1.203 ansible_ssh_port=22 ansible_ssh_user=root
EOF

# 高可用集群
mkdir -p /etc/kubernetes/ansible && \
rm -rf /etc/kubernetes/ansible/ansible-kubernetes.ini && \
cat > /etc/kubernetes/ansible/ansible-kubernetes.ini <<-EOF
[master]
beagle-01 ansible_ssh_host=192.168.1.201 ansible_ssh_port=22 ansible_ssh_user=root
beagle-02 ansible_ssh_host=192.168.1.202 ansible_ssh_port=22 ansible_ssh_user=root
beagle-03 ansible_ssh_host=192.168.1.203 ansible_ssh_port=22 ansible_ssh_user=root

[node]
beagle-04 ansible_ssh_host=192.168.1.204 ansible_ssh_port=22 ansible_ssh_user=root
EOF

配置说明：

• [master] , k8s 控制平面-管理节点配置；
• [node] , k8s 计算节点配置；

在线安装 kubernetes 集群

配置文件请参考all.yml

# 安装docker
mkdir -p /opt/docker && \
curl -sfL https://cache.ali.wodcloud.com/kubernetes/ansible/ansible-docker.sh > /opt/docker/ansible-docker.sh && \
bash /opt/docker/ansible-docker.sh

# 安装k8s
mkdir -p /etc/kubernetes/ansible && \
curl -sfL https://cache.ali.wodcloud.com/kubernetes/ansible/ansible-kubernetes.sh > /etc/kubernetes/ansible/ansible-kubernetes.sh && \
bash /etc/kubernetes/ansible/ansible-kubernetes.sh

离线安装 kubernetes 集群

# 安装docker
# HTTP_SERVER=https://cache.ali.wodcloud.com
# TARGET_ARCH=amd64;arm64;
mkdir -p /opt/docker && \
curl -fL https://cache.ali.wodcloud.com/kubernetes/ansible/ansible-docker-27.5.1-amd64.tgz > /opt/docker/ansible-docker-27.5.1-amd64.tgz && \
curl -sfL https://cache.ali.wodcloud.com/kubernetes/ansible/ansible-docker.sh > /opt/docker/ansible-docker.sh && \
export DOCKER_VERSION=27.5.1 && \
bash /opt/docker/ansible-docker.sh

# 开始安装k8s
mkdir -p /etc/kubernetes/ansible && \
curl -fL https://cache.ali.wodcloud.com/kubernetes/ansible/ansible-kubernetes-images-v1.30.8-amd64.tgz >/etc/kubernetes/ansible/ansible-kubernetes-images-v1.30.8-amd64.tgz && \
curl -fL https://cache.ali.wodcloud.com/kubernetes/ansible/ansible-kubernetes-latest-amd64.tgz >/etc/kubernetes/ansible/ansible-kubernetes-latest-amd64.tgz && \
curl -sfL https://cache.ali.wodcloud.com/kubernetes/ansible/ansible-kubernetes-latest.sh > /etc/kubernetes/ansible/ansible-kubernetes-latest.sh && \
export K8S_VERSION=v1.30.8 && \
bash /etc/kubernetes/ansible/ansible-kubernetes-latest.sh

完成安装

显示以下提示信息，所有节点都是 ok，failed=0

PLAY RECAP *******************************************************************************************************
beagle-01                  : ok=85   changed=65   unreachable=0    failed=0    skipped=23   rescued=0    ignored=6
beagle-02                  : ok=37   changed=32   unreachable=0    failed=0    skipped=6    rescued=0    ignored=1
beagle-03                  : ok=37   changed=32   unreachable=0    failed=0    skipped=6    rescued=0    ignored=1

验证安装

root@beagle-01:~# kubectl get node
NAME        STATUS   ROLES    AGE   VERSION
beagle-01   Ready    master   93s   v1.30.8-beagle
beagle-02   Ready    <none>   79s   v1.30.8-beagle
beagle-03   Ready    <none>   79s   v1.30.8-beagle

root@beagle-01:~# kubectl get pod -A -o wide
NAMESPACE     NAME                                READY   STATUS    RESTARTS   AGE   IP              NODE        NOMINATED NODE   READINESS GATES
kube-system   cilium-2zq4f                        1/1     Running   0          76s   192.168.1.202   beagle-02   <none>           <none>
kube-system   cilium-7tjl8                        1/1     Running   0          76s   192.168.1.203   beagle-03   <none>           <none>
kube-system   cilium-f8gcp                        1/1     Running   0          76s   192.168.1.201   beagle-01   <none>           <none>
kube-system   cilium-operator-7877c885b7-47ld8    1/1     Running   0          76s   192.168.1.202   beagle-02   <none>           <none>
kube-system   cilium-operator-7877c885b7-phjpf    1/1     Running   0          76s   192.168.1.203   beagle-03   <none>           <none>
kube-system   coredns-78dcd56fdf-ztqf6            1/1     Running   0          74s   10.2.0.134      beagle-01   <none>           <none>
kube-system   etcd-beagle-01                      1/1     Running   0          97s   192.168.1.201   beagle-01   <none>           <none>
kube-system   hubble-relay-84bff94f74-kclr9       1/1     Running   0          76s   10.2.0.234      beagle-01   <none>           <none>
kube-system   hubble-ui-596749dfc4-v2cxd          2/2     Running   0          76s   10.2.0.248      beagle-01   <none>           <none>
kube-system   kube-apiserver-beagle-01            1/1     Running   0          89s   192.168.1.201   beagle-01   <none>           <none>
kube-system   kube-controller-manager-beagle-01   1/1     Running   0          99s   192.168.1.201   beagle-01   <none>           <none>
kube-system   kube-scheduler-beagle-01            1/1     Running   0          99s   192.168.1.201   beagle-01   <none>           <none>

FAQ

Ubuntu 18.04 如何安装

尽量升级内核至 5.4 以上。请参考Ubuntu-18.04.md

• Linux Kernel 3.10 时，将会默认安装 Flannel 网络插件
• 升级 Linux Kernel 至大于等于 4.9.17 时，将会安装 Cilium 网络插件

安装前准备

• 检查 python ， 确保服务器安装了 python2 或 python3
• 检查 iptable ， 确保服务器安装了 iptable
• 关闭防火墙 ， 确保服务器关闭了默认防火墙

安装历史版本 k8s

请参考InstallHistoryVersion.md

• 1.28
• 1.26
• 1.24
• 1.22
• 1.20
• 1.18