-
Notifications
You must be signed in to change notification settings - Fork 154
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
5da87a3
commit b2c3b76
Showing
25 changed files
with
333 additions
and
19 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
.. _kueue: | ||
|
||
========================================= | ||
Kueue - K8s原生批处理调度 | ||
========================================= | ||
|
||
.. toctree:: | ||
:maxdepth: 2 | ||
|
||
intro_kueue.rst |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,33 @@ | ||
.. _intro_kueue: | ||
|
||
================== | ||
Kueue简介 | ||
================== | ||
|
||
批处理管理缘起 | ||
================ | ||
|
||
早期的Kubernetes专注于微服务工作负载调度,随着Kubernetes发展已经逐步进入HPC(高性能计算)领域,提供了构建批处理平台的强大而灵活的工具。这种转变是由于 :ref:`machine_learning` 不断增长的训练需求,以及高性能计算(HPC)系统向云转变的引发。 | ||
|
||
PGS在2022年Google Cloud Next ’22上宣布采用Google Cloud Platform构建了相当于世界排名第七的超级计算机, `使用1.2M vCPU运行在云端和Spot VM替代本地Cray超级计算机 <https://www.pgs.com/company/newsroom/news/industry-insights--hpc-in-the-cloud/?utm_source=thenewstack&utm_medium=website&utm_content=inline-mention&utm_campaign=platform>`_ 。 | ||
|
||
在 :ref:`big_data` 和 :ref:`machine_learning` 领域,采用批处理工作负载的用户通常依赖 Slurm, Mesos, HTCondor 或 Nomad 这些框架,为批处理任务提供必要的功能和扩展性。但是这些框架缺乏Kubernetes的提供的充满活力的生态系统(vibrant ecosystem),社区支持以及集成功能。现在Kubernetes社区投入大量资源,组建批处理工作组(Batch Working Group)致力于增强Kubernetes的批处理功能里。 | ||
|
||
Batch Working Group对Job API进行大量改进,使其支持更广泛的批处理工作负载。改进后的API允许用户管理批处理作业,提供可扩展性、性能和可靠性增强。 | ||
|
||
Kueue项目 | ||
=========== | ||
|
||
`Kueue作业调度系统 <https://kueue.sigs.k8s.io/>`_ 是Batch Working Group开发的专为Kubernetes批处理工作负载而设计,提供Job优先级(job prioritization)、回填(backfilling)、资源风格编排(resource flavors orchestration)和抢占(preemption),以确保高效、及时地处理批处理作业,同时保持资源使用效率最大化。 | ||
|
||
Kueue正在致力于构建与 :ref:`kubeflow` , Ray, :ref:`spark` 和 :ref:`airflow` 等各种框架的集成。这些集成使得用户能够利用Kubernetes的强大功能和灵活性,同时利用这些框架的专业能力,从而创建无缝且高效的批处理体验。 | ||
|
||
此外,Kueue还计划提供增强功能,包括自动缩放的作业级配置API(job-level provisioning APIs in autoscaling),嗲赌气插件、节点运行时增强等。 | ||
|
||
Kubernetes广泛的多租户、丰富的生态以及主要云计算厂商托管服务使得其成为寻求批处理任务优化和充分利用云计算的最佳选择。目前在批处理领域,有不同的框架以及方式实现通用概念(作业、作业组、作业队列)。未来可能会更快的发展,所以研究和学习 ``Kueue`` 项目,会对未来 :ref:`machine_learning` 发展有很大的助力。 | ||
|
||
|
||
参考 | ||
====== | ||
|
||
- `Kubernetes Evolution: From Microservices to Batch Processing Powerhouse <https://thenewstack.io/kubernetes-evolution-from-microservices-to-batch-processing-powerhouse/>`_ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1 change: 1 addition & 0 deletions
1
source/kvm/libvirt/storage/libvirt_zfs_pool/ubuntu_install_libvirt_zfs_driver
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
apt install libvirt-daemon-driver-storage-zfs |
8 changes: 8 additions & 0 deletions
8
source/kvm/libvirt/storage/libvirt_zfs_pool/virsh_pool-list_all
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,8 @@ | ||
Name State Autostart | ||
------------------------------------ | ||
boot-scratch active yes | ||
images active yes | ||
images_lvm active yes | ||
images_rbd active yes | ||
images_zfs active yes | ||
nvram active yes |
7 changes: 7 additions & 0 deletions
7
source/kvm/libvirt/storage/libvirt_zfs_pool/virsh_pool-list_output
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
Name State Autostart | ||
------------------------------------ | ||
boot-scratch active yes | ||
images active yes | ||
images_lvm active yes | ||
images_rbd active yes | ||
nvram active yes |
1 change: 1 addition & 0 deletions
1
source/kvm/libvirt/storage/libvirt_zfs_pool/virsh_pool_define_zfs
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
virsh pool-define-as --name images_zfs --source-name zpool-data --type zfs |
2 changes: 2 additions & 0 deletions
2
source/kvm/libvirt/storage/libvirt_zfs_pool/virsh_pool_define_zfs_err
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
error: Failed to define pool images_zfs | ||
error: internal error: missing backend for pool type 12 (zfs) |
1 change: 1 addition & 0 deletions
1
source/kvm/libvirt/storage/libvirt_zfs_pool/virsh_pool_define_zfs_output
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
Pool images_zfs defined |
2 changes: 2 additions & 0 deletions
2
source/kvm/libvirt/storage/libvirt_zfs_pool/virsh_pool_zfs_start
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
virsh pool-autostart images_zfs | ||
virsh pool-start images_zfs |
1 change: 1 addition & 0 deletions
1
source/kvm/libvirt/storage/libvirt_zfs_pool/virsh_vol_create_zfs
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
virsh vol-create-as images_zfs centos7-zfs 20G |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
NAME USED AVAIL REFER MOUNTPOINT | ||
zpool-data 283G 1.40T 112K /zpool-data | ||
zpool-data/android 262G 1.40T 262G /zpool-data/android | ||
zpool-data/ccache 96K 1.40T 96K /zpool-data/ccache | ||
zpool-data/centos7-zfs 20.6G 1.42T 56K - | ||
zpool-data/y-k8s 96K 1.40T 96K /zpool-data/y-k8s |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
# virsh vol-create-as images_zfs centos7-zfs 20G | ||
|
||
virt-install \ | ||
--network bridge:br0 \ | ||
--name centos7-zfs \ | ||
--ram=4096 \ | ||
--vcpus=2 \ | ||
--os-type=Linux --os-variant=rhl7 \ | ||
--boot uefi --cpu host-passthrough \ | ||
--disk vol=images_zfs/centos7-zfs,sparse=false,format=raw,bus=virtio,cache=none,io=native \ | ||
--graphics none \ | ||
--location=http://mirrors.163.com/centos-vault/7.8.2003/os/x86_64/ \ | ||
--extra-args="console=tty0 console=ttyS0,115200" |
54 changes: 54 additions & 0 deletions
54
source/linux/redhat_linux/almalinux/almalinux_vs_rockylinux.rst
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,54 @@ | ||
.. _almalinux_vs_rockylinux: | ||
|
||
=============================== | ||
AlmaLinux vs. Rocky Linux | ||
=============================== | ||
|
||
2021年12月31日,随着CentOS Linux 8来到生命周期重点(End of Life, EoL),所有以CentOS作为Red Hat Enterprise Linux平替的企业和个人都需要考虑何去何从: | ||
|
||
- CentOS将演变为CentOS Stream(9),作为RHEL的开发版本和"滚动发布"版本,意味着在生产环境中使用存在风险 | ||
- 作为个人爱好者,期望有企业级的开发学习环境,并且紧跟RHEL技术发展,可以选择社区驱动快速迭代的 :ref:`almalinux` | ||
- `Rocky Linux <https://rockylinux.org/>`_ 承诺bug级复制的RHEL,则更为适合需要完全复制Red Hat Enterprise Linux的企业用户(有时候bug的兼容也很重要,避免触发生产环境work around失效),也适合企业规模升级后切换到Red Hat Enterprise Linux | ||
|
||
区别 | ||
====== | ||
|
||
- 运营模式区别: | ||
|
||
- AlmaLinux 是由 CloudLinux (专门为大型托管服务提供商和数据中心提供定制的基于 Linux 的操作系统的公司) 创建和资助,但完全由社区管理和驱动(CloudLinux不拥有该项目和软件) | ||
- Rocky Linux由最初的 CentOS 项目创始人 Gregory Kurtzer 创立的 Rocky Enterprise Software Foundation (RESF) 控制和管理,意味着Kurtzer拥有Rocky(公司持有人和决策者) | ||
|
||
- 社区区别: | ||
|
||
- AlmaLinux 和开源社区结合更紧密,没有采用绕开RHEL协议的方式,所以是ABI兼容(RHEL和EPEL),开发极为活跃 | ||
- Rocky Linux采用了1:1 Bug级兼容,通过RHEL协议漏洞(购买RHEL服务可以获得源代码),实现像素级复制,更适合必须完全兼容RHEL的企业采用 | ||
|
||
- 商业支持区别: | ||
|
||
- AlmaLinux背后支持是微软(和IBM竞争),如果想更快接触新技术,甚至可能采用微软Azure云计算,则可以选择AlmaLinux | ||
- Rocky Linux背后支持是谷歌,未来可能会类似CentOS一样和RedHat合作,如果需要维护企业现有配置以及传统的Linux线路,则建议选择Rocky Linux | ||
|
||
我的选择 | ||
========= | ||
|
||
我在2023年双十一时期购买了阿里云促销的99元/年 2c2g (ecs.e-c1m1.large) 3Mbps带宽: | ||
|
||
.. csv-table:: 阿里云2c2g (ecs.e-c1m1.large) 计算存储 | ||
:file: almalinux_vs_rockylinux/ecs.e-c1m1.large.csv | ||
:widths: 20,20,20,20,20 | ||
:header-rows: 1 | ||
|
||
.. csv-table:: 阿里云2c2g (ecs.e-c1m1.large) 网络 | ||
:file: almalinux_vs_rockylinux/ecs.e-c1m1.large_network.csv | ||
:widths: 20,20,20,20,20 | ||
:header-rows: 1 | ||
|
||
由于我不想采用默认的AliOS,所以综合上述对比,选择采用 AlmaLinux 来学习开发 | ||
|
||
参考 | ||
====== | ||
|
||
- `AlmaLinux vs Rocky Linux:CentOS 替代你选择哪一个? <https://www.51cto.com/article/705594.html>`_ | ||
- `CentOS Linux 即将到了生命周期终点,老用户何去何从 <https://www.linuxmi.com/centos-linux-eol.html>`_ | ||
- `同为CentOS的替代者,AlmaLinux 和 Rocky Linux有什么区别?该如何选择? <https://www.zhihu.com/question/503401806>`_ | ||
- `Alma Linux 与 Rocky Linux 有什么不同? <https://www.shixingceping.com/3906.html>`_ |
2 changes: 2 additions & 0 deletions
2
source/linux/redhat_linux/almalinux/almalinux_vs_rockylinux/ecs.e-c1m1.large.csv
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
实例规格,vCPU,内存(GiB),云盘IOPS基础/突发,云盘带宽基础/突发(Gbit/s) | ||
ecs.e-c1m1.large,2,2.0,0.8万/无,0.4/无 |
2 changes: 2 additions & 0 deletions
2
source/linux/redhat_linux/almalinux/almalinux_vs_rockylinux/ecs.e-c1m1.large_network.csv
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
实例规格,网络带宽基础/突发(Gbit/s),多队列,弹性网卡,单网卡私有IPv4地址数 | ||
ecs.e-c1m1.large,0.2/最高2,1,2,2 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,17 @@ | ||
.. _almalinux: | ||
|
||
======================================== | ||
AlmaLinux | ||
======================================== | ||
|
||
.. toctree:: | ||
:maxdepth: 1 | ||
|
||
almalinux_vs_rockylinux.rst | ||
|
||
.. only:: subproject and html | ||
|
||
Indices | ||
======= | ||
|
||
* :ref:`genindex` |
Oops, something went wrong.