Skip to content
@openebs

OpenEBS

High-Performance Container Native Stateful Persistent Block-mode and Filesystem storage platform for K8s // A CNCF Member project

Welcome to OpenEBS

OpenEBS Social Banner

OpenEBS is a Persistent block-mode Data Storage platform with an native vSAN fabric; for Kubernetes. We are CNCF member project. We are the largest global community of K8s storage users.

Our project team was an early pioneering inventor of K8s Container Native Storage services (we invented the term). We conceived the vision of a Stateful Persistent data platform for K8s that is tightly integrated and natively embeded into the core of K8s.

We built an innovative High-performance Enterprise grade Block-mode Hyper-converged Storage vSAN Fabric that augments the storage services of K8s with Stateful Persistence, Enterprise Data mgmt, SSD/NVMe optimized I/O services, Replicated Data volumes, Thin Provisioning, Snapshot, Clones; and many other Mission critical data storage services that don't come in K8s out-of-the-box.

OpenEBS is very popular :
Live OpenEBS systems actively report back product telemetry each day, to our Global Analytics system (unless disabled by the user).
Below are our project popularity & pentration metrics as of: 01 May 2024

🚀   OpenEBS is the #1 deployed Storage Platform for Kubernetes
⭐   We are the #1 GitHub Star ranked K8s Data Storage platform
💾   We have +49 Million Volumes deployed globally
📺   We have +9 Million Global installations
⚡   1 Million OpenEBS K8s Containers are spawned per week
😎   1.7 Million global users

Building a K8s Enterprise Data Storage platform is complex, and areas of the Data & I/O stack could be considerd 'Storage Rocket science'. Our global team comes from many areas of the data storage industry. Companies like... Microsoft Azure, VMware, DELL/EMC, Brocade/Broadcom, Hitachi Vantara, INTEL, Nvidia/Mellanox, IBM, RedHat and DataCore.

Important

We are grateful for the above innovative Data Storage companies and their amazing engineering contributors. Our orignal founding team continues to guide the project as custodial Maintainers. Major sponsorship is provided by DataCore, who donates a large team of dedicated Product Dev/Engineers, Product Mgmt and operational rescources. (Our founding team was acquired by DataCore, Inc). OpenEBS has 100's of amazing individuals, contributors and storage engineers who provide brainstorming ideas, feedback, code reviews and high-quality code to the project. - All who are passionate about storage and Data are welcome here.

Project structure

Project Structure

Our project currently has 2 main Editions:

1. OSS STANDARD>
2. Legacy


Important

OSS : Standard Edition

There are 2 Types of Storage Services provided within the OSS STANDARD. Replicated PV and Local PV.

Type Storage Engine Type of data services Status Latest
Replicated_PV Replicated data volumes (in a Cluster wide vSAN block mode fabric)
Replicated PV Mayastor Mayastor for High Availability deploymemnts distributing & replicating volumes across the cluster Stable, deployable in PROD v4.0.1
 
Local PV Non-replicated node local data volumes (Local-PV has multiple variants. See below) v4.0.1
Local PV Hostpath Local PV HostPath for integration with local node hostpath (e.g. /mnt/fs1) Stable, deployable in PROD v4.0.1
Local PV ZFS Local PV ZFS for integration with local ZFS storage deployments Stable, deployable in PROD v4.0.1
Local PV LVM2 Local PV LVM for integration with local LVM2 storage deployments Stable, deployable in PROD v4.0.1
Local PV Rawfile Local PV Rawfile for integration with Loop mounted Raw device-file filesystem Stable, deployable in PROD, undergoing evaluation & integration v0.70

STANDARD (Open Source Standard) is our Ultra modern Datastore stack that is strongly aligned with the cutting edge direction of storage use-cases in the K8s industry. It is designed to facilitate modern K8s datastore architectures, key K8s I/O patterns, K8s data access methods, K8s data use-cases and where K8s Datastore applications are heading.

STANDARD is optimized for NVMe and SSD Flash storage media, and integrates ultra modern cutting-edge high performance storage technologies at its core...

☑️   It uses the High performance SPDK storage stack - (SPDK is an open-source NVMe project initiated by INTEL)
☑️   The hyper modern IO_Uring Linux Kernel Async polling-mode I/O Interface - (fastest kernel I/O mode possible)
☑️   Native abilities for RDMA and Zero-Copy I/O
☑️   NVMe-oF TCP Block storage Hyper-converged data fabric
☑️   Block layer volume replication
☑️   Logical volumes and Diskpool based data managment
☑️   a Native high performance Blobstore
☑️   Native Block layer Thin provisioning
☑️   Native Block layer Snapshots and Clones



Warning

LEGACY Edition

LEGACY consists of Data-Engines that we experimented with early on. These Data-Engines have a number of open-source
technologies embedded inside them, and are a great intro into the world of simple K8s storage services. LEGACY helped
us learn, iterate and develop our core storage K8s strategy, as well as discern how users want & need to interact with
K8s storage services. LEGACY also helped to reveal key areas within K8s that are lacking in storage/datastore services,
what areas of K8s we could optimize; and how we can provide the best value into the various K8s storage layers.

There are multiple Data-Engines within LEGACY:

ID Data-Engines Embedded tech stack Status Action date
 
1 Jiva iSCSI deprecated & has been Migrated to OpenEBS Archive org 29 Apr, 2024
2 cStor Open ZFS deprecated & has been Migrated to OpenEBS Archive org 29 Apr, 2024
3 NFS Provisioner NFS userspace server deprecated & has been Migrated to OpenEBS Archive org 29 Apr, 2024
4 Device LocalPV Node Local storage deprecated & has been Migrated to OpenEBS Archive org 29 Apr, 2024
5 LocalPV Device Node Local storage deprecated & has been Migrated to OpenEBS Archive org 29 Apr, 2024
6 NDM Node Local storage deprecated & has been Migrated to OpenEBS Archive org 29 Apr, 2024
7 +43 other repos & projects
(Total Repos migrated: 49)
66% of Project's repos have been Archvied Please see the OpenEBS Archive org 29 Apr, 2024


🌎 ROADMAP

Our 2024 Roadmap is here It defines a rich set of new features that are planned for 2024.
Please review this roadmap and feel free to pass back any feedback on it, as well as recommend and suggest new ideas. We welcome all of your feedback.

⭐ GitHub Star Chart

OpenEBS is the most successful Stateful Persistent Container Native Storage platform in the CNCF landscape. It has always held the #1 position and continues to as of today.

XXXXXXXX

Pinned

  1. openebs openebs Public

    Most popular & widely deployed Open Source Container Native Storage platform for Stateful Persistent Applications on Kubernetes.

    8.7k 926

  2. mayastor mayastor Public

    Dynamically provision Stateful Persistent Replicated Cluster-wide Fabric Volumes & Filesystems for Kubernetes that is provisioned from an optimized NVME SPDK backend data storage stack.

    Rust 647 102

  3. dynamic-localpv-provisioner dynamic-localpv-provisioner Public

    Dynamically deploy Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is provisioned from simple Local-Hostpath /root storage.

    Go 129 59

  4. zfs-localpv zfs-localpv Public

    Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend ZFS data storage stack.

    Go 375 93

  5. lvm-localpv lvm-localpv Public

    Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend LVM2 data storage stack.

    Go 229 89

  6. rawfile-localpv rawfile-localpv Public

    Dynamically deploy Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is provisioned from RAW-device file loop mounted Local-Hostpath storage.

    Python 61 25

Repositories

Showing 10 of 28 repositories