OpenZFS is an open-source implementation of the ZFS file system and volume manager initially developed by Sun Microsystems for the Solaris operating system, and is now maintained by the OpenZFS Project. Similar to the original ZFS, the implementation supports features like data compression, data deduplication, copy-on-write clones, snapshots, RAID-Z, and virtual devices that can create filesystems that span multiple disks. One of the main capabilities of OpenZFS is self-healing. The file system can detect and correct errors while in use, without the need for a dedicated file system checker. This feature makes it suitable for mission-critical applications that require high availability.
A curated list of resources on OpenZFS.
From 🇪🇪 with ❤️.
This project has no sponsors but we accepting donations to purchase hardware for OpenZFS test rig.
You can support us these ways:
- ❤️ Share the link to this repo.
- ⭐ Give us a GitHub star.
- 🏆 Buying us a coffee
We would like to compare performance with same set of hardware components and all the money from "Buy Me a Coffee" will be spent on hardware:
- for RAIDZ (RAIDZ1 vs. RAIDZ2 vs. RAIDZ3)
- for dRAID (dRAID1 vs. dRAID2 vs. dRAID3)
- for other RAIDs, supported by OpenZFS like RAID0 vs. RAID1 vs. RAID10
- with other FS (OpenZFS vs. Btrfs vs. GlusterFS vs. Ceph vs. HDFS vs. Lustre vs. MinIO)
Please find more details about in ZFS Performance Test scenario
- Awesome OpenZFS
- Abandoned 💀
- Monetized 💰
- Beta version
⚠️ - Something wrong 💔
- Higly recommended 💘
RAIDZ is a variation on RAID-5 that allows for better distribution of parity and eliminates the RAID-5 “write hole”. Data and parity is striped across all disks within a raidz group. RAIDZ is effective for large block sizes and sequential workloads.
dRAID is a variant of RAIDZ that provides integrated distributed hot spares which allows for faster resilvering while retaining the benefits of raidz.
Open ZFS focused on RAIDZ and dRAID. Meanwhile it also support other RAID types like Stripe and Mirror.
- 💘 ZFS 101
- OpenZFS Topology FAQ: What’s a zpool? What’s a vdev?
- ZFS Guide for starters and advanced users
- What is ZFS? Why are People Crazy About it?
- 10 Reasons Why ZFS Rocks
- ZFS walkthrough
- ZFS CLI reference
- Secure External Backup with ZFS Native Encryptionp
- Sending and Receiving ZFS Data
- How to use snapshots, clones and replication in ZFS on Linux
- ZFS Snapshot Tools
- Efficient ZFS Replication with Snapshots
- Backup storage for thousands of virtual machines using free tools
- Managing and Tracking Storage Performance – OpenZFS Storage Bottlenecks
- 5 Reasons Why Your ZFS Storage Benchmarks Are Wrong
- FreeBSD vs. Linux – Which Operating System to Use for OpenZFS
- ZFS performance results
- ZFS performance considerations
- ZFS RAID vs. Linux mdraid
- A quick-start guide to OpenZFS native encryption
- ZFS handbook - Encryption
- OpenZFS on OS X encryption support
- Tutorial on how to backup encrypted ZFS data on untrusted storage without the need of unlocking it.
- How to install LUKS encrypted Server and enable remote unlocking tutorial
- ZFS RAID types
- Understanding ZFS RAID Levels: Types, Modes, and Configurations
- ZFS RAIDZ vs. traditional RAID
- 💘 ZFS versus RAID
- 💘 zdb — display ZFS storage pool debugging and consistency information
- 💘 fsck.zfs — dummy ZFS filesystem checker
- 💘 ZED — ZFS Event Daemon
- 💘 zfs_prepare_disk
- 💀 Zyggy - Simple GUI for ZFS administration
- 💰 Poolsman - Web UI for OpenZFS
- 💀 ZFS Commander
⚠️ ZfDash ZFS Management GUI / WEBUI- Terminal UI for inspecting and restoring file history on ZFS snapshots
- ZFS administration tool for Webmin
- ZFS pool monitoring and notification daemon
- Prometheus and ZFS
- Prometheus ZFS exporter
- Zabbix ZFS monitor
- Zabbix template and user parameters to monitor zfs on linux
- Nagios/Icinga plugin to monitor ZFS Pools
- 💀 Nagios plugin to check ZFS pool in the Linux environment
- collectd plugin for ZFS
- bzfs - Backup command line tool
- pyznapv - ZFS snapshot tool
- sanoid - Policy-driven snapshot management and replication tool
- zap - Management of zfs snapshots
- zfs_autobackup - ZFS autobackup is used to periodicly backup ZFS filesystems to other locations
- zfs-autosnapshot - Shell script that takes snapshots
- zfs-auto-snapshot - ZFS Automatic Snapshot Service
- zfs-backup - ZFS backup via zfs send/recv over SSH
- zfs-backup-blob - Backup-tools for ZFS to blob-storage backups
- zfs-backup-manager - Automatic ZFS Backup Management Tool
- zfs_mgmt - Managing zfs snapshots
- zfsnap - Rolling ZFS snapshots
- zfsnap - Rolling ZFS snapshots
- zfs-periodic - Scripts to take zfs snapshots with periodic on FreeBSD
- zfs-prune-snapshots - Remove snapshots from one or more zpools that match given criteria
- zfs-rclone - Script to periodically backup ZFS datasets using rclone
- zfs-remote-mirror - Setting up a remote ZFS mirror
- zfs-replicate - Shell script to manage ZFS snapshot replication locally, or between hosts.
- zfs-snapshot-mgmt - Script for automating ZFS snapshot creation for FreeBSD
- zfstools
- zfs-tools - ZFS backup tools
- znapzend - High performance open source ZFS backup with mbuffer and ssh support
- zrep - ZFS replication and failover
- zrepl - ZFS backup & replication solution
- zxfer - Script for managing ZFS snapshot replication
- Simple bash script to rebalance pool data between all mirrors when adding vdevs to a pool
- 💘 "zpool iostats" for humans. Find the slow parts of ZFS pool
- Script to check ZFS replication status
- ZSys - daemon and client for zfs systems
- ZFS Boot Environment manager
- HomeLab setup with ZFS, Docker & Ansible
- ansible-zfs
- ZTop
- 💘 ZFS statistics tool
- Script to load ZFS encryption keys
- zfs-health-check
- ZFS Cheat Sheet #1
- 💘 ZFS Cheat Sheet #2
- 💘 ZFS Cheat Sheet #3
- ZFS Cheatsheet + Backups tutorial
- 💘 ZFS tuning cheat sheet
- ZFS RAIDZ Expansion Is Awesome but Has a Small Caveat
- ZFS backed persistent volumes on Kubernetes
- Sync ZFS backups to an offsite location natively in Kubernetes
- 💀 Kubernetes operator to manage ZFS Datasets
- ZFS Feature Discovery for Kubernetes
- Dynamic ZFS persistent volume provisioner for Kubernetes
- Docker volume plugin for creating persistent volumes as a dedicated zfs dataset
- ZFS snapshotter plugin for containerd
- ZFS/ ZoL quick fixes
- [PracticalZFS - Great collection of ZFS use cases](https://discourse.practicalzfs.com/
- Cockpit+ZFS Manager plugin
- Top Tools to Recover Data from ZFS Drives. How to Recover Data from ZFS File System
- The BEST Linux filesystem encryption in 2020 ext4 vs btrfs vs zfs vs luks vs gocryptfs comparison
- Explaining ZFS LOG and L2ARC Cache: Do You Need One and How Do They Work?
- Tuesday Tech Tip - ZFS Best Practices
- ZFS Basics - Pools and VDEVs - Testing, Configuration, and Expansion
- ZFS Boot Menu - I put that stuff on everything
- ZFS 101: Leveraging Datasets and Zvols for Better Data Management
- OpenZFS novel algorithms: snapshots, space allocation, RAID-Z - Matt Ahrens
- Lecture on OpenZFS read and write code paths - Matt Ahrens
- OpenZFS Basics by Matt Ahrens and George Wilson
- Software Tools to Read a ZFS Disk in Windows / How to Open a ZFS Disk in Windows
- Project ZeroFault: OpenZFS-Level Safeguards Against Pool Faults
- Understanding ZFS in the Real World: Mistakes Made, Lessons Learned & Future Plans
- Best Practice Architecture for Open-Source Storage using ZFS
- OpenZFS at scale: learning, challenges, and awesome customers by Sam Atkinson
Your contributions are welcome!
This code is released under the GNU General Public License v3.0. See LICENSE.
