Skip to content

v0.34.0

Choose a tag to compare

@github-actions github-actions released this 24 Sep 15:53
· 670 commits to develop since this release
v0.34.0
71cf4e1

DittoFS v0.34.0

A modular virtual filesystem that decouples file interfaces from storage backends.

Upgrade notes

The metadata store's on-disk format moves to version 2, and the move is one-way.

Once a v0.34.0 server opens a Badger metadata store, v0.33.0 and earlier will refuse to open it and report a future-format error. Nothing is lost and nothing is corrupted, but there is no downgrade path short of restoring a backup taken before the upgrade. Take one first if you need the option.

Existing stores migrate themselves. A file's chunk list is now held in segments rather than one value, reads accept both shapes, and the old whole-list key is retired the first time the file is written. There is no migration step to run.

Why it changed: a chunk list past a few thousand refs crossed Badger's large-value threshold, and every later commit appended a fresh copy to a log that its own reclamation pass never learned to collect. One field store reached 245 GiB of log against 0.15 GiB of live data.

Two operations that used to succeed now fail

Renaming a directory into its own subtree returns EINVAL. It used to be accepted, and it built a cycle of directories that no path reached, that the link count reported as alive, and that nothing ever collected. Any client with write permission on two directories could create one. Cycles created by an earlier build are still there and still uncollected.

Setting extended attributes past 256 KiB per file returns NFS4ERR_XATTR2BIG, or STATUS_EA_TOO_LARGE over SMB. The limit is on the encoded total for one file, not on each value, and it is all-or-nothing: nothing is stored when it trips. Per-value limits were already enforced at 64 KiB. For scale, ext4 bounds a file's whole xattr set to a single filesystem block, typically 4 KiB.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.34.0/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.34.0/dfs_0.34.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.34.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.34.0

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.34.0/dfs_0.34.0_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.34.0/dfsctl_0.34.0_Linux_x86_64.tar.gz | tar xz

Changelog

Features

Bug Fixes

Performance Improvements

Others


Full Changelog: v0.33.0...v0.34.0

Verifying Checksums

sha256sum -c checksums.txt

Verifying Signatures

Release checksums are signed with Sigstore cosign using keyless OIDC:

cosign verify-blob \
  --bundle checksums.txt.sigstore.json \
  --certificate-oidc-issuer https://token.actions.githubusercontent.com \
  --certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
  checksums.txt

Docker Images

Multi-architecture images are available for linux/amd64 and linux/arm64:

  • marmos91c/dittofs:v0.34.0 - This specific version
  • marmos91c/dittofs:latest - Latest stable release
  • marmos91c/dittofs:v0 - Latest v0.x.x
  • marmos91c/dittofs:v0.34 - Latest v0.34.x