Skip to content

Releases

v0.36.0

Choose a tag to compare

@github-actions github-actions released this 19 Oct 09:14
v0.36.0
51fc844

DittoFS v0.36.0

A modular virtual filesystem that decouples file interfaces from storage backends.

What's new

0.36.0 is a fix release, mostly for SMB. Before upgrading, check any SMB adapter config you have set by hand: the SMB adapter now refuses an encryption object it cannot apply, both when the config is stored and at boot. A stored row that 0.35.0 accepted can keep the SMB adapter down after the upgrade. See Changed below. No on-disk format changes in this release.

Changed

  • The SMB adapter refuses an encryption setting that it would otherwise ignore. encryption must be an object holding only encryption_mode and allowed_ciphers, and encryption_mode must be a string. Before, a non-object encryption, a non-string mode or a misspelt key such as mode was read as no mode at all. The adapter stayed on preferred and dfsctl reported success, so an operator who asked for required still served unencrypted SMB 2.x.

  • allowed_ciphers can no longer be set; the SMB cipher set is fixed. The key was accepted with any value and never applied: NEGOTIATE kept offering every cipher while dfsctl adapter edit smb --config reported success. A non-empty value is now refused with allowed_ciphers cannot be configured: the SMB cipher set is fixed. An absent key, null and [] are still accepted. Negotiation itself is unchanged.

    Both checks run when the config is stored and when the server boots. A stored row that fails them leaves the SMB adapter down with Adapter failed to start; continuing without it, while the server, the API and NFS keep running. To recover, store the config again without the offending key, for example dfsctl adapter edit smb --config '{"encryption":{"encryption_mode":"required"}}'. The adapter then starts without a server restart. Adapters seeded by default carry no config and are not affected.

Security

  • encryption.encryption_mode in the SMB adapter config now takes effect. dfs start read bind_address and signing out of the adapter config but skipped encryption_mode, so the process stayed on the preferred default and required could not be selected from the adapter config at all.

  • SMB refuses a security descriptor holding an ACE type it cannot store, instead of dropping that ACE. Object ACEs, callback ACEs, mandatory labels and other types the server does not model were skipped, the rest of the DACL was stored, and the request succeeded. A skipped deny granted what the client had denied; a skipped allow silently withdrew a grant. SET_INFO now answers STATUS_INVALID_PARAMETER and leaves the stored ACL as it was. A CREATE whose security descriptor fails to parse or validate is answered the same way and creates nothing, where it used to create the file without the descriptor. A SACL is parsed whenever one is present, so a SACL carrying anything other than audit or alarm ACEs, a mandatory label for instance, now fails the request too, even when the client did not ask for the SACL to be set.

  • SMB TREE_CONNECT is refused when the user's share permission cannot be resolved. A store error used to fall back to the share's default permission, which can be above a user's explicit grant, or above an explicit none. Since a tree keeps the permission it was connected with until a control-plane change re-checks it, the fallback outlived the failure. TREE_CONNECT now answers STATUS_ACCESS_DENIED, as NFS already refuses, and the client can retry once the store answers. A failed lookup of a principal's SID grants refuses as well.

Fixed

  • Truncating two files down to the same content no longer fails forever on the second one. The second truncate was refused on every retry, as NFS4ERR_DELAY over NFS and STATUS_INSUFFICIENT_RESOURCES over SMB. Truncate gave each file an identifier derived from its remaining content, which the Badger store kept unique, although nothing read it any more. That identifier and its index are now removed. The on-disk format stays compatible: stores and backups written by older versions still open, a file record drops the old field the next time it is written, and the leftover index keys are deleted when a store is first opened or right after a restore, with a log line (badger: dropped the retired ObjectID index). On a store with a million such keys this takes about 12 seconds. Rolling back to an older version can hit the bug again.

  • Opening an existing file for append over NFSv3 no longer empties it. A CREATE in UNCHECKED mode that named an existing file truncated it to zero and applied the request's mode and ownership to it. Linux clients send that CREATE for open(O_CREAT), so on some kernels echo x >> file lost the file's contents and wrote at offset 0. Now, as on the Linux kernel server, only a size the request carries is applied; without one the file is left alone. On a read-only share such a CREATE fails with NFS3ERR_ROFS, so a client opening the file for writing learns at open rather than at its first write. An existing directory or symlink named without a size is answered with its own handle and attributes. NFSv4 was not affected.

  • A Windows client can open an encrypted share when the session does not require encryption. In preferred mode the server encrypted the TREE_CONNECT response for a share that requires encryption, but the client learns that from the flag inside that response and was not decrypting yet. Windows retried and dropped the connection. TREE_CONNECT is now sent in the clear in that case; later commands on the tree are still encrypted, and a session that already requires encryption still encrypts TREE_CONNECT.

  • SMB Kerberos accepts a ticket whose addresses are NetBIOS names only. Windows often lists the workstation's NetBIOS name and no IP in a ticket's addresses, and comparing those to the connection's IP failed session setup with KRB_AP_ERR_BADADDR. Non-IP addresses no longer constrain the peer. A ticket that lists any IP still has to match the connection's IP. Verify failures now log client_address and ticket_addresses. NFS is unchanged.

  • A whole-share warm no longer holds memory in proportion to the share while its progress reporting is stalled. Each finished block queued one progress event until the reporter caught up; pending progress is now two counters. Progress calls may therefore jump by more than one block, and a successful warm still ends with done equal to total.

  • The operator now shows when the DittoFS API refuses its own account. Applying spec.snapshotPolicies and turning on the NFS portmapper both need the admin role, so the operator's account (role operator) got 403 on each, and that showed only in a verbose log line. A new Authorized condition on the DittoServer is False and names each refused call. It turns True once every call gets its answer, and a transient API error leaves it as it was. The NFS adapter's Service now publishes port 111 only once the operator has seen the portmapper on, so it no longer points at a port nothing listens on. The operator still cannot apply these settings without the admin role.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.36.0/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.36.0/dfs_0.36.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.36.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.36.0

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.36.0/dfs_0.36.0_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.36.0/dfsctl_0.36.0_Linux_x86_64.tar.gz | tar xz

Changelog

Features

Read more

v0.35.0

Choose a tag to compare

@github-actions github-actions released this 12 Oct 16:09
v0.35.0
aea1948

DittoFS v0.35.0

A modular virtual filesystem that decouples file interfaces from storage backends.

What's new

The main change in 0.35.0 is that BadgerDB is now the only metadata store: the PostgreSQL, SQLite and legacy memory metadata store backends have been removed. Read the migration guide below before upgrading a server that uses any of them.

Removed

  • Breaking: the PostgreSQL, SQLite and legacy memory metadata stores are gone; BadgerDB is the only metadata store. The postgres, sqlite and memory metadata store types no longer exist. A server whose configuration still names one refuses to start, with unsupported metadata store type, and changes nothing. There is no conversion tool: a share on a SQL store moves by copying its files to a share on a new instance. A memory store is removed before the upgrade and recreated as a Badger store kept in RAM, with dfsctl store metadata add --name <store> --in-memory. See the metadata store migration guide before upgrading. The control-plane database (database:, SQLite or PostgreSQL) is not affected.

Fixed

  • A write refused because the local store is full now reaches the client as "no space", not as an I/O error. SMB returns STATUS_DISK_FULL, NFSv3 NFS3ERR_NOSPC and NFSv4 NFS4ERR_NOSPC, where all three used to return their generic I/O error.

  • A request that arrives with no deadline gets 30 seconds at the block store. A cold read from a remote that stopped answering, or a write held while the local store was at capacity, used to wait out their own 60-second budgets, and the backpressure budget restarted whenever the remote drained a little.

  • Deleting a file no longer waits for a flush pass to finish uploading. The delete itself was already durable; only the best-effort reclaim at its end waited, and with the remote down it waited for upload slots that never freed. An SMB delete-on-close was measured held for 68 seconds, past the point where clients give up on the connection.

  • A write that lands while a CLONE replaces its destination is no longer read back as zeros. A write outside the cloned range could commit between the clone's metadata transaction and its journal discard and be lost, and a background carve or warm could republish the old content over the clone. CLONE now holds the source and destination exclusively for the whole replacement, and ordinary writes, carves and warms take shared ownership.

  • That ownership is no longer held across a clone's upload or a whole-share warm. A CLONE drains its source before taking the exclusive hold, and a warm holds one payload at a time, so reads and writes on other files no longer queue behind either.

  • Directory removal and rename are ordered against creates inside the directory. A directory could be removed after another operation had created or moved a child into it, a create could commit after its parent was gone, and a delayed removal could delete a name that a rename had already replaced. Creates of distinct names in one directory still run concurrently.

  • New files created over SMB get the user's own primary GID, as they do over NFS. A user with a GID and no group memberships used to write files owned by group 1000, and a user with groups got their first group's GID instead of their own.

  • dfsctl store block add --config no longer drops the flags given beside it. --compression, every --encryption-* flag, --parallel-uploads and the S3 field flags were silently discarded, so a store asked for compression or encryption was created without it. Flags are now merged into the JSON, and a flag that contradicts a key the JSON already sets is refused. --type memory now sends the compression, encryption and upload settings as well.

  • An S3 endpoint refused by the private-address guard fails at once. The SDK retried the refused dial up to ten times with backoff, turning a definite refusal into a 30-second timeout.

  • The startup warning for a missing config file names dfs init, not dittofs init.

Performance

  • Sequential reads of a file that is already local no longer re-download it. Prefetch ignored what the journal already held, so each warm 32 MiB pass fetched 24 MiB from the remote again; it now fetches only the ranges that are not resident. Demand fetches and integrity checks are unchanged.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.35.0/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.35.0/dfs_0.35.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.35.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.35.0

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.35.0/dfs_0.35.0_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.35.0/dfsctl_0.35.0_Linux_x86_64.tar.gz | tar xz

Changelog

Bug Fixes

Performance Improvements

Others

Read more

v0.34.1

Choose a tag to compare

@github-actions github-actions released this 02 Oct 15:41
v0.34.1
ebd28f1

DittoFS v0.34.1

A modular virtual filesystem that decouples file interfaces from storage backends.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.34.1/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.34.1/dfs_0.34.1_amd64.pkg.tar.zst
sudo pacman -U dfs_0.34.1_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.34.1

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.34.1/dfs_0.34.1_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.34.1/dfsctl_0.34.1_Linux_x86_64.tar.gz | tar xz

Changelog

Bug Fixes

Others


Full Changelog: v0.34.0...v0.34.1

Verifying Checksums

sha256sum -c checksums.txt

Verifying Signatures

Release checksums are signed with Sigstore cosign using keyless OIDC:

cosign verify-blob \
  --bundle checksums.txt.sigstore.json \
  --certificate-oidc-issuer https://token.actions.githubusercontent.com \
  --certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
  checksums.txt

Docker Images

Multi-architecture images are available for linux/amd64 and linux/arm64:

  • marmos91c/dittofs:v0.34.1 - This specific version
  • marmos91c/dittofs:latest - Latest stable release
  • marmos91c/dittofs:v0 - Latest v0.x.x
  • marmos91c/dittofs:v0.34 - Latest v0.34.x

v0.34.0

Choose a tag to compare

@github-actions github-actions released this 24 Sep 15:53
v0.34.0
71cf4e1

DittoFS v0.34.0

A modular virtual filesystem that decouples file interfaces from storage backends.

Upgrade notes

The metadata store's on-disk format moves to version 2, and the move is one-way.

Once a v0.34.0 server opens a Badger metadata store, v0.33.0 and earlier will refuse to open it and report a future-format error. Nothing is lost and nothing is corrupted, but there is no downgrade path short of restoring a backup taken before the upgrade. Take one first if you need the option.

Existing stores migrate themselves. A file's chunk list is now held in segments rather than one value, reads accept both shapes, and the old whole-list key is retired the first time the file is written. There is no migration step to run.

Why it changed: a chunk list past a few thousand refs crossed Badger's large-value threshold, and every later commit appended a fresh copy to a log that its own reclamation pass never learned to collect. One field store reached 245 GiB of log against 0.15 GiB of live data.

Two operations that used to succeed now fail

Renaming a directory into its own subtree returns EINVAL. It used to be accepted, and it built a cycle of directories that no path reached, that the link count reported as alive, and that nothing ever collected. Any client with write permission on two directories could create one. Cycles created by an earlier build are still there and still uncollected.

Setting extended attributes past 256 KiB per file returns NFS4ERR_XATTR2BIG, or STATUS_EA_TOO_LARGE over SMB. The limit is on the encoded total for one file, not on each value, and it is all-or-nothing: nothing is stored when it trips. Per-value limits were already enforced at 64 KiB. For scale, ext4 bounds a file's whole xattr set to a single filesystem block, typically 4 KiB.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.34.0/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.34.0/dfs_0.34.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.34.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.34.0

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.34.0/dfs_0.34.0_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.34.0/dfsctl_0.34.0_Linux_x86_64.tar.gz | tar xz

Changelog

Features

Bug Fixes

Performance Improvements

Others


Full Changelog: v0.33.0...v0.34.0

Verifying Checksums

sha256sum -c checksums.txt

Verifying Signatures

Release checksums are signed with Sigstore cosign using keyless OIDC:

cosign verify-blob \
  --bundle checksums.txt.sigstore.json \
  --certificate-oidc-issuer https://token.actions.githubusercontent.com \
  --certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
  checksums.txt

Docker Images

Multi-architecture images are available for linux/amd64 and linux/arm64:

  • marmos91c/dittofs:v0.34.0 - This specific version
  • marmos91c/dittofs:latest - Latest stable release
  • marmos91c/dittofs:v0 - Latest v0.x.x
  • marmos91c/dittofs:v0.34 - Latest v0.34.x

v0.33.0

Choose a tag to compare

@github-actions github-actions released this 22 Sep 08:47
v0.33.0
2dfca5e

DittoFS v0.33.0

A modular virtual filesystem that decouples file interfaces from storage backends.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.33.0/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.33.0/dfs_0.33.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.33.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.33.0

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.33.0/dfs_0.33.0_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.33.0/dfsctl_0.33.0_Linux_x86_64.tar.gz | tar xz

Changelog

Bug Fixes

Performance Improvements

  • 1da70c9: perf(metadata): persist quota counters so startup never scans every file row (#2809) (@marmos91)
  • 65bbda7: perf(wave7): run phase 0 locally, and find the group commit limited by shard fan-out (#2818) (@marmos91)

Others


Full Changelog: v0.32.0...v0.33.0

Verifying Checksums

sha256sum -c checksums.txt

Verifying Signatures

Release checksums are signed with Sigstore cosign using keyless OIDC:

cosign verify-blob \
  --bundle checksums.txt.sigstore.json \
  --certificate-oidc-issuer https://token.actions.githubusercontent.com \
  --certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
  checksums.txt

Docker Images

Multi-architecture images are available for linux/amd64 and linux/arm64:

  • marmos91c/dittofs:v0.33.0 - This specific version
  • marmos91c/dittofs:latest - Latest stable release
  • marmos91c/dittofs:v0 - Latest v0.x.x
  • marmos91c/dittofs:v0.33 - Latest v0.33.x

v0.32.0

Choose a tag to compare

@github-actions github-actions released this 21 Sep 11:42
v0.32.0
a39fbd1

DittoFS v0.32.0

A modular virtual filesystem that decouples file interfaces from storage backends.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.32.0/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.32.0/dfs_0.32.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.32.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.32.0

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.32.0/dfs_0.32.0_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.32.0/dfsctl_0.32.0_Linux_x86_64.tar.gz | tar xz

Changelog

Features

  • eed3469: feat(docker): ship the compose stack the install guide documents (#2616) (@marmos91)
  • 0164002: feat(engine): sink upload semaphore, WithoutCancel reap, shutdown test port (@marmos91)
  • 998254d: feat(journal): FlushAll drain, per-file closures, carver cut-cursor fix (@marmos91)
  • f239a81: feat(journal): lane F engine closure, ported pins, carve retirement (@marmos91)

Bug Fixes

Read more

v0.31.1

Choose a tag to compare

@github-actions github-actions released this 10 Sep 12:14
v0.31.1
25dbd71

DittoFS v0.31.1

A modular virtual filesystem that decouples file interfaces from storage backends.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.31.1/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.31.1/dfs_0.31.1_amd64.pkg.tar.zst
sudo pacman -U dfs_0.31.1_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.31.1

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.31.1/dfs_0.31.1_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.31.1/dfsctl_0.31.1_Linux_x86_64.tar.gz | tar xz

Changelog

Features

  • 02f2be1: feat(nfs): grant delegations to NFSv4.1 clients on a verified callback path (#2479) (@marmos91)

Bug Fixes

  • ecdb4ed: fix(api): drop RealIP so the request log records an unforgeable address (#2291) (@marmos91)
  • f793f27: fix(block): hold the retention pin in the local store so Start cannot lift it (#2302) (@marmos91)
  • 4ac5071: fix(block): never evict bytes a share has no way to fetch back (#2376) (@marmos91)
  • 29ffe1d: fix(block): route the carve block size to the loop that reads it (#2311) (@marmos91)
  • 9314a04: fix(block): stop reporting a local-tier check that never ran (#2347) (@marmos91)
  • 2406afb: fix(ci): analyse cold so a bumped go.sum cannot poison the lint cache (#2443) (@marmos91)
  • 8b05dc1: fix(conformance): stop reporting a setup failure as new test failures (#2477) (@marmos91)
  • 5454e4f: fix(deps): bump grpc to 1.83.1 in the operator module (#2411) (@marmos91)
  • a2791f9: fix(journal): fail a restore whose shard can never be made durable (#2390) (@marmos91)
  • d3172e6: fix(journal): fence a hydrate against the truncate marker's own version (#2386) (@marmos91)
  • ad6162b: fix(journal): order unstamped segments by age, not ahead of everything (#2308) (@marmos91)
  • 90a7b8d: fix(journal): record which writer made a cold entry, and stop restore guessing (#2478) (@marmos91)
  • 58dc7c2: fix(journal): size the carve block arena to the share's own chunk ceiling (#2480) (@marmos91)
  • bc58034: fix(lint): stop the citation check scanning nested working copies (#2267) (@marmos91)
  • a02d55f: fix(metadata): make the xattr read-modify-write atomic (#2452) (@marmos91)
  • 111192f: fix(metadata): persist the create verifier on SQL backends, and rename the row the transaction read (#2379) (@marmos91)
  • 9f35691: fix(metadata): release a file's bytes from the share usage counters when its last link goes (#2288) (@marmos91)
  • cde7dd9: fix(metadata): rename over an existing file never freed the clobbered file's bytes (#2309) (@marmos91)
  • 2a3b305: fix(nfs): DESTROY_CLIENTID must not gate on the requester's client ID, and must report an unrecognized target first (#2489) (@marmos91)
  • 1d69f4d: fix(nfs): bind NFSv4 stateids to their owning client and make the stateid other unpredictable (#2448) (@marmos91)
  • 48671a2: fix(nfs): call the cross-protocol lock manager without holding the global state mutex (#2459) (@marmos91)
  • 47a439e: fix(nfs): check read permission in NFSv4 READ, READ_PLUS and SEEK (#2427) (@marmos91)
  • 5f05f50: fix(nfs): check the stateid belongs to the caller in CLOSE, LOCK, LOCKU, OPEN_DOWNGRADE, OPEN_CONFIRM and TEST_STATEID (#2466) (@marmos91)
  • 1a478fc: fix(nfs): default max_version to 4.0 until full NFSv4.1 lands (@marmos91)
  • 06cef31: fix(nfs): draw the server boot epoch at random instead of reading the clock (#2485) (@marmos91)
  • c5dd09b: fix(nfs): enforce CREATE_SESSION channel-size floors, flag validation, and NOSPC session cap (#2471) (#2494) (@marmos91)
  • 13931d0: fix(nfs): implement the EXCHANGE_ID flag validation and record algorithm of RFC 8881 18.35.4 (#2491) (@marmos91)
  • f9ebda7: fix(nfs): key the RECLAIM_COMPLETE duplicate check on the client, not the grace period (#2486) (@marmos91)
  • c810d03: fix(nfs): merge same-owner byte-range locks and keep one lease per client ID (#2361) (@marmos91)
  • 1cee59f: fix(nfs): narrow the SECINFO flavor list to the target share's auth-flavor policy (#2460) (@marmos91)
  • 2acb10d: fix(nfs): reject bad, old and stale stateids in CLOSE, OPEN_CONFIRM, OPEN_DOWNGRADE and LOCK (#2484) (@marmos91)
  • a4b0ee9: fix(nfs): reject cross-share LINK — the v3 share check was a tautology (#2432) (@marmos91)
  • 14fd86a: fix(nfs): return NFS4ERR_NOT_ONLY_OP when a session-exempt op shares its COMPOUND (#2481) (@marmos91)
  • 321a443: fix(nfs3): narrow ACCESS replies to the request and drop DELETE for non-directories (#2273) (@marmos91)
  • a8c8772: fix(nfs4): translate the all-ones lock length into the manager's end-of-file range (#2274) (@marmos91)
  • 655f12b: fix(nfsv4): REMOVE never freed the removed file's payload bytes (#2286) (@marmos91)
  • fc16cb0: fix(nfsv4): put space_avail/free/total at their RFC 7530 attribute numbers (#2458) (@marmos91)
  • 2a6ac1b: fix(postgres): create the filesystem_meta table the share queries read (#2316) (@marmos91)
  • b608506: fix(smb): answer a CHANGE_NOTIFY that registers after a directory is marked deleted (#2283) (@marmos91)
  • 93c8116: fix(smb): authorize the parent-dir frozen-timestamp restore by the frozen handle's grant (#2319) (@marmos91)
  • 99d2203: fix(smb): bind a client-supplied FileId to the session that opened it (#2461) (@marmos91)
  • 24846cb: fix(smb): correct the seven wrong spec citations and empty the allowlist (#2269) (@marmos91)
  • ee3ab6a: fix(smb): don't announce a rename that a hard link made a no-op (#2387) (@marmos91)
  • 923c40e: fix(smb): hardlink replace never freed the replaced file's bytes (#2318) (@marmos91)
  • 63b1aa4: fix(smb): keep the ChangeTime a client observed across rename (#2284) (@marmos91)
  • c77afc8: fix(smb): let FILE_WRITE_ATTRIBUTES authorize a timestamp write (#2313) (@marmos91)
  • a39ec44: fix(smb): let rename's ChangeTime advance stand, and pin frozen timestamps across rename + CLOSE (#2279) (@marmos91)
  • c5ba24c: fix(smb): make the rename ChangeTime preserve conditional (#2343) (@marmos91)
  • 0bc01b3: fix(smb): scope async-flagged CANCEL lookups to the arriving connection (#2426) (@marmos91)
  • 9295779: fix(smb): scope the tree lookup to the requesting session (#2424) (@marmos91)
  • 3c22a38: fix(smbtorture): anchor the NT_STATUS_NO_MEMORY flake excuse to a connection diagnostic (#2272) (@marmos91)
  • 025de21: fix(test): stop the known-failures parser reading fenced examples as rows (#2412) (@marmos91)

Performance Improvements

Others

Read more

v0.31.0

Choose a tag to compare

@github-actions github-actions released this 02 Sep 12:14
v0.31.0
4d317e5

DittoFS v0.31.0

A modular virtual filesystem that decouples file interfaces from storage backends.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.31.0/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.31.0/dfs_0.31.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.31.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.31.0

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.31.0/dfs_0.31.0_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.31.0/dfsctl_0.31.0_Linux_x86_64.tar.gz | tar xz

Changelog

Features

Bug Fixes

Performance Improvements

Read more

v0.30.0

Choose a tag to compare

@github-actions github-actions released this 22 Aug 15:54
v0.30.0
6d2a1bb

DittoFS v0.30.0

A modular virtual filesystem that decouples file interfaces from storage backends.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.30.0/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.30.0/dfs_0.30.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.30.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.30.0

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.30.0/dfs_0.30.0_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.30.0/dfsctl_0.30.0_Linux_x86_64.tar.gz | tar xz

Changelog

Features

Bug Fixes

Read more

v0.29.2

Choose a tag to compare

@github-actions github-actions released this 29 Jul 08:40
v0.29.2
da7a0b5

DittoFS v0.29.2

A modular virtual filesystem that decouples file interfaces from storage backends.

Installation

Quick install (macOS / Linux):

curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.29.2/install.sh | sh

Homebrew (macOS/Linux):

brew tap marmos91/tap
brew install marmos91/tap/dfs      # Server daemon
brew install marmos91/tap/dfsctl   # Client CLI

Debian/Ubuntu (APT):

curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfs

RHEL/Fedora (YUM):

sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfs

Arch Linux:

curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.29.2/dfs_0.29.2_amd64.pkg.tar.zst
sudo pacman -U dfs_0.29.2_amd64.pkg.tar.zst
sudo systemctl enable --now dfs

Scoop (Windows):

scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs       # Server daemon
scoop install dfsctl    # Client CLI

Docker:

docker run -d \
  -p 12049:12049 \
  -p 12445:12445 \
  -p 8080:8080 \
  -v /path/to/config.yaml:/config/config.yaml:ro \
  -v dittofs-data:/data \
  marmos91c/dittofs:v0.29.2

Binary Download:

# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.29.2/dfs_0.29.2_Linux_x86_64.tar.gz | tar xz

# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.29.2/dfsctl_0.29.2_Linux_x86_64.tar.gz | tar xz

Changelog

Bug Fixes

Others


Full Changelog: v0.29.1...v0.29.2

Verifying Checksums

sha256sum -c checksums.txt

Verifying Signatures

Release checksums are signed with Sigstore cosign using keyless OIDC:

cosign verify-blob \
  --bundle checksums.txt.sigstore.json \
  --certificate-oidc-issuer https://token.actions.githubusercontent.com \
  --certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
  checksums.txt

Docker Images

Multi-architecture images are available for linux/amd64 and linux/arm64:

  • marmos91c/dittofs:v0.29.2 - This specific version
  • marmos91c/dittofs:latest - Latest stable release
  • marmos91c/dittofs:v0 - Latest v0.x.x
  • marmos91c/dittofs:v0.29 - Latest v0.29.x