Repository navigation
v0.30.0
DittoFS v0.30.0
A modular virtual filesystem that decouples file interfaces from storage backends.
Installation
Quick install (macOS / Linux):
curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.30.0/install.sh | shHomebrew (macOS/Linux):
brew tap marmos91/tap
brew install marmos91/tap/dfs # Server daemon
brew install marmos91/tap/dfsctl # Client CLIDebian/Ubuntu (APT):
curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfsRHEL/Fedora (YUM):
sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfsArch Linux:
curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.30.0/dfs_0.30.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.30.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfsScoop (Windows):
scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs # Server daemon
scoop install dfsctl # Client CLIDocker:
docker run -d \
-p 12049:12049 \
-p 12445:12445 \
-p 8080:8080 \
-v /path/to/config.yaml:/config/config.yaml:ro \
-v dittofs-data:/data \
marmos91c/dittofs:v0.30.0Binary Download:
# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.30.0/dfs_0.30.0_Linux_x86_64.tar.gz | tar xz
# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.30.0/dfsctl_0.30.0_Linux_x86_64.tar.gz | tar xzChangelog
Features
- 632bbf0: feat(dfsctl): add store check, a metadata-only manifest coverage scan (#2008) (@marmos91)
- 5204481: feat(dfsctl): repair the recoverable manifest damage store check reports (#2044) (@marmos91)
- 40ee8d3: feat(encryption): support master-key rotation via a retired-key set (#1951) (@marmos91)
- e732094: feat(kmip): validate the client against PyKMIP in CI and honour the KMIP key state (#2009) (@marmos91)
- 2f4b71c: feat: report why a share is not being served (#2011) (@marmos91)
Bug Fixes
- ae309f9: fix(adapters): report the real bind outcome from adapter enable (#2045) (@marmos91)
- 766c6ed: fix(api): bind {scope} on the id-less quota routes (#2055) (@marmos91)
- 5a2e620: fix(audit): close the LOW bug and security findings across block, metadata and control plane (#1971) (@marmos91)
- e411551: fix(authz): close three data-plane authorization gaps (#1932) (@marmos91)
- f070b6a: fix(badger): resolve a missing link-count key to the type-based default (#1989) (@marmos91)
- d14a30b: fix(block): block the legacy cas/ purge when a configured share is not registered (#1955) (@marmos91)
- 03779e3: fix(block): fetch chunks after a sparse hole instead of skipping to the block boundary (#1903) (@marmos91)
- f7f445b: fix(block): hold a cold-read hydrate to the bytes its manifest row still claims (#1933) (@marmos91)
- 16ff798: fix(block): journal reclaim/recovery correctness and local-store cleanups (#1948) (@marmos91)
- a912262: fix(block): make the covering-row check overflow-safe (#1969) (@marmos91)
- 3d65945: fix(block): re-seed cold intervals a share lost under an earlier build (#1889) (@marmos91)
- 7d66d61: fix(block): reclaim the legacy cas/ namespace per remote, not per share (#1928) (@marmos91)
- 949c0c3: fix(block): reconcile an uncovered read against the manifest, not just a cold one (#1965) (@marmos91)
- 1f95b38: fix(block): report the physical segment footprint as local disk_used (#1890) (@marmos91)
- 8c29143: fix(block): resolve overlapping manifest rows to the greatest start (#1953) (@marmos91)
- 8c41f31: fix(block): share decorator passthrough, drop dead append contract, correct rotation docs (#1946) (@marmos91)
- a4e95ab: fix(block): stage whole blocks on readahead, fail closed on a cold re-read (#1959) (@marmos91)
- 67a5890: fix(block): stop a stale straddling manifest row shadowing a newer row on cold reads (#1991) (@marmos91)
- 7f221d5: fix(block): verify record CRCs before copying payloads to remote or a new segment (#1925) (@marmos91)
- 336743c: fix(block): write manifest rows for deduped carve chunks (#1979) (@marmos91)
- c745cbe: fix(controlplane): validate the control-plane config before the first-boot admin bootstrap (#2056) (@marmos91)
- e72e068: fix(gc): propagate remote-tier error detail into the server-wide sweep total (#2040) (@marmos91)
- e88d008: fix(journal): a hydrate fills the local tier, it does not overwrite it (#2064) (@marmos91)
- b5af5ce: fix(journal): bound the age of unfsynced writes with a periodic dirty-age commit (#2005) (@marmos91)
- ace69fe: fix(journal): carve through the manifest row a run's end lands inside (#2049) (@marmos91)
- 083f43f: fix(journal): cover the framed FileID with the record CRC (#1988) (@marmos91)
- a3db32b: fix(journal): release the segment claim when eviction's cold-log append fails (#1922) (@marmos91)
- 2f5205e: fix(journal): skip a sealed segment that scans as zero valid records instead of panicking (#1921) (@marmos91)
- 99767ae: fix(lifecycle): abort startup when the machine SID is not durable (#1987) (@marmos91)
- adb8bf0: fix(lock): close the wait-for-graph check-then-act window and bound two lease-key sweeps (#1935) (@marmos91)
- 0131bac: fix(lock): derive a lease record's lock type, and take the store round-trip out from under the share mutex (#2043) (@marmos91)
- f175047: fix(memory): guard durable handles with the store-wide lock (#2034) (@marmos91)
- 87e9587: fix(metadata): bound the backpressure guard by the store's retry budget, not wall clock (#2068) (@marmos91)
- af7086f: fix(metadata): close five MED write-path audit findings (#1972) (@marmos91)
- ace4a92: fix(metadata): close small MED audit findings in the memory and badger stores (#1970) (@marmos91)
- 2d37dc7: fix(metadata): close the MED audit findings in the SQL stores (#1949) (@marmos91)
- a32bec1: fix(metadata): copy every FileAttr field in CopyFileAttr (#1982) (@marmos91)
- 46a96c9: fix(metadata): drop every derived badger cache on Reset and RestoreSnapshot (#2004) (@marmos91)
- f3634ae: fix(metadata): enforce per-share quotas against the share's own usage, not the metadata store's total (#2066) (@marmos91)
- 537f390: fix(metadata): make Identity.HasGID a pure read so concurrent callers are safe (#1902) (@marmos91)
- fadd83f: fix(metadata): make ListFileChunks membership agree across backends (#2046) (@marmos91)
- f560213: fix(metadata): narrow the straddling manifest row a carve run supersedes (#2039) (@marmos91)
- fcf560a: fix(metadata): purge the badger share cache on Reset and RestoreSnapshot (#1950) (@marmos91)
- 7cd665b: fix(metadata): reject an undecodable handle in statfs on every backend (#2069) (@marmos91)
- d465318: fix(metadata): scope durable-handle FileID lookups to a single handle (#1926) (@marmos91)
- e582dd8: fix(nfs): correct non-regular READ errno, clamp v3 READ to rtmax (#1939) (@marmos91)
- 78ddd44: fix(nfs): deny NFSv4 delegations over cross-protocol byte-range locks (#1990) (@marmos91)
- f93b7d2: fix(nfs): enforce netgroup export access on NFSv4, not only NFSv3 MOUNT (#1907) (@marmos91)
- 0a253f8: fix(nfs): register with the system rpcbind without an adapter restart (#1966) (@marmos91)
- 7679499: fix(nfs): report the real NFS version for a connected client (#2007) (@marmos91)
- 29928f1: fix(nfs4): consume the owner seqid when a sequenced operation fails (#1942) (@chessman)
- 5901017: fix(nfs4): release open state when a v4.1 client's lease expires (@chessman)
- 980c302: fix(runtime): surface adapter restart failures, hold entries until stopped, drop dead client tracking (#1943) (@marmos91)
- 7c93ca2: fix(s3): enforce the endpoint safety check on every dial, not just at config time (#1927) (@marmos91)
- 0fa1497: fix(shares): reject share names too long to encode a file handle (#2065) (@marmos91)
- 6b295f9: fix(shares): report per-share logical usage in share list, not the metadata store's total (#2059) (@marmos91)
- 3323ce8: fix(smb): claim durable handles by ID on reconnect (#1954) (@marmos91)
- 2b675ba: fix(smb): guard the OpenFile fields WRITE and CLOSE mutate, coalesce atime writes (#1938) (@marmos91)
- 8657b93: fix(smb): honor WRITE_THROUGH by flushing durably before acking the write (#1904) (@marmos91)
- 9ec2642: fix(smb): publish the OpenFile name triple as one atomic value (#1957) (@marmos91)
- 6fde2b0: fix(smb-conformance): excuse the self-contradictory channel-sequence CSN draw (#1960) (@marmos91)
- f93b5af: fix(snapshot): recover the orchestration error from the row when the goroutine finishes first (#2036) (@marmos91)
- 11a0316: fix: sweep the LOW audit findings classified gaps (#1975) (@marmos91)
Performance Improvements
- c205510: perf(metadata): project committed chunks incrementally instead of re-listing the manifest (#1906) (@marmos91)
- dcaaf07: perf(postgres): gate the per-op debug logs on the Debug level (#1998) (@marmos91)
- e6e6a41: perf(smb): coalesce per-READ atime updates instead of writing metadata on every read (#1905) (@marmos91)
- c5aec49: perf(smb): skip the durable-purge lock and lookup when a file has no disconnected handles (#1908) (@marmos91)
- db9e595: perf: batch the per-item round trips on four hot metadata paths (#1983) (@marmos91)
- d3fbb5e: perf: sweep the LOW perf findings on the data-plane hot paths (#1978) (@marmos91)
Others
- ec39e9e: Fix/quota reset develop (#1883) (@viquitorreis)
- 0a81547: build: expose the metrics and discovery ports in the images (#1997) (@marmos91)
- c9477e2: chore(claude): route graphify by question shape, and harden the issue skills (#2026) (@marmos91)
- 6d2a1bb: chore(release): v0.30.0 (@marmos91)
- b150578: ci(smb): make the Windows client-compat job skip honestly instead of failing on an unmeetable precondition (#2002) (@marmos91)
- 18db597: ci: stop the integration job hanging in the rpcbind install (#2028) (@marmos91)
- 70dc777: docs(audit): close the data-plane audit's escalated findings (#2050) (@marmos91)
- c701a93: docs(audit): rule on the two open journal findings (#2033) (@marmos91)
- d9552bd: docs(audit): rule the LOW structure tail and mark the ruled shortcuts in source (#2042) (@marmos91)
- 6b845aa: docs(audit): validate the two deferred structure findings and drop dead lock-manager stats (#2035) (@marmos91)
- 48a2998: docs(metadata): describe errors.go and lock_exports.go as the package's public API (#2025) (@marmos91)
- 89eca2f: docs(planning): record the audit sweep verdicts across the MED and LOW tranches (#1984) (@marmos91)
- 46aa0ff: docs(planning): record the data-plane audit report with fix status (#1920) (@marmos91)
- 0b307ff: docs(planning): record the dead-code tranche verdicts in the audit ledger (#2032) (@marmos91)
- a237319: docs(planning): refresh audit status — all escalated findings closed (#1937) (@marmos91)
- 3fcd7af: docs(planning): refresh the data-plane audit status through the MED tail (#1963) (@marmos91)
- 6a6eb67: docs(planning): refresh the data-plane audit status through the structure wave (#2031) (@marmos91)
- a58e9c9: docs(planning): update audit status for the journal recovery and reclaim fixes (#1924) (@marmos91)
- 2b14eff: docs(skills): add fix-issue and solve-issues workflow skills (#1986) (@marmos91)
- d79d309: fix(block,metadata): hold a committed file size to the durable extent (#1929) (@marmos91)
- eee7ef1: fix(sqlite,postgres): propagate GetLinkCount query errors instead of reporting zero links (#1901) (@marmos91)
- b4ff70a: refactor(acl): collapse the duplicated DACL walk and EvaluateContext builders (#2014) (@marmos91)
- 47803c1: refactor(journal): decompose recover() into named phases (#2015) (@marmos91)
- b9f59e2: refactor(lock): decompose the lease grant and break-ack god functions (#2016) (@marmos91)
- 1eff390: refactor(lock): split manager.go by the concerns it already names (#2017) (@marmos91)
- 2b865ce: refactor(metadata): collapse the third EvaluateContext copy onto the shared builder (#2030) (@marmos91)
- 47449ef: refactor(metadata): drop the memory store's dead lock sub-store and its shadow mutexes (#2018) (@marmos91)
- ce41ee3: refactor(metadata): extract per-share state from the Service god object into shareRegistry (#2061) (@marmos91)
- f16e724: refactor(metadata): extract store/basestore from internal/{quota,sqlstat} (#2062) (@marmos91)
- b9b5f96: refactor(metadata): replace the single-impl FileAccessChecker with a consumer-side probe (#2020) (@marmos91)
- 1502cc7: refactor(metadata): reuse quota.Delta for the memory restore reseed (#1947) (@marmos91)
- 6b7fd26: refactor(metadata): split PutFile into UpdateAttrs and SetManifest (#2058) (@marmos91)
- bd24d8d: refactor(runtime): delete the never-built restore orchestrator scaffold (#2019) (@marmos91)
- daa4f09: refactor(runtime): pass lifecycle collaborators as a named Deps struct (#2021) (@marmos91)
- 4c65a1f: refactor(shares): split service.go by concern (#2022) (@marmos91)
- ca0a5ed: refactor: apply the TRIVIAL findings from the LOW structure audit tranche (#1999) (@marmos91)
- 2aae168: refactor: sweep the LOW bloat findings (dead fields, params, duplicated helpers) (#2000) (@marmos91)
- cb3557e: refactor: validate the LOW duplication tranche; thread ctx into DiscoveryName (#2037) (@marmos91)
- a9c2088: test(crash): dm-flakey device-loss rig; verify the committed-size clamp on hardware (#1964) (@marmos91)
- 1fcb9f3: test(journal): bound backpressure termination by EvictMaxWait, not wall clock (#2048) (@marmos91)
- f30f262: test(metadata): pin DecrLiveChunkCount's conflict-retry contract in the store suite (#2041) (@marmos91)
- 3d5172b: test(metadata): split the combined error and value check in the read-cache test (#1985) (@marmos91)
- c08221d: test(nfs4): assert lock state drains when a v4.1 lease expires (@chessman)
- de7a703: test(smbtorture): report timeouts and unfinished tests instead of dropping them (#1919) (@marmos91)
Full Changelog: v0.29.2...v0.30.0
Verifying Checksums
sha256sum -c checksums.txtVerifying Signatures
Release checksums are signed with Sigstore cosign using keyless OIDC:
cosign verify-blob \
--bundle checksums.txt.sigstore.json \
--certificate-oidc-issuer https://token.actions.githubusercontent.com \
--certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
checksums.txtDocker Images
Multi-architecture images are available for linux/amd64 and linux/arm64:
marmos91c/dittofs:v0.30.0- This specific versionmarmos91c/dittofs:latest- Latest stable releasemarmos91c/dittofs:v0- Latest v0.x.xmarmos91c/dittofs:v0.30- Latest v0.30.x