Repository navigation
v0.31.0
DittoFS v0.31.0
A modular virtual filesystem that decouples file interfaces from storage backends.
Installation
Quick install (macOS / Linux):
curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.31.0/install.sh | shHomebrew (macOS/Linux):
brew tap marmos91/tap
brew install marmos91/tap/dfs # Server daemon
brew install marmos91/tap/dfsctl # Client CLIDebian/Ubuntu (APT):
curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfsRHEL/Fedora (YUM):
sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfsArch Linux:
curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.31.0/dfs_0.31.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.31.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfsScoop (Windows):
scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs # Server daemon
scoop install dfsctl # Client CLIDocker:
docker run -d \
-p 12049:12049 \
-p 12445:12445 \
-p 8080:8080 \
-v /path/to/config.yaml:/config/config.yaml:ro \
-v dittofs-data:/data \
marmos91c/dittofs:v0.31.0Binary Download:
# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.31.0/dfs_0.31.0_Linux_x86_64.tar.gz | tar xz
# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.31.0/dfsctl_0.31.0_Linux_x86_64.tar.gz | tar xzChangelog
Features
- 339a134: feat(integrity): run the structural manifest scan on a schedule (#2080) (@marmos91)
- dd82b32: feat(lint): fail CI when a comment names a structure and cites a different spec section (#2192) (@marmos91)
- ca01f58: feat(offline): report per-share remote-only bytes and offline read safety (#2082) (@marmos91)
Bug Fixes
- 44f6aaa: fix(adapters): an out-of-range port panicked under the service lock and wedged the control plane (#2213) (@marmos91)
- 61dcaa3: fix(api): gate the drain-uploads stall trip on there being something to upload (#2099) (@marmos91)
- e87b695: fix(badger): apply capabilities in memory only after the write commits (#2221) (@marmos91)
- 54acb39: fix(block): bound parsed chunk offsets to int64 at the parse (#2118) (@marmos91)
- 4a2c430: fix(block): give a manifest row an in-chunk start offset so it can be narrowed off its head (#2137) (@marmos91)
- 3ef4d7d: fix(block): order the carve dedup oracle against the remote GC sweep (#2249) (@marmos91)
- 2e40487: fix(block): seed the local tier for a server-side copy's destination (#2161) (@marmos91)
- bf03c41: fix(block): stop a reflink's destination serving the content it replaced (#2178) (@marmos91)
- 7f1b811: fix(carve): keep a row reaching past a reaped run, batch the reap, evict under carveMu (#2122) (@marmos91)
- 0760d97: fix(carve): keep what a run's first chunk takes over, where the journal says it is owed (#2163) (@marmos91)
- 0d3aab2: fix(clone): clip a local-only clone's destination past the source's size (#2188) (@marmos91)
- a675d03: fix(dfsbench): judge the cold-barrier drain residue by the segments it pins (#2088) (@marmos91)
- 71130f8: fix(engine): cross-check offline readiness against the manifest (#2121) (@marmos91)
- f6038a6: fix(engine): hold the per-file commit lock while reaping superseded manifest rows (#2071) (@marmos91)
- d9847e6: fix(journal): fence Hydrate against a racing Delete (#2252) (@marmos91)
- 4a56382: fix(journal): fold the cold log into the version RestoreToVersion rewinds to (#2253) (@marmos91)
- 4906e43: fix(journal): fsync the view RestoreToVersion re-materializes (#2248) (@marmos91)
- 85e1314: fix(journal): let the write-path capacity gate force-seal synced actives (#2266) (@marmos91)
- 72f0b25: fix(journal): persist Invalidate's cold demotion before marking the interval (#2103) (@marmos91)
- 82e7e18: fix(journal): repack target never counted its records, so eviction could drop dirty bytes (#2246) (@marmos91)
- 555fdfc: fix(journal): truncate the torn cold.log tail at recovery (#2245) (@marmos91)
- db68d21: fix(metadata): make DeleteChild idempotent across all four backends (#2261) (@marmos91)
- 0692f19: fix(nfs4): bind the client ID to the authenticating principal where the RFCs require it (#2173) (@marmos91)
- dd3477b: fix(nfs4): deliver delegation recalls — AUTH_SYS credential and the client's callback_ident (#2219) (@marmos91)
- 69a5689: fix(nfs4): key v4.1 open- and lock-owners by the session's client (#2146) (@chessman)
- ff14b24: fix(nfs4): open the reboot-grace window only when state is reclaimable (#2214) (@marmos91)
- 60e2bd9: fix(nfs4): reject the byte ranges RFC 7530 calls invalid in LOCK (#2210) (@chessman)
- f79801f: fix(nfs4): report only the ACCESS rights the object and minorversion can answer (#2211) (@chessman)
- 8f614a9: fix(nfs4): validate the client ID on OPEN (#2063) (@chessman)
- 04be48b: fix(shares): reject share names that cannot address their own directory (#2116) (@marmos91)
- 01aadfe: fix(smb): answer a CHANGE_NOTIFY from events that already exist (#2138) (@marmos91)
- 23b9742: fix(smb): answer every CHANGE_NOTIFY the notify path owes, one operation at a time (#2175) (@marmos91)
- 05062d1: fix(smb): answer every CHANGE_NOTIFY the registry removes (#2131) (@marmos91)
- b031b1c: fix(smb): apply the three SET_INFO access gates MS-FSA states as MUSTs (#2184) (@marmos91)
- e3da5b9: fix(smb): arm the session-cleanup barrier before draining a dying connection (#2120) (@marmos91)
- 73f3ef3: fix(smb): break a deleted file's Handle leases only once teardown actually removed it (#2183) (@marmos91)
- 47a2d1f: fix(smb): decide content-change dir-lease breaks at change time, not at dispatch time (#2081) (@marmos91)
- 1dedf7d: fix(smb): decide the last delete-on-close handle atomically with its departure (#2143) (@marmos91)
- 4239639: fix(smb): decline a delete-on-close removal of a non-empty directory instead of failing the close (#2159) (@marmos91)
- 8850852: fix(smb): dispatch FSCTL_SET_REPARSE_POINT on the code clients actually send (#2194) (@marmos91)
- cf184ba: fix(smb): gate rename on the destination parent's write sharing, not delete sharing (#2135) (@marmos91)
- 5dda058: fix(smb): give buffered notify events to the earliest outstanding request (#2151) (@marmos91)
- 57fb21f: fix(smb): key per-lease state on the lease's identity, not on the lease key alone (#2139) (@marmos91)
- 865b92e: fix(smb): lease epoch only seeds on first grant; rename break precedes the destination lookup (#2124) (@marmos91)
- d1ef833: fix(smb): order response emission per connection so a break is never overtaken (#2162) (@marmos91)
- 6141384: fix(smb): relate base files and streams by resolved identity, not path text (#2141) (@marmos91)
- feb2ea5: fix(smb): release the DH2Q replay reservation before the parked CREATE's final response (#2097) (@marmos91)
- a013628: fix(smb): scope a lease's epoch and state to its own file, not the lease key (#2149) (@marmos91)
- 278b133: fix(smb): scope lease ack, reclaim and break staging to the lease's own file (#2157) (@marmos91)
- 9cdaeeb: fix(smb): stop bumping LastWriteTime on an attribute-only SET_INFO (#2191) (@marmos91)
Performance Improvements
- 4f2fe25: perf(journal): carve a file's dirty runs concurrently (#2072) (@marmos91)
- 5d1f6d8: perf(journal): pack one remote block across several dirty runs (#2092) (@marmos91)
- b132ff1: perf(seed): batch the manifest cold seed into one durable append (#2087) (@marmos91)
- 6d2afd6: perf(shares): read only the size the share-start reconcile compares (#2077) (@marmos91)
- 1c7b735: perf(sql): seek file_blocks by ID range instead of scanning with LIKE (#2089) (@marmos91)
Others
- b1b22dd: chore(deps): bump dependencies flagged by Dependabot (#2101) (@marmos91)
- 9786e0c: chore(k8s): drop the committed operator binary and the dead Dockerfile that needed it (#2195) (@marmos91)
- 9bc1e4d: chore(planning): prune eight spent plans (#2242) (@marmos91)
- 4d317e5: chore(release): v0.31.0 (@marmos91)
- ce37eaa: ci(codeql): analyse develop, and close out the #2104 alert triage (#2166) (@marmos91)
- 8ee9ad9: ci(codeql): attest the operator module's coverage instead of adding a second analysis (#2180) (@marmos91)
- 4f4ae22: ci(e2e): make a failing E2E run conclude failure instead of cancelled (#2212) (@marmos91)
- cce7190: ci(smb-compat): gate the Windows 445 bind on the same flag as the assertions (#2153) (@marmos91)
- 92ff2de: ci(smb-compat): record how long srvnet actually takes to release TCP 445 (#2158) (@marmos91)
- 33420e6: ci(smb-compat): record that the 30s wait for TCP 445 is measured, not a guess (#2170) (@marmos91)
- 20d308c: ci: declare the GITHUB_TOKEN scopes each workflow needs (#2117) (@marmos91)
- 6c1330e: docs(durability): document relaxed_durability and the namespace loss window (#2074) (@marmos91)
- 2c4944b: docs(internals): RFC — split the block data flow into pier, crane and ferry (#2233) (@marmos91)
- 60d4e61: docs(smb): correct 60+ wrong MS-SMB2 spec citations in the SMB adapter (#2156) (@marmos91)
- 41cab93: docs(smb): correct ~243 wrong MS-FSCC and MS-FSA spec citations in the SMB adapter (#2174) (@marmos91)
- 8823c2f: docs(smbtorture): repoint the notify.rec and mask-change rows at the failure they now hit (#2142) (@marmos91)
- 816ff70: refactor(badger): pool-path share and server methods delegate to the transaction path (#2223) (@marmos91)
- 9bdeb83: refactor(metadata): name the SQL executor contract once in store/sql (#2225) (@marmos91)
- c1339a4: refactor(metadata): one body for handle, capability and statistics reads (#2239) (@marmos91)
- e2ce799: refactor(metadata): one body for the directory-entry and link-count writes (#2240) (@marmos91)
- c31465d: refactor(metadata): one body for the inode delete and the server-config pair (#2244) (@marmos91)
- 3bb0d56: refactor(metadata): one body for the share options and share delete writes (#2243) (@marmos91)
- eb0aced: refactor(metadata): one body per file read instead of four (#2235) (@marmos91)
- 792bad6: refactor(metadata): one body per share read, and one SetParent (#2237) (@marmos91)
- 4ec814b: refactor(metadata): one chunk-store implementation shared by both SQL dialects (#2232) (@marmos91)
- f9df205: refactor(metadata): one client-registration and client-recovery store (#2255) (@marmos91)
- fa0cbbe: refactor(metadata): one generation-guarded cache instead of three copies (#2222) (@marmos91)
- 376cd1e: refactor(metadata): the postgres sub-stores speak the shared executor (#2250) (@marmos91)
- 2c5015c: refactor(postgres): one body per operation instead of a pool copy and a tx copy (#2226) (@marmos91)
- 282134e: test(block): the copy's RefCount bump reaches nothing — #2177 refuted, not fixed (#2190) (@marmos91)
- 059844c: test(dfsbench): capture the evidence a failed cold barrier needs (#2079) (@marmos91)
- dae34ba: test(metadata): pin that transaction writes roll back with their transaction (#2264) (@marmos91)
- 6d6996a: test(metadata): pin what the lock path does against an exhausted pool (#2256) (@marmos91)
- 44931b6: test(metadata): read the acquire bound instead of mirroring it (#2259) (@marmos91)
- bc45b2c: test(smbtorture): fail on an ungraded tail nobody signed off on, drop aio_delay (#2168) (@marmos91)
- 6e5191b: test(smbtorture): raise the budgets the truncation reporting has been pointing at, bound maxfid (#2111) (@marmos91)
- 95c0a30: test(smbtorture): re-measure seven now-passing rows on 15 draws, remove six (#2202) (@marmos91)
- 0c590d5: test(smbtorture): remove the rename_wait row, re-measured 10/10 across both filter conditions (#2187) (@marmos91)
- 9c9a455: test(smbtorture): remove the v2_complex1 row, correct rename_wait to intermittent (#2144) (@marmos91)
Full Changelog: v0.30.0...v0.31.0
Verifying Checksums
sha256sum -c checksums.txtVerifying Signatures
Release checksums are signed with Sigstore cosign using keyless OIDC:
cosign verify-blob \
--bundle checksums.txt.sigstore.json \
--certificate-oidc-issuer https://token.actions.githubusercontent.com \
--certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
checksums.txtDocker Images
Multi-architecture images are available for linux/amd64 and linux/arm64:
marmos91c/dittofs:v0.31.0- This specific versionmarmos91c/dittofs:latest- Latest stable releasemarmos91c/dittofs:v0- Latest v0.x.xmarmos91c/dittofs:v0.31- Latest v0.31.x