Repository navigation
v0.31.1
·
933 commits
to develop
since this release
DittoFS v0.31.1
A modular virtual filesystem that decouples file interfaces from storage backends.
Installation
Quick install (macOS / Linux):
curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.31.1/install.sh | shHomebrew (macOS/Linux):
brew tap marmos91/tap
brew install marmos91/tap/dfs # Server daemon
brew install marmos91/tap/dfsctl # Client CLIDebian/Ubuntu (APT):
curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfsRHEL/Fedora (YUM):
sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfsArch Linux:
curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.31.1/dfs_0.31.1_amd64.pkg.tar.zst
sudo pacman -U dfs_0.31.1_amd64.pkg.tar.zst
sudo systemctl enable --now dfsScoop (Windows):
scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs # Server daemon
scoop install dfsctl # Client CLIDocker:
docker run -d \
-p 12049:12049 \
-p 12445:12445 \
-p 8080:8080 \
-v /path/to/config.yaml:/config/config.yaml:ro \
-v dittofs-data:/data \
marmos91c/dittofs:v0.31.1Binary Download:
# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.31.1/dfs_0.31.1_Linux_x86_64.tar.gz | tar xz
# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.31.1/dfsctl_0.31.1_Linux_x86_64.tar.gz | tar xzChangelog
Features
- 02f2be1: feat(nfs): grant delegations to NFSv4.1 clients on a verified callback path (#2479) (@marmos91)
Bug Fixes
- ecdb4ed: fix(api): drop RealIP so the request log records an unforgeable address (#2291) (@marmos91)
- f793f27: fix(block): hold the retention pin in the local store so Start cannot lift it (#2302) (@marmos91)
- 4ac5071: fix(block): never evict bytes a share has no way to fetch back (#2376) (@marmos91)
- 29ffe1d: fix(block): route the carve block size to the loop that reads it (#2311) (@marmos91)
- 9314a04: fix(block): stop reporting a local-tier check that never ran (#2347) (@marmos91)
- 2406afb: fix(ci): analyse cold so a bumped go.sum cannot poison the lint cache (#2443) (@marmos91)
- 8b05dc1: fix(conformance): stop reporting a setup failure as new test failures (#2477) (@marmos91)
- 5454e4f: fix(deps): bump grpc to 1.83.1 in the operator module (#2411) (@marmos91)
- a2791f9: fix(journal): fail a restore whose shard can never be made durable (#2390) (@marmos91)
- d3172e6: fix(journal): fence a hydrate against the truncate marker's own version (#2386) (@marmos91)
- ad6162b: fix(journal): order unstamped segments by age, not ahead of everything (#2308) (@marmos91)
- 90a7b8d: fix(journal): record which writer made a cold entry, and stop restore guessing (#2478) (@marmos91)
- 58dc7c2: fix(journal): size the carve block arena to the share's own chunk ceiling (#2480) (@marmos91)
- bc58034: fix(lint): stop the citation check scanning nested working copies (#2267) (@marmos91)
- a02d55f: fix(metadata): make the xattr read-modify-write atomic (#2452) (@marmos91)
- 111192f: fix(metadata): persist the create verifier on SQL backends, and rename the row the transaction read (#2379) (@marmos91)
- 9f35691: fix(metadata): release a file's bytes from the share usage counters when its last link goes (#2288) (@marmos91)
- cde7dd9: fix(metadata): rename over an existing file never freed the clobbered file's bytes (#2309) (@marmos91)
- 2a3b305: fix(nfs): DESTROY_CLIENTID must not gate on the requester's client ID, and must report an unrecognized target first (#2489) (@marmos91)
- 1d69f4d: fix(nfs): bind NFSv4 stateids to their owning client and make the stateid other unpredictable (#2448) (@marmos91)
- 48671a2: fix(nfs): call the cross-protocol lock manager without holding the global state mutex (#2459) (@marmos91)
- 47a439e: fix(nfs): check read permission in NFSv4 READ, READ_PLUS and SEEK (#2427) (@marmos91)
- 5f05f50: fix(nfs): check the stateid belongs to the caller in CLOSE, LOCK, LOCKU, OPEN_DOWNGRADE, OPEN_CONFIRM and TEST_STATEID (#2466) (@marmos91)
- 1a478fc: fix(nfs): default max_version to 4.0 until full NFSv4.1 lands (@marmos91)
- 06cef31: fix(nfs): draw the server boot epoch at random instead of reading the clock (#2485) (@marmos91)
- c5dd09b: fix(nfs): enforce CREATE_SESSION channel-size floors, flag validation, and NOSPC session cap (#2471) (#2494) (@marmos91)
- 13931d0: fix(nfs): implement the EXCHANGE_ID flag validation and record algorithm of RFC 8881 18.35.4 (#2491) (@marmos91)
- f9ebda7: fix(nfs): key the RECLAIM_COMPLETE duplicate check on the client, not the grace period (#2486) (@marmos91)
- c810d03: fix(nfs): merge same-owner byte-range locks and keep one lease per client ID (#2361) (@marmos91)
- 1cee59f: fix(nfs): narrow the SECINFO flavor list to the target share's auth-flavor policy (#2460) (@marmos91)
- 2acb10d: fix(nfs): reject bad, old and stale stateids in CLOSE, OPEN_CONFIRM, OPEN_DOWNGRADE and LOCK (#2484) (@marmos91)
- a4b0ee9: fix(nfs): reject cross-share LINK — the v3 share check was a tautology (#2432) (@marmos91)
- 14fd86a: fix(nfs): return NFS4ERR_NOT_ONLY_OP when a session-exempt op shares its COMPOUND (#2481) (@marmos91)
- 321a443: fix(nfs3): narrow ACCESS replies to the request and drop DELETE for non-directories (#2273) (@marmos91)
- a8c8772: fix(nfs4): translate the all-ones lock length into the manager's end-of-file range (#2274) (@marmos91)
- 655f12b: fix(nfsv4): REMOVE never freed the removed file's payload bytes (#2286) (@marmos91)
- fc16cb0: fix(nfsv4): put space_avail/free/total at their RFC 7530 attribute numbers (#2458) (@marmos91)
- 2a6ac1b: fix(postgres): create the filesystem_meta table the share queries read (#2316) (@marmos91)
- b608506: fix(smb): answer a CHANGE_NOTIFY that registers after a directory is marked deleted (#2283) (@marmos91)
- 93c8116: fix(smb): authorize the parent-dir frozen-timestamp restore by the frozen handle's grant (#2319) (@marmos91)
- 99d2203: fix(smb): bind a client-supplied FileId to the session that opened it (#2461) (@marmos91)
- 24846cb: fix(smb): correct the seven wrong spec citations and empty the allowlist (#2269) (@marmos91)
- ee3ab6a: fix(smb): don't announce a rename that a hard link made a no-op (#2387) (@marmos91)
- 923c40e: fix(smb): hardlink replace never freed the replaced file's bytes (#2318) (@marmos91)
- 63b1aa4: fix(smb): keep the ChangeTime a client observed across rename (#2284) (@marmos91)
- c77afc8: fix(smb): let FILE_WRITE_ATTRIBUTES authorize a timestamp write (#2313) (@marmos91)
- a39ec44: fix(smb): let rename's ChangeTime advance stand, and pin frozen timestamps across rename + CLOSE (#2279) (@marmos91)
- c5ba24c: fix(smb): make the rename ChangeTime preserve conditional (#2343) (@marmos91)
- 0bc01b3: fix(smb): scope async-flagged CANCEL lookups to the arriving connection (#2426) (@marmos91)
- 9295779: fix(smb): scope the tree lookup to the requesting session (#2424) (@marmos91)
- 3c22a38: fix(smbtorture): anchor the NT_STATUS_NO_MEMORY flake excuse to a connection diagnostic (#2272) (@marmos91)
- 025de21: fix(test): stop the known-failures parser reading fenced examples as rows (#2412) (@marmos91)
Performance Improvements
- a9a429e: perf(journal): read the file high-water mark off the interval tail (#2384) (@marmos91)
- 8212870: perf(metadata): let a directory listing skip the attributes nobody reads (#2292) (@marmos91)
Others
- 7e5cd2e: LOCK: reject special stateids on the exist path with NFS4ERR_BAD_STATEID (#2490) (#2498) (@marmos91)
- 5b4e3c1: Merge pull request #2510 from marmos91/fix/149-default-max-version (@marmos91)
- 25dbd71: Merge pull request #2519 from marmos91/release-v0.31.1 (@marmos91)
- 7d7033b: adapter: release the listener-ready channel on shutdown and bound the accept retry loop (#2502) (@marmos91)
- 64eb33e: build(nix): make the flake usable day to day (#2388) (@marmos91)
- b519507: build: untrack the generated Dockerfile.cross, unignore the real Dockerfile.prebuilt (#2271) (@marmos91)
- 899194c: chore(block): delete the dead hash-keyed CAS surface (#2422) (@marmos91)
- 0973be0: chore(block): remove the cas→blocks migration (#2305) (@marmos91)
- d4b8de5: chore(ci): bump the actions group with 13 updates (#2276) (@dependabot[bot])
- fa17370: chore(ci): bump the actions group with 2 updates (#2418) (@dependabot[bot])
- fc828b9: chore(ci): point dependabot at develop (#2289) (@marmos91)
- 65a04ff: chore(deps): bump github.com/olekukonko/tablewriter from 0.0.5 to 1.1.4 (#2278) (@dependabot[bot])
- 9641165: chore(deps): bump google.golang.org/grpc in /k8s/dittofs-operator (#2410) (@dependabot[bot])
- 00f719e: chore(deps): bump google.golang.org/grpc in /k8s/dittofs-operator (#2492) (@dependabot[bot])
- 0cc2e28: chore(deps): bump the go-dependencies group with 32 updates (#2277) (@dependabot[bot])
- 8aa32ed: chore(deps): bump the go-dependencies group with 9 updates (#2419) (@dependabot[bot])
- 71d56bc: chore(deps): bump the operator-dependencies group across 1 directory with 6 updates (#2416) (@dependabot[bot])
- fe1a155: chore(deps): bump the operator-dependencies group in /k8s/dittofs-operator with 8 updates (#2275) (@dependabot[bot])
- 8d4b84d: chore(pi): complete the migration from Claude Code to pi (#2493) (@marmos91)
- 0206d19: chore(release): v0.31.1 (@marmos91)
- b95da2d: ci(codeql): assert the operator was analysed, not archived (#2306) (@marmos91)
- d4b7902: ci(codeql): take the analyser toolchain from the operator go.mod (#2298) (@marmos91)
- a24a4ad: ci: retry the binaries download once after an artifact-service blip (#2447) (@marmos91)
- 0ecb4ce: ci: stop a lost diagnostics artifact from failing a passing suite (#2463) (@marmos91)
- 6ffc426: common: cover the full ErrorCode enum and drop the dead NFS lock columns (#2499) (@marmos91)
- 88c96fe: docs(audits): commit the NFS and SMB adapter audit reports (#2415) (@marmos91)
- 5ca935f: docs(block): name the split packages after what the tree already calls them (#2417) (@marmos91)
- d79a5c8: docs(internals): write the object-ownership rule into the architecture doc (#2468) (@marmos91)
- 9f4e89b: docs(nfs): document the write-session change-attribute freeze instead of unfreezing it (#2456) (@marmos91)
- b1dc5ec: docs(perf): correct what the block baseline says about block size (#2375) (@marmos91)
- 23de25e: docs(planning): Wave 2 closed — all five PRs merged, Wave 3 next (@marmos91)
- 8f8fd43: docs(planning): Wave 2 closed, Wave 3 premises verified (@marmos91)
- 776d5de: docs(planning): Wave 3 LANDED, Wave 3.5 NEXT (@marmos91)
- 2000978: docs(planning): Wave 3 PRs 2499-2504 open, merge babysitter running (@marmos91)
- 3784a24: docs(planning): Wave 3 branches pushed, review fan-out running (@marmos91)
- c6c5650: docs(planning): Wave 3 lane plan + memory update (@marmos91)
- 0a929bd: docs(planning): Wave 3 plan-validation corrections baked into relaunch (@marmos91)
- d9b0666: docs(planning): correct step 1's file list, a method cannot leave its package (#2444) (@marmos91)
- 9e7d6eb: docs(planning): fold wave3.5 statusfor extraction into roadmap (@marmos91)
- 1ce966e: docs(planning): program memory updated through Wave 2 closure (@marmos91)
- ac6c96b: docs(planning): program memory — Wave 3 fan-out running with corrections (@marmos91)
- 2c9ea79: docs(planning): program memory — Wave 3 landed, Wave 3.5 next (@marmos91)
- 7100030: docs(planning): record the wave 1 soundness audit and its residual gap (#2453) (@marmos91)
- a25731b: docs(planning): rewrite step 1's scope from what develop actually shows (#2428) (@marmos91)
- cfecb53: docs(planning): step 2 has no extraction to make, only the test (#2475) (@marmos91)
- 4c87a85: docs(planning): the adapter convergence master plan (#2420) (@marmos91)
- 2051f6f: docs(planning): wave 1 landed, and the CI traps it surfaced (#2450) (@marmos91)
- eda765c: docs(planning): wave 2 closure + Wave 3 premise verification (@marmos91)
- 6f086e1: docs(planning): wave 3.5 implemented, reviews running (@marmos91)
- f514f73: docs(planning): wave 3.5 landed, wave 4 next (@marmos91)
- b56297c: docs(planning): wave 3.5 lane prompts for fan-out (@marmos91)
- ff62090: docs(planning): wave 4 SMB triage re-derivation results (@marmos91)
- 001ac09: docs(planning): wave 4 fix-wave 1 fanned out (@marmos91)
- 39598ba: docs(planning): wave 4 fix-wave lane prompts (@marmos91)
- 41a64c8: docs(planning): wave 4 issues filed, tranches 2512-2518 (@marmos91)
- 15d3a50: docs(planning): wave 4 triage lane prompts (@marmos91)
- ffdb75c: docs(planning): wave 4 triaged, fix-wave ordering recorded (@marmos91)
- 829aee4: fix(nfs/v4): READDIR argument validation, and the account pynfs's second client never had (#2383) (@marmos91)
- d080dd8: fix(nfs/v4): client-record and lease validation, and courtesy-client state at the conflict (#2378) (@marmos91)
- 2a866d0: fix(nfs/v4): honour WRITE stability, and track the current stateid across a COMPOUND (#2380) (@marmos91)
- 6a7f0aa: fix(nfs/v4): object-type gates, OPEN seqid accounting, createattrs and share reservations (#2377) (@marmos91)
- 265b5cd: fix(nfs/v4): reject '.' and '..' components, and correct saved-FH and hard-link rename status (#2358) (@marmos91)
- 5fe8954: fix(nfs/v4): reject the attribute requests RFC 7530 requires refusing (#2363) (@marmos91)
- 35bac64: fix(nfs/v4): resolve the current-stateid placeholder in OPEN's CLAIM_DELEGATE_CUR (#2457) (@marmos91)
- 7086c4b: fix(nfs/v4): three NFSv4.0 conformance defects behind the RPLY failures (#2356) (@marmos91)
- 9fe2fd3: fix(nfs/v4): validate the SECINFO name, and implement SECINFO_NO_NAME (#2368) (@marmos91)
- d4febf1: fix(nfs/v4.1): enforce the session's negotiated COMPOUND limits (#2367) (@marmos91)
- 57be335: fix(test/e2e): build against the testcontainers v0.44 port API (#2301) (@marmos91)
- 7d045f4: fix(test/nfs): refuse to grade a pynfs run whose tests never executed (#2354) (@marmos91)
- 9c669f4: fix(test/posix): always rebuild the binaries the suite is about to run (#2360) (@marmos91)
- a4f479f: fold the v4.0 and v4.1 client indexes into one (#2482) (#2496) (@marmos91)
- 0a0e96c: nfs v4: route content-path failures through the shared content mapper (#2500) (@marmos91)
- 80331c4: pynfs harness: fail fast when the applied lease time doesn't match the request (#2464) (#2497) (@marmos91)
- b76b2dc: refactor(block): export the optional BlockSink capabilities and assert both sinks satisfy them (#2430) (@marmos91)
- 4ace553: refactor(block): extract the upload-window mechanism into pkg/block/syncer (#2438) (@marmos91)
- 9819896: refactor(engine): rename Syncer to RemoteSync, freeing the syncer name (#2431) (@marmos91)
- 23e057c: refactor(metadata): delete the CreateShare surface (#2344) (@marmos91)
- 7da673a: refactor(metadata): drop the unimplemented LockQuery.IsLease filter (#2315) (@marmos91)
- c38d63c: refactor(metadata): merge the five remaining sqlite/postgres pairs (#2425) (@marmos91)
- ac42e73: refactor(metadata): one block-record implementation over both SQL dialects (#2348) (@marmos91)
- 6b38641: refactor(metadata): one capability set for the SQL backends, and stop overstating timestamp precision (#2381) (@marmos91)
- 125102b: refactor(metadata): one durable-handle store for both SQL dialects (#2293) (@marmos91)
- 80fa298: refactor(metadata): one file-chunk object implementation over both SQL dialects (#2370) (@marmos91)
- d64c440: refactor(metadata): one file_block_refs implementation over both SQL dialects (#2365) (@marmos91)
- 40884ad: refactor(metadata): one lock store for both SQL dialects (#2303) (@marmos91)
- ef065d7: refactor(metadata): one root-directory body, and one meaning for it (#2312) (@marmos91)
- 9ff9618: refactor(metadata): one synced-hash implementation over both SQL dialects (#2373) (@marmos91)
- 0bd9414: refactor(metadata): share what putFile marshals, keep what the dialects decide (#2299) (@marmos91)
- 0078304: refactor(nfs): unify the v4.0 and v4.1 client records into one type (#2476) (@marmos91)
- 4f418ff: refactor: move all error mapping into the adapter types packages (#2505) (@marmos91)
- 8c48957: retry a failed reclaim-complete persist with backoff (#2487) (#2495) (@marmos91)
- cc4a586: smb: name the session-user UID/GID derivation for what it derives from (#2501) (@marmos91)
- c698184: smb: route async credit grants through the per-session grant path (#2503) (@marmos91)
- 1906959: test(block): one benchmark per journal state transition, and the recorded baseline (#2374) (@marmos91)
- fec645d: test(chunker): pin chunk boundaries to content, not to buffer length (#2474) (@marmos91)
- 2838384: test(conformance): refuse a port the harness does not own, and let a schedule reach its tier (#2392) (@marmos91)
- 563bf04: test(engine): prove the ordered carve flip against the production block sink (#2455) (@marmos91)
- 09d6034: test(metadata): pin commits-per-operation and give metabench a postgres cell (#2421) (@marmos91)
- 9fdfa96: test(nfs): run pynfs as an NFSv4 protocol conformance suite in CI (#2321) (@marmos91)
- b292721: test(pynfs): align DELEG26 reason, disclose walk-out evidence tier (#2507) (@marmos91)
- deb2d7b: test(pynfs): retire the OPEN4 row, and say what removing a row requires (#2409) (@marmos91)
- 75b45e9: test(pynfs): walk out v4.1 rows the Wave 2 fixes closed (#2506) (@marmos91)
- 65a2233: test(smb): make CLOSE observable on the handler fixtures (#2295) (@marmos91)
- eccc484: test(smbtorture): skip the create benchmark subtest and reap the one-off client container (#2282) (@marmos91)
- 042ee75: test(storetest): scope synced-hash fixtures to the run (#2385) (@marmos91)
Full Changelog: v0.31.0...v0.31.1
Verifying Checksums
sha256sum -c checksums.txtVerifying Signatures
Release checksums are signed with Sigstore cosign using keyless OIDC:
cosign verify-blob \
--bundle checksums.txt.sigstore.json \
--certificate-oidc-issuer https://token.actions.githubusercontent.com \
--certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
checksums.txtDocker Images
Multi-architecture images are available for linux/amd64 and linux/arm64:
marmos91c/dittofs:v0.31.1- This specific versionmarmos91c/dittofs:latest- Latest stable releasemarmos91c/dittofs:v0- Latest v0.x.xmarmos91c/dittofs:v0.31- Latest v0.31.x