Repository navigation
v0.32.0
·
748 commits
to develop
since this release
DittoFS v0.32.0
A modular virtual filesystem that decouples file interfaces from storage backends.
Installation
Quick install (macOS / Linux):
curl -fsSL https://github.com/marmos91/dittofs/releases/download/v0.32.0/install.sh | shHomebrew (macOS/Linux):
brew tap marmos91/tap
brew install marmos91/tap/dfs # Server daemon
brew install marmos91/tap/dfsctl # Client CLIDebian/Ubuntu (APT):
curl -fsSL https://s3.cubbit.eu/dittofs-binaries/apt/dittofs.gpg.key | gpg --dearmor --yes | sudo tee /usr/share/keyrings/dittofs.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/dittofs.gpg] https://s3.cubbit.eu/dittofs-binaries/apt stable main" | sudo tee /etc/apt/sources.list.d/dfs.list
sudo apt update && sudo apt install dfs
sudo systemctl enable --now dfsRHEL/Fedora (YUM):
sudo curl -fsSLo /etc/yum.repos.d/dfs.repo https://s3.cubbit.eu/dittofs-binaries/rpm/dfs.repo
sudo yum install dfs
sudo systemctl enable --now dfsArch Linux:
curl -fsSLO https://github.com/marmos91/dittofs/releases/download/v0.32.0/dfs_0.32.0_amd64.pkg.tar.zst
sudo pacman -U dfs_0.32.0_amd64.pkg.tar.zst
sudo systemctl enable --now dfsScoop (Windows):
scoop bucket add marmos91 https://github.com/marmos91/scoop-bucket
scoop install dfs # Server daemon
scoop install dfsctl # Client CLIDocker:
docker run -d \
-p 12049:12049 \
-p 12445:12445 \
-p 8080:8080 \
-v /path/to/config.yaml:/config/config.yaml:ro \
-v dittofs-data:/data \
marmos91c/dittofs:v0.32.0Binary Download:
# dfs (server daemon)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.32.0/dfs_0.32.0_Linux_x86_64.tar.gz | tar xz
# dfsctl (client CLI)
curl -sfL https://github.com/marmos91/dittofs/releases/download/v0.32.0/dfsctl_0.32.0_Linux_x86_64.tar.gz | tar xzChangelog
Features
- eed3469: feat(docker): ship the compose stack the install guide documents (#2616) (@marmos91)
- 0164002: feat(engine): sink upload semaphore, WithoutCancel reap, shutdown test port (@marmos91)
- 998254d: feat(journal): FlushAll drain, per-file closures, carver cut-cursor fix (@marmos91)
- f239a81: feat(journal): lane F engine closure, ported pins, carve retirement (@marmos91)
Bug Fixes
- 1744228: fix(api): answer 409 for a duplicate metadata store name (#2621) (@marmos91)
- 3f9c359: fix(api): evict the health checker under the name it was cached with (#2635) (@marmos91)
- fc3251e: fix(api): invalidate the adapter auth cache on user and group mutations (#2585) (@marmos91)
- 0d5d4cf: fix(auxsvc): start aux services outside the group lock (#2540) (@marmos91)
- 3ead6d4: fix(block-store): count share references by name as well as UUID, and refuse a taken rename before writing (#2612) (@marmos91)
- 3893a39: fix(controlplane): drain API handlers before store close (#2722) (@marmos91)
- 8996031: fix(controlplane): normalize user-route share keys and reproject the root ACL on an id change (#2723) (@marmos91)
- 42e952d: fix(controlplane): project the share root ACL on the grant write, not at each HTTP call site (#2679) (@marmos91)
- c411e22: fix(dfs): name the release that can still migrate a pre-journal share (#2563) (@marmos91)
- c49f4d7: fix(docs): describe the single block store and journal consistently (#2607) (@marmos91)
- 986d828: fix(e2e): make the MinIO availability guard verify the image is obtainable (#2715) (@marmos91)
- 9485651: fix(engine): copilot panel findings (@marmos91)
- 4fa692c: fix(engine): local-only flush populates manifest, matching carve semantics (@marmos91)
- 01b84fd: fix(engine): the upload window never engaged (#2556) (@marmos91)
- a708809: fix(engine): unhealthy remote is the soft condition, matching carve acks (@marmos91)
- 7849328: fix(journal): verify warm reads unless a caller opts out (#2572) (@marmos91)
- e5a87de: fix(lock): recall an NFSv4 delegation on the SMB lock path instead of denying (#2756) (@marmos91)
- b01d10e: fix(metadata): cross-share LINK/RENAME reports one code across protocols (#2536) (@marmos91)
- c66a38f: fix(metadata): preserve DOS attribute bits across an absolute Mode write (#2752) (@marmos91)
- cd256ba: fix(metadata): run postgres transactions at REPEATABLE READ, and write the row the transaction read (#2707) (@marmos91)
- 7bfb2c2: fix(metadata): write back the attribute columns SetFileAttributes was asked for, not the ones that differ from its pre-read (#2711) (@marmos91)
- 6a9240e: fix(netlogon): retry a transient connect failure so hot-reload is transparent (#2732) (@marmos91)
- 4f66683: fix(nfs): advertise only the auth flavors a share accepts (#2578) (@marmos91)
- 13c6139: fix(nfs): apply a register-with-system flip that lands mid-transition (#2662) (@marmos91)
- 83f0b08: fix(nfs): bound the callback AUTH_SYS credential to its RFC 5531 limits (#2724) (@marmos91)
- 3d7cb7f: fix(nfs): cap RPC and MOUNT decodes at the bytes the peer delivered (#2552) (@marmos91)
- b8abc53: fix(nfs): deliver a Kerberos principal's SID and group SIDs to NFS ACL evaluation (#2747) (@marmos91)
- 122cc04: fix(nfs): deny an RPCSEC_GSS credential that was never verified (#2575) (@marmos91)
- bff40e9: fix(nfs): dereference the sidecar config bools under configMu (#2565) (@marmos91)
- 77682e5: fix(nfs): enforce the export auth-flavor policy on every NFSv3 operation (#2584) (@marmos91)
- 6ae6e59: fix(nfs): fail closed when share-permission resolution errors (#2574) (@marmos91)
- 7069013: fix(nfs): gate both share-handle entry points on the export policy (#2403) (#2681) (@marmos91)
- 4e51ad5: fix(nfs): gate the four state-only ops on the export auth policy (#2721) (@marmos91)
- b2b010b: fix(nfs): grant and recall NFSv4.1 delegations over a shared connection (#2598) (@marmos91)
- 55861c2: fix(nfs): guard sidecar config fields across settings-apply paths (#2549) (@marmos91)
- e9287d6: fix(nfs): keep the GSS context LRU within a principal, and touch it only after the MIC (#2716) (@marmos91)
- 9604b5d: fix(nfs): krb5p EC integrity, GSS ticket-bound context lifetime, UDP shutdown wait (#2405) (#2686) (@marmos91)
- dc988ae: fix(nfs): notify dir delegations on create, remove, rename, link (#2537) (@marmos91)
- 4064a4b: fix(nfs): push export policy changes into the running share (#2582) (@marmos91)
- e2f09cc: fix(nfs): recall an NFSv4 delegation before foreign I/O, and complete the reclaim (#2746) (@marmos91)
- fbe525c: fix(nfs): refuse a persisted require_kerberos when Kerberos is decommissioned (#2594) (@marmos91)
- 531e002: fix(nfs): refuse an export that would accept no auth flavor (#2639) (@marmos91)
- 4e603ab: fix(nfs): release callback state by binding direction, and walk past two candidates (#2727) (@marmos91)
- bbbeaf4: fix(nfs): release callback waiters by session, not only by connection (#2650) (#2742) (@marmos91)
- ba5a388: fix(nfs): return NFS4ERR_DELAY when a v4.1 session is at its connection limit (#2590) (@marmos91)
- a105464: fix(nfs): scope UMNT to one export and UMNTALL to the calling client (#2583) (@marmos91)
- d8ac11f: fix(nfs): seek answers the file type, not a blanket ISDIR (#2538) (@marmos91)
- 33b681f: fix(nfs): serialise system-rpcbind registration against shutdown (#2696) (#2718) (@marmos91)
- d9a1032: fix(nfs): start the v4.1 recall watchdog at dequeue, bound the queue wait separately (#2728) (@marmos91)
- 03fbb51: fix(nfs): sync sidecar shutdown state outside the group lock (#2547) (@marmos91)
- 9486794: fix(nfs): validate the v4.0 lock-owner seqid of zero (#2541) (@marmos91)
- 04da056: fix(nfsv3): SETATTR block reclaim on partial failure, stale-handle status, write verifier resolution (#2683) (@marmos91)
- 24eb879: fix(nfsv4): index the v4.1 owner map with the conversion inline (#2596) (@marmos91)
- 06a6f26: fix(nfsv4): write the client-recovery row when a client takes state, and retire it at grace end (#2689) (@marmos91)
- 8da6b69: fix(nlm): authorize byte-range locks, dedup retransmits, and own the NLM/NSM background work (#2690) (@marmos91)
- 05231c1: fix(nlm): guard the whole blocking waiter, not just its cancelled flag (#2719) (@marmos91)
- 14038b0: fix(operator): name the password key and the admin default (#2772) (@marmos91)
- e508f65: fix(operator): point the journal at the content volume the pod mounts (#2613) (@marmos91)
- 0896ee1: fix(shares): decide journal-root containment by relative path (#2609) (@marmos91)
- 77932b5: fix(shares): fold a share name to one spelling at the AddShare seam (#2615) (@marmos91)
- 46a9de3: fix(shares): refuse a pre-journal share instead of mounting it empty (#2557) (@marmos91)
- 651dc77: fix(shares): stop decoding a share name on the runtime path (#2659) (@marmos91)
- d4535ad: fix(smb): ACE size guard, IS_FSCTL gate, VNEG MaxOutputResponse floor (#2525) (@marmos91)
- c569186: fix(smb): SET_INFO/WRITE access gates, PositionInfo locking, EA write path (#2526) (@marmos91)
- f0aeec5: fix(smb): admit SESSION_SETUP under the lock LOGOFF takes (#2735) (@marmos91)
- db01e34: fix(smb): carry a frozen timestamp across a durable-handle reconnect (#2693) (#2733) (@marmos91)
- 58ae43b: fix(smb): carry a placeholder's owner across symlink conversion (#2750) (@marmos91)
- 067babf: fix(smb): close the five rows left open by tranches #2516/#2517/#2518 (#2664) (@marmos91)
- a751af2: fix(smb): compound signature classes, per-sub-command credits, dialect gate (#2524) (@marmos91)
- 97ef47d: fix(smb): fail closed on session-id squatting, encryption bypass, and unscoped durable failover (#2523) (@marmos91)
- aa86e5d: fix(smb): gate the AppInstanceId failover on client identity (#2622) (@marmos91)
- 7af43aa: fix(smb): hold a frozen ChangeTime across the access-time bump (#2626) (@marmos91)
- fcd71f6: fix(smb): judge AppInstanceId failover by the session's current connection (#2743) (@marmos91)
- 392ed7e: fix(smb): make the oplock break timeout setting effective (#2703) (@marmos91)
- 555476b: fix(smb): re-apply the session-id, durable-failover and SET_INFO/WRITE gates reverted by 83e532d (#2599) (@marmos91)
- dc40a10: fix(smb): re-check authorization on established sessions and trees (#2589) (@marmos91)
- 7122d17: fix(smb): read session identity under lock and refresh it on the authorization re-check (#2666) (@marmos91)
- f76168d: fix(smb): refuse unencrypted null/guest traffic on an encryption-required share (#2714) (@marmos91)
- 2f0c621: fix(smb): retire a cancelled bind's preauth hash, and serialize durable reconnect against the failover (#2736) (@marmos91)
- 0843768: fix(smb): route the explicit CLOSE path through OpenFile.Handle (#2729) (@marmos91)
- eca48bc: fix(smb): stop six operations moving a frozen ChangeTime (#2682) (@marmos91)
- 2126946: fix(smb): stop the frozen-timestamp restore rolling back a peer (#2720) (@marmos91)
- 9372a05: fix(smb): update DOS attributes with mode masks, not a synthesized POSIX mode (#2737) (@marmos91)
- dc523d5: fix(smb): verify a client's mechListMIC with the client-to-server keys (#2680) (@marmos91)
- 1974392: fix(snapshot): say which drain NoVerify actually skips (#2620) (@marmos91)
- c0cc732: fix(start): close the control-plane store on the boot-guard and serving shutdown paths (#2731) (@marmos91)
- a93b237: fix(start): close the control-plane store when the serving process ends (#2629) (@marmos91)
- 0bb857d: fix(start): install the metrics handle before the goroutines that read it (#2646) (@marmos91)
- 74d2795: fix(store): stop retrying a transaction whose context is already cancelled (#2571) (@marmos91)
- a29bc2f: fix: raise auth invalidation from the mutation, sweep off the control-plane goroutine, and join the SMB adapter's goroutines (#2663) (@marmos91)
Others
- 131bfe0: NFSv4.1: gss_cb_handles4 decoding, negotiated reply sizes, and the per-client reclaim gate (#2688) (@marmos91)
- a558b0d: SMB: create-race lease break and compound park guard (#2528) (@marmos91)
- 44d4d70: SMB: harden the session-auth cluster (#2527) (@marmos91)
- 8c8c754: chore(ci): bump the actions group with 3 updates (#2758) (@dependabot[bot])
- 33178bd: chore(deps): bump go.opentelemetry.io/otel/sdk in /k8s/dittofs-operator (#2748) (@dependabot[bot])
- 90573bb: chore(deps): bump otlptrace and otlptracegrpc to 1.45.0 in /k8s/dittofs-operator (#2770) (@dependabot[bot])
- 7c14130: chore(deps): bump the go-dependencies group with 11 updates (#2759) (@dependabot[bot])
- 57e8125: chore(deps): bump the go-dependencies group with 6 updates (#2546) (@dependabot[bot])
- bd5873b: chore(deps): bump the operator-dependencies group (#2757) (@dependabot[bot])
- 75e0029: chore(metadata): retire the four ShareOptions fields nothing reads (#2773) (@marmos91)
- a39fbd1: chore(release): v0.32.0 (@marmos91)
- 78b5d42: ci(integration): run only the integration-tagged packages (#2654) (@marmos91)
- c6ac4d6: ci(lint): fold ten lint jobs into three (#2647) (@marmos91)
- 2f0b099: ci(nix): stop three dev-shell-only jobs pushing to the Actions cache (#2652) (@marmos91)
- 0d67234: ci(windows): cap test parallelism so the runner keeps its commit limit (#2601) (@marmos91)
- 754c0eb: ci: a new Go package arrives with a test (#2560) (@marmos91)
- 276b27b: ci: cut the PR fan-out and cap every job that can hang (#2643) (@marmos91)
- 221e993: ci: extend unit test timeout for race engine suite (@marmos91)
- 29cf485: ci: guard commit type against the diff and pin the tests that may not disappear (#2597) (@marmos91)
- 1c5032e: ci: read the latest develop verdict, and stop cancelling develop runs (#2698) (#2713) (@marmos91)
- b4c7970: ci: refuse a commit that credits an AI tool (#2706) (@marmos91)
- ac3435e: docs(ci): plan to cut PR wall-clock and make green mean mergeable (#2637) (@marmos91)
- b8c29a5: docs(engine): record why the no-remote branches must not be collapsed (#2768) (@marmos91)
- aaf5d2d: docs(planning): Wave 7 perf-lens entry plan (#2776) (@marmos91)
- 3aafe11: docs(planning): fix-wave 1 A/C landed, B/D finish runs (@marmos91)
- 82d1048: docs(planning): fix-wave 1 all four lanes landed (@marmos91)
- 75fe84d: docs(planning): fix-wave 1 lane C landed, A resumed (@marmos91)
- e6b1f76: docs(planning): post-wave-5 follow-ups all landed (@marmos91)
- ad661b8: docs(planning): step 3 fanned as six lanes, H and C in flight (@marmos91)
- 61b4f12: docs(planning): step 4 legacy cleanup receipt (@marmos91)
- 281cd1a: docs(planning): triage the NFS MED tranches against current develop (#2553) (@marmos91)
- 7e0e424: docs(planning): wave 4 complete, both fix waves landed (@marmos91)
- 83e532d: docs(planning): wave 4 fix-wave 1 landed (@marmos91)
- cc24ac5: docs(planning): wave 4 fix-wave 1 merge state, source naming rule (@marmos91)
- 07c53d7: docs(planning): wave 4 fix-wave 1 recovery state (@marmos91)
- dc7d4a6: docs(planning): wave 4 fix-wave 2 CI failures fixed, advisory MIC (@marmos91)
- f255b1d: docs(planning): wave 4 fix-wave 2 CI failures, B guard dropped (@marmos91)
- 32121e4: docs(planning): wave 4 fix-wave 2 PRs opened with review fixes (@marmos91)
- 920d16b: docs(planning): wave 4 fix-wave 2 lane A landed, lane B finishing (@marmos91)
- 1097a53: docs(planning): wave 4 fix-wave 2 lane prompts (@marmos91)
- 3afd838: docs(planning): wave 4 fix-wave 2 lane prompts (@marmos91)
- 89f9b31: docs(planning): wave 5 fanned as four move-only split PRs (@marmos91)
- 3d598ac: docs(planning): wave 5 landed, four move-only splits merged (@marmos91)
- 57a3d67: docs(planning): wave 8 plan, cross-cutting queue + perf lens (@marmos91)
- ec48a8d: docs(planning): wave 8 step-1 lanes landed green (@marmos91)
- d097658: docs(readme): list Active Directory support in the feature matrix (#2568) (@marmos91)
- 24279cb: docs(rfc): reflect landed lanes, stop formatter mangling issue refs (@marmos91)
- eb8e002: docs(skills): stop solve-issues agents waiting on CI and read Copilot early (#2630) (@marmos91)
- a300172: docs(smb): correct the AppInstanceId failover contract on ProcessAppInstanceId (#2655) (#2730) (@marmos91)
- dddc646: fix(nfs,postgres): bound a leaked DRC reservation; stop hand-parsing the postgres test DSN (#2687) (@marmos91)
- 5da8b2a: nfs: move mount dispatch into the mount package (#2534) (@marmos91)
- 2246eed: refactor(adapter): drop dead auth surface and simplify base lifecycle (#2700) (@marmos91)
- 47ea0fa: refactor(adapter): rename auxsvc to sidecar (#2751) (@marmos91)
- dd9aee6: refactor(auth): add pkg/auth Translator and route AUTH_UNIX through it (#2710) (@marmos91)
- fc68056: refactor(auth): delete the dead auth provider chain and duplicate nobody helper (#2704) (@marmos91)
- 132a3d1: refactor(block): delete pkg/block/local/fs, hold journal.Store directly (@marmos91)
- e06074b: refactor(engine): drop dead carveTargetsWired, fix local-only Flush docs (@marmos91)
- 7a95969: refactor(journal): retire carve path, move seam survivors into flush.go (@marmos91)
- ac1563a: refactor(journal): stand the package alone on stdlib + x/sys (#2559) (@marmos91)
- 9025a0a: refactor(logger): delete the request-scoped LogContext machinery (#2755) (@marmos91)
- 7ccc379: refactor(metadata): delete the dead share-level squash and IP-ACL path (#2741) (@marmos91)
- 41b45eb: refactor(nfs): give NFSv3 its own dispatch package and delete the dead router (#2567) (@marmos91)
- 84deeb6: refactor(nfs): split the connection glue and put the DRC protocol behind one wrapper (#2569) (@marmos91)
- 7d48ee7: refactor(nfs): split the state manager god file by concern (#2529) (@marmos91)
- 0850997: refactor(shares): one block store, one journal, no kind (#2579) (@marmos91)
- 21ad9e6: refactor(smb): converge the replay caches on the duplicate-request cache vocabulary (#2573) (@marmos91)
- 0d3a63b: refactor(smb): drop the write-only Session.credits.LastActivity field (#2712) (@marmos91)
- c2e2a6a: refactor(smb): extract the change-notify registry into its own package (#2760) (@marmos91)
- 398ed53: refactor(smb): split create by replay, path resolution, and completion (#2531) (@marmos91)
- 99c8943: refactor(smb): split set-info by info class, security, and lease breaks (#2530) (@marmos91)
- 3c4a5e6: refactor(smb): split the handler god file by state concern (#2532) (@marmos91)
- d06862d: refactor(smb): stand the pending registries and replay caches alone (#2562) (@marmos91)
- 7ca9315: refactor: carve FastCDC carver out journal (@marmos91)
- 28b6f19: refactor: delete dead callback codecs, error shims and Printer methods (#2745) (@marmos91)
- bd5b681: refactor: journal hygiene sweep (#2535) (@marmos91)
- 3b25bb1: refactor: the record-residency state as the index's shape (@marmos91)
- 1685aad: test(ad-dc): isolate each fixture container and bound every docker exec (#2726) (@marmos91)
- 939367b: test(block): restore the reap-span property lane F dropped (#2558) (@marmos91)
- fcf5e32: test(conformance): read a missing verdict as ungraded only where one is written (#2695) (@marmos91)
- 6c7b5bd: test(journal): count chunk boundaries directly in params test (@marmos91)
- e963e87: test(lock): probe cross-protocol mandatory locking at the shared manager (#2734) (@marmos91)
- ca97855: test(runtime): release the scheduler tick before the join deadline, not on it (#2744) (@marmos91)
- 53bd0a5: test(smb): account for manifest-populating transactions in write-through delta (@marmos91)
- 2a3e54c: test(smb): admit one conformance run per host with a lease, not only per checkout (#2697) (@marmos91)
- 1773e8c: test(smb): isolate the conformance stack per checkout and grade its own run (#2628) (@marmos91)
- e6a93fe: test(smb): seed FSCTL-managed bits through the mode mask (#2753) (@marmos91)
Full Changelog: v0.31.1...v0.32.0
Verifying Checksums
sha256sum -c checksums.txtVerifying Signatures
Release checksums are signed with Sigstore cosign using keyless OIDC:
cosign verify-blob \
--bundle checksums.txt.sigstore.json \
--certificate-oidc-issuer https://token.actions.githubusercontent.com \
--certificate-identity-regexp '^https://github\.com/marmos91/dittofs/\.github/workflows/release\.yml@refs/tags/' \
checksums.txtDocker Images
Multi-architecture images are available for linux/amd64 and linux/arm64:
marmos91c/dittofs:v0.32.0- This specific versionmarmos91c/dittofs:latest- Latest stable releasemarmos91c/dittofs:v0- Latest v0.x.xmarmos91c/dittofs:v0.32- Latest v0.32.x