Skip to content

Releases

v0.3.0

Choose a tag to compare

@github-actions github-actions released this 09 Nov 02:09
0c287d9

Changelog

Features

  • Add CLI and MCP parity: seedfall trace grep and seedfall_trace_search, seedfall faults and seedfall_faults_edit with schedule checks against the config, seedfall findings with a status filter, and seedfall schema printing every command and MCP tool as JSON
  • Add a generic mmap and flock shim for wasip1, host-backed shared mappings kept coherent with pwrite, the mmap_early_writeback fault, a seedfall init report naming the shim for each dependency, and the mmapwal example
  • Add a profile input to the GitHub Action
  • Add config extends, named profiles, -set overrides, fault presets, seeded node disks and files, and upgrade_to packages swapped in on restart
  • Add contributing, security, code of conduct and roadmap files, issue forms for bugs, new systems and false positives, a pull request template asking for the verify proof, CODEOWNERS, a docs index, a troubleshooting catalog keyed by the exact messages seedfall prints, and a FAQ, link them from the README, and regenerate llms.txt
  • Add disk faults: full disks, read and write errors, corrupted reads, lost and misdirected writes, crash corruption, bit rot and slow fsyncs
  • Add failure artifact folders, seedfall pin with pinned regressions replayed before every sweep, seedfalltest Pinned, Replay and Seeds, and report notify and issue commands with action inputs
  • Add feedback-guided exploration: seedfall explore with corpus, signals, function coverage, chained and single-stream branches in schedule files, run -until-novelty, throughput in summaries, reports and JSON, and -faults on shrink
  • Add jmsadair/raft and 3-node NATS cluster examples
  • Add liveness mode with a recovery phase, sim.Eventually, finally checks, and faults on the workload
  • Add numeric and grouped assertions with margins, sim.Event and Antithesis SendEvent, and a host-call determinism hash that names the first diverging call
  • Add one-way clogs, partition topologies, swizzles, connection resets, slow nodes and per-link latency
  • Add pct and calls preemption strategies with change points recorded as preempt faults, preempt.loops loop-header counting so call-free loops are preempted and use virtual time, and the journal and busyloop examples
  • Add pluggable history checkers: cas, append, queue, set and counter models, Elle-style list-append isolation checking, JSONL history export and seedfall check
  • Add release automation with GoReleaser, install paths and an install script, seedfall version, help and doctor, a sweep progress line, run -timeout, a utilization report, and the build version in history entries and verify proofs
  • Add rename, truncate, network and monotonic clock mutants, mutate -only, and the seedfall_mutate and seedfall_findings MCP tools
  • Add run timelines and a trace explorer: timeline.html and timeline.mmd in every failure folder and embedded in the triage report, replay -html, -net-trace message tracing, seedfall logs, a seedfall debug time-travel prompt, seedfall trace diff, and the seedfall_logs and seedfall_debug MCP tools
  • Add sim.Buggify sites and seeded sim.Random choices as replayable faults
  • Add source mutants: mutate -app rebuilds node packages with flipped comparisons, skipped error returns and skipped Sync calls, and verify -app-mutants adds them to the proof
  • Add the AI-written key-value store study
  • Add verify, inspect, run -json and failure classification; nutsdb, bitcask, diskv and Gostman examples

Fixes

  • Fix CI: unused pages value, busyloop spin lint, symlinked init dirs, quoted replay paths, and a toolchain-dependent preempt test
  • Fix CLI review findings: check schedule seeds, harden the hook and gh calls, validate flags, surface swallowed errors
  • Fix disk fault review findings: UTF-8 report template, crash damage only for surviving files, bit rot under pending writes, and accurate inspect docs
  • Fix review findings in report, verify, sim and seedfalltest: fail on unreadable history lines, reject unsupported networks and empty RandomChoice, close the test runner, share percent and filter helpers, and keep report lists non-null
  • Fix review findings in scripts, action and workflows
  • Fix the MCP and CLI parity review findings: accept a timed fault at the end of the run and a disk-op fault recorded after it, drop shrink metadata from an edited schedule, describe when seedfall_faults_edit writes without edits, and keep regress.sh printf formats on one line
  • Fix the UDP review findings: reseed the udp stream on a branch, refuse a connected socket's datagrams to an unbound port so unknown host lookups fail at once, keep the sender's socket id and trace lane on every datagram line, name the connected-socket loss, show udp rates in the report, cover udp faults in the shift docs and schema, and check EPIPE and refusals in netcompat
  • Fix the exploration review findings: keep shifted faults valid inside the horizon, count unreadable corpus entries as stale, stop treating unopened crash windows as active, only re-key streams a scheduled run reads, report a failure stop over a plateau, remove dead code, cover re-rolled children of recorded schedules and scheduled report findings, and state what the docs have not verified
  • Fix the file system fidelity review findings: make fsync persist dirty mapped pages while a ranged msync stays ranged, show a new mapping other mappings' writes, clear mappings past a truncation, refuse O_EXCL through a symlink and an empty symlink target, refresh day-old access times, release flock when the holder closes, key mapped page fates on the branch seed, read the build constraint header from the parser, follow renamed unix imports, cover init's shim report and the syscall overlay in a real guest, and document the shim limits
  • Fix the preemption review findings: encode the PCT bound's middle dot as UTF-8, test that pct change points fire at their counted call across sleeps and time-slice parks, derive the spin test's iterations from the time slice, and document the schedule form of a preempt fault and how interleave overrides strategy none
  • Fix the release review findings: replace the deprecated brews config that fails goreleaser check with a cask, keep prereleases off the tap and latest image, let the Docker image read a mounted repository, replace the installed binary atomically, make utilization batches even and stop calling a barely quiet sweep finished, refuse a negative MCP timeout, accept development Go toolchains in doctor, remove dead stop handling, and correct what the install and verify docs claim
  • Fix the timeline review findings: list data sent before accept in debug net, drop the next fault once a run is over, reject a negative seedfall_logs limit, keep the report template UTF-8, put trace diff's -context before its paths, and stop claiming trace diff is an MCP tool

Other

  • Bring the landing page up to date with every command and MCP tool, render the comparison from sourced compare.json, add site-check.sh, and show each finding's upstream link and status
  • Bump actions/attest-build-provenance from 2.4.0 to 4.2.2 (#5)
  • Bump actions/cache/restore from 4.3.0 to 6.1.0 (#3)
  • Bump actions/setup-go from 5.6.0 to 7.0.0 (#6)
  • Bump anchore/sbom-action/download-syft from 0.24.0 to 0.24.3 (#7)
  • Bump docker/login-action from 3.7.0 to 4.8.0 (#1)
  • Bump docker/setup-buildx-action from 3.12.0 to 4.4.1 (#2)
  • Bump goreleaser/goreleaser-action from 6.4.0 to 7.3.0 (#4)
  • Check linearizability without a wall-clock timeout
  • Deploy site from Git
  • Describe link and mapping host calls in the determinism docs and name the shim report in the MCP tool description
  • Document config layers, presets, seeded disks and upgrades, scaffold starter profiles in init, and show the fault preset in triage reports
  • Document the preemption and frozen-clock limitations
  • Document where real time goes and how fast heavy guests run
  • Fail a workload that exits with an error under supervise instead of restarting it, and note Eventually panics outside the simulator in the properties skill
  • Finish the GitHub Action v2: show the comment Markdown in the job summary with the output folded below, report a config that cannot run or a failing mutate baseline in the summary and comment with the last lines of output, link the workflow run from every comment body, and add report github -md
  • Fold example config variants into profiles and extends overlays, and add an upgrade example that starts from a seeded v1 disk and restarts into v2
  • Give up on a linearizability check after 30 seconds instead of hanging the sweep, only build the timeline for a violation, and skip hidden directories when loading example configs
  • Interactive three-step demo, project logos on the bugs list, a GitHub star button, and one Gostman section styled with the rest of the page
  • Keep -set runs from overwriting base pins and artifacts, reject a disk that is not a directory, find report history past -set values, print inspect -out disk paths relative to the config, and pin the upgrade example's torn migration schedule
  • Keep recorded runtime faults out of the step loop so replays match the original run
  • Keep the compile cache bounded to the 8 most recently used builds
  • Link filed nutsdb and diskv issues; confine inspect export and MCP verify writes
  • Make seedfall agent-native: init, skills, plugin and llms.txt
  • Make shrink keep the same failure
  • Make the shrink time budget test independent of clock resolution
  • Merge branch 'ai-native' into merge-limits
  • Merge branch 'engine-preempt' into merge-limits
  • Merge branch 'engine-reorder' into merge-limits
  • Merge branch 'engine-speed' into merge-limits
  • Merge branch 'engine-wasicompat' into merge-limits
  • Merge branch 'fix-cmd' into gaps
  • Merge branch 'fix-engine' into gaps
  • Merge branch 'fix-report' into gaps
  • Merge branch 'gaps-community' into gaps
  • Merge branch 'main' into gaps
  • Model hard links, symlinks, Lstat and store...
Read more

seedfall v0.2.0

Choose a tag to compare

@kunalgoesbyken kunalgoesbyken released this 07 Nov 16:01

Deterministic simulation testing for unmodified Go programs. Your nodes run as WebAssembly under a seeded scheduler with a virtual clock, simulated disk and simulated network, so every failing seed replays exactly.

Install

go install github.com/kunalgoesbyken/seedfall/cmd/seedfall@v0.2.0

or download a binary below (Linux, macOS, Windows; amd64 and arm64).

What's in this release

  • Faults: crashes, partitions, torn writes, crash-on-IO, fsync EIO (fsyncgate semantics), process pauses, clock skew and clock jumps, and swarm mode (a random fault mix per seed).
  • Properties: Always, Sometimes, Reachable, Unreachable, AlwaysOrUnreachable, found in your source so a check that never runs fails the sweep. QuietFor and SetupComplete for liveness.
  • Antithesis SDK compatibility: code using antithesis-sdk-go/assert runs unchanged.
  • seedfall cause: branches a failing run at many moments to show when the failure became inevitable.
  • seedfall mutate: weakens fsync, directory fsync and O_SYNC to check your workload notices.
  • Triage reports: run -report with findings tracked across runs (new, ongoing, resolved, regressed).
  • Zero-code networking: net_overlay runs plain net and net/http on the simulated network.
  • Agents and CI: an MCP server (seedfall mcp) and a GitHub Action (kunalgoesbyken/seedfall@v0.2.0).

Bugs found with it

NATS JetStream, rosedblabs/wal, tidwall/buntdb, tidwall/wal and hashicorp/raft. Details and one-command replays are in docs/findings.