FaultPack v1.6.0 — Regression corpus catalog

Changelog

All notable changes to FaultPack are documented here.

1.6.0 — Regression corpus catalog

Added

• Added faultpack catalog ROOT to recursively inventory nested FaultPacks as a deterministic regression corpus.
• Added passive verification and privacy preflight per pack, with JSON and Markdown outputs for CI and maintainer review.
• Added explicit aggregate counts for verified, invalid, and privacy-clean packs, plus safe per-pack error messages.
• Added contract tests for deterministic discovery, passive operation, valid/invalid mixtures, and Markdown rendering.

Safety and compatibility

• Cataloging never executes declared commands, follows pack-provided URLs, loads plugins, or mutates the corpus.
• Existing pack formats, commands, and exit semantics remain unchanged; only the package/CLI version advances to 1.6.0.
• Pytest coverage remains above 90%, with Ruff and mypy passing locally.

1.4.0 — Offline evidence viewer

Added

• Added faultpack inspect PACK --html --output report.html for a self-contained, dependency-free evidence report.
• The viewer displays the verified execution contract, source and producer metadata, selected input digests, and digest-first evidence timeline.
• Added a decision record documenting the flagship choice, competitive gap, scoring matrix, architecture, scope, and acceptance bar.

Quality and safety

• HTML inspection verifies the pack before rendering and refuses tampered manifests.
• Manifest-derived values are HTML-escaped; captured stdout/stderr are never embedded by passive inspection.
• The report has no network requests, external assets, JavaScript dependencies, subprocess execution, or implicit uploads.
• Added focused CLI tests for verified rendering, safe escaping, and tamper rejection. Pytest coverage remains above 90%, with Ruff, mypy, and wheel/sdist builds passing locally.

1.3.1 — Compatibility patch

Fixed

• Preserved legacy v0.1/v0.2 manifest fingerprints when the parser materializes optional v0.3 producer and event fields.
• Added a regression test covering enriched legacy manifests and verified the existing fixture workflow on GitHub Actions.

1.3.0 — Evidence interchange

Added

• Added optional Producer metadata for identifying the capture adapter without coupling the core verifier to a runtime.
• Added digest-first EvidenceEvent timeline contracts for tool calls, model responses, assertions, policy decisions, and annotations.
• Added faultpack evidence-diff LEFT RIGHT for offline semantic comparison without executing either declared command.
• Added stable event summaries and explicit volatile-field exclusions for evidence comparisons.
• Updated the public JSON Schema to support format 0.3 while preserving 0.1 and 0.2 parsing.

Quality and safety

• Event sequences must be strictly increasing and unique; payloads are represented by SHA-256 digests by default.
• Evidence diff verifies both packs before reading semantic fields and reports changes in machine-readable JSON.
• Added contract, privacy, CLI, and backward-compatibility tests; pytest coverage remains above 90%, with Ruff, mypy, JSON validation, and wheel/sdist builds passing locally.

1.2.0 — Privacy preflight

Added

• Added passive faultpack diagnose PACK for share-before-you-send privacy diagnostics.
• Added machine-readable findings for private keys, GitHub tokens, AWS access keys, bearer tokens, secret-like assignments, email addresses, and oversized textual evidence.
• Added --fail-on-findings with exit code 6 for CI privacy gates.
• Added flagship strategy documentation explaining the product decision, competitive rationale, scoring model, and architecture boundaries.

Quality

• Added focused diagnostics and CLI tests while preserving the 90% coverage gate.
• Added the diagnostic command to the fixture GitHub Actions workflow.
• Ruff, mypy, pytest, and wheel/sdist builds pass locally.

1.1.0 — Replay matrix

Added

• Added typed MatrixProfile and MatrixResult contracts with strict profile names, safe environment keys, optional tokenized argv overrides, and bounded timeout narrowing.
• Added faultpack matrix PACK --profiles profiles.json for ordered, isolated, local replay across multiple profiles.
• Added aggregate JSON output plus Markdown, SARIF, and JUnit matrix reports.
• Added matrix support to the composite GitHub Action through the optional profiles input.
• Added deterministic matrix fixtures and focused tests for success, mismatch, duplicate profiles, unsafe policy, and execution errors.
• Added docs/architecture-v1.1.md and examples/profiles.json.

Compatibility and safety

• Existing v0.1/v0.2 pack formats and commands remain readable and unchanged.
• Matrix execution never mutates the source pack and does not invoke a shell for argv overrides.
• Profile timeouts may narrow but never expand the pack timeout.
• FaultPack remains local-first, passive during verification, and explicit that replay is not a sandbox.

[1.0.0] — 2026-08-25

Added

• Production-oriented flagship release for the portable failure evidence workflow.
• Optional Ed25519 key generation and detached fingerprint signatures through the signing extra.
• Explicit public-key verification with no trust-root discovery or network access.
• diff command for replaying and comparing two verified packs with stable JSON output.
• bundle command for verified deterministic ZIP export.
• Stable JSON output for capture, verification, differential replay, and bundle commands.
• v1.0 product and architecture design covering data flow, error semantics, security, performance, and extension boundaries.
• Rewritten README focused on the product problem, adoption path, security boundary, and Open Source contribution model.

Quality

• Added focused tests for Ed25519 signing, tamper rejection, differential behavior, bundle generation, CLI contracts, and exit codes.
• Preserved v0.1/v0.2 pack parsing and legacy HMAC verification behavior.
• Ruff, mypy, pytest with coverage gate, git diff --check, and wheel/sdist builds pass locally.

[0.2.0] — 2026-08-25

Added

• Versioned v0.2 manifest with backward parsing support for v0.1.
• Safe input-file capture with relative paths and SHA-256 evidence.
• Minimal child environment with explicit --env allowlist.
• Optional HMAC signing through FAULTPACK_SIGNING_KEY and --require-signature verification.
• Stable v0.2 fingerprints that exclude volatile pack ID and measured duration.
• Temporary-workspace replay with output regex/hash and duration predicates.
• Bounded line-oriented reduce command that preserves a non-passing oracle.
• Fixture-driven end-to-end example under fixtures/.
• Security model, threat boundary, architecture, and schema documentation.

Quality

• Expanded unit, CLI, integrity, redaction, replay, and reducer tests.
• Coverage gate raised to 90%.
• Ruff and mypy pass on the source tree.
• Wheel and source distribution build successfully.

[0.1.0] — 2026-08-24

Added

• Versioned faultpack.json manifest contract.
• Privacy-first capture with secret, email, IP, and custom-pattern redaction.
• Deterministic manifest fingerprints and ZIP pack writer.
• Safe relative-path and symlink checks.
• CLI commands: capture, inspect, verify, replay, and version.
• Markdown, SARIF, and JUnit replay reports.
• GitHub Actions quality matrix for Python 3.10–3.13.
• Unit and integration tests with a coverage gate above 85%.

FaultPack v1.5.0

Highlights

• Add faultpack issue to generate metadata-only GitHub issue bodies from verified packs.
• Run passive privacy preflight before issue generation, with optional --fail-on-findings CI gating.
• Include fingerprints, command contracts, input digests, evidence-event names, and maintainer safety checklist without embedding captured stdout/stderr.
• Add integration and branch-coverage tests; keep Ruff, mypy, pytest, and package builds green.

Verification

• 40 tests passed
• 91.24% coverage
• Ruff clean
• mypy clean
• wheel and sdist build successfully

FaultPack v1.4.0 — Offline evidence viewer

1.4.0 — Offline evidence viewer

Added

• Added faultpack inspect PACK --html --output report.html for a self-contained, dependency-free evidence report.
• The viewer displays the verified execution contract, source and producer metadata, selected input digests, and digest-first evidence timeline.
• Added a decision record documenting the flagship choice, competitive gap, scoring matrix, architecture, scope, and acceptance bar.

Quality and safety

• HTML inspection verifies the pack before rendering and refuses tampered manifests.
• Manifest-derived values are HTML-escaped; captured stdout/stderr are never embedded by passive inspection.
• The report has no network requests, external assets, JavaScript dependencies, subprocess execution, or implicit uploads.
• Added focused CLI tests for verified rendering, safe escaping, and tamper rejection. Pytest coverage remains above 90%, with Ruff, mypy, and wheel/sdist builds passing locally.

FaultPack v1.3.1 — Compatibility patch

Highlights

• Added optional producer metadata and digest-first EvidenceEvent timelines for AI-agent and tool runs.
• Added offline semantic comparison through faultpack evidence-diff without executing declared commands.
• Added format 0.3 JSON Schema support while preserving 0.1/0.2 compatibility.
• Added contract and CLI tests; pytest coverage remains above 90%.

Verification

• 34 tests passed.
• Coverage: 90.58%.
• Ruff passed.
• mypy strict passed.
• JSON Schema parsed successfully.
• Wheel and sdist built successfully.

The project remains local-first and explicitly does not claim to be a sandbox or hosted observability platform.

FaultPack v1.3.0 — Evidence interchange

Highlights

• Added optional producer metadata and digest-first EvidenceEvent timelines for AI-agent and tool runs.
• Added offline semantic comparison through faultpack evidence-diff without executing declared commands.
• Added format 0.3 JSON Schema support while preserving 0.1/0.2 compatibility.
• Added contract and CLI tests; pytest coverage remains above 90%.

Verification

• 34 tests passed.
• Coverage: 90.58%.
• Ruff passed.
• mypy strict passed.
• JSON Schema parsed successfully.
• Wheel and sdist built successfully.

The project remains local-first and explicitly does not claim to be a sandbox or hosted observability platform.

FaultPack v1.2.0 — Privacy preflight

Full Changelog: v1.1.0...v1.2.0

FaultPack 1.1.0 — Replay matrix

Changelog

All notable changes to FaultPack are documented here.

1.1.0 — Replay matrix

Added

• Added typed MatrixProfile and MatrixResult contracts with strict profile names, safe environment keys, optional tokenized argv overrides, and bounded timeout narrowing.
• Added faultpack matrix PACK --profiles profiles.json for ordered, isolated, local replay across multiple profiles.
• Added aggregate JSON output plus Markdown, SARIF, and JUnit matrix reports.
• Added matrix support to the composite GitHub Action through the optional profiles input.
• Added deterministic matrix fixtures and focused tests for success, mismatch, duplicate profiles, unsafe policy, and execution errors.
• Added docs/architecture-v1.1.md and examples/profiles.json.

Compatibility and safety

• Existing v0.1/v0.2 pack formats and commands remain readable and unchanged.
• Matrix execution never mutates the source pack and does not invoke a shell for argv overrides.
• Profile timeouts may narrow but never expand the pack timeout.
• FaultPack remains local-first, passive during verification, and explicit that replay is not a sandbox.

[1.0.0] — 2026-08-25

Added

• Production-oriented flagship release for the portable failure evidence workflow.
• Optional Ed25519 key generation and detached fingerprint signatures through the signing extra.
• Explicit public-key verification with no trust-root discovery or network access.
• diff command for replaying and comparing two verified packs with stable JSON output.
• bundle command for verified deterministic ZIP export.
• Stable JSON output for capture, verification, differential replay, and bundle commands.
• v1.0 product and architecture design covering data flow, error semantics, security, performance, and extension boundaries.
• Rewritten README focused on the product problem, adoption path, security boundary, and Open Source contribution model.

Quality

• Added focused tests for Ed25519 signing, tamper rejection, differential behavior, bundle generation, CLI contracts, and exit codes.
• Preserved v0.1/v0.2 pack parsing and legacy HMAC verification behavior.
• Ruff, mypy, pytest with coverage gate, git diff --check, and wheel/sdist builds pass locally.

[0.2.0] — 2026-08-25

Added

• Versioned v0.2 manifest with backward parsing support for v0.1.
• Safe input-file capture with relative paths and SHA-256 evidence.
• Minimal child environment with explicit --env allowlist.
• Optional HMAC signing through FAULTPACK_SIGNING_KEY and --require-signature verification.
• Stable v0.2 fingerprints that exclude volatile pack ID and measured duration.
• Temporary-workspace replay with output regex/hash and duration predicates.
• Bounded line-oriented reduce command that preserves a non-passing oracle.
• Fixture-driven end-to-end example under fixtures/.
• Security model, threat boundary, architecture, and schema documentation.

Quality

• Expanded unit, CLI, integrity, redaction, replay, and reducer tests.
• Coverage gate raised to 90%.
• Ruff and mypy pass on the source tree.
• Wheel and source distribution build successfully.

[0.1.0] — 2026-08-24

Added

• Versioned faultpack.json manifest contract.
• Privacy-first capture with secret, email, IP, and custom-pattern redaction.
• Deterministic manifest fingerprints and ZIP pack writer.
• Safe relative-path and symlink checks.
• CLI commands: capture, inspect, verify, replay, and version.
• Markdown, SARIF, and JUnit replay reports.
• GitHub Actions quality matrix for Python 3.10–3.13.
• Unit and integration tests with a coverage gate above 85%.

FaultPack v1.0.0

FaultPack v1.0.0

FaultPack v1.0.0 is a local-first, privacy-preserving, verifiable failure evidence workflow.

Highlights

• Portable failure packs with deterministic fingerprints and integrity checks.
• Optional Ed25519 detached signing and explicit public-key verification.
• Differential replay with stable JSON output and diagnostic-only timing deltas.
• Verified deterministic ZIP bundles.
• Bounded replay and reduction with explicit safety boundaries.
• JSON, Markdown, SARIF, and JUnit reports plus a reusable GitHub Action.
• Product/architecture design documentation and focused v1.0 regression tests.

See the README and v1 design.

FaultPack v0.2.0

Full Changelog: v0.1.0...v0.2.0

FaultPack v0.1.0

FaultPack v0.1.0

FaultPack's first public release introduces a local-first workflow for turning software failures into portable, privacy-first, verifiable reproduction packs.

Highlights

• Versioned faultpack.json manifest with stable SHA-256 fingerprints.
• Capture, inspect, verify, and replay CLI commands.
• Redaction for secret-like values, emails, IPv4 addresses, and custom patterns.
• Safe path and symlink checks.
• Markdown, SARIF, and JUnit reports for local workflows and CI.
• GitHub Actions quality matrix across Python 3.10–3.13.
• 90%+ automated test coverage with ruff and mypy gates.

This release is intentionally focused on a transparent core. Replay is not a sandbox; use isolated runners or containers for untrusted packs.