Govern stack-wide property fuzzing and test quality - #365
Conversation
|
Review the following changes in direct dependencies. Learn more about Socket for GitHub.
|
Codecov Report❌ Patch coverage is
📢 Thoughts on this report? Let us know! |
|
ty-everett
left a comment
There was a problem hiding this comment.
Maintainer/admin exact-head attestation for a59cdc6: reviewed scope and evidence; the branch includes current main, all exact-head required checks are green, Sonar reports 0 new issues and 0 security hotspots, CodeQL/Socket/Dependency Review/Codecov gates pass, and the final local campaign exercised 88 independent properties across 25 packages with at least 88,000 generated cases while machine-classifying all 33 package manifests. There are no unresolved review threads. Admin merge is authorized for this maintenance wave.



What changed
not implemented; 211 intended gaps across 19 vector files now have governed ownership, reasons, exact counts, review dates, and removal criteriafast-checkproperty fuzzing across 25 packages and 88 independent properties covering codecs, binary and script framing, signed-body canonicalization, public protocol parsers, network destinations, GASP and reorg events, integrity hashes, native batch memory, wallet pairing, issuer allowlists, operator/scaffolder inputs, currency math, HTTP payment challenges, authenticated Express framing, replay admission, BTMS authorization, and untrusted metadataWhy
The stack previously mixed deterministic tests with live, credentialed, resource-heavy, empty, and intentionally unsupported cases. That made coverage claims ambiguous and allowed non-required conformance dispatch paths to pass without assertions. High-risk parsers and serializers also relied mostly on hand-picked examples. This wave makes what runs auditable and adds broad generative checks that have already found concrete malformed-input, overflow, canonicalization, and authorization-boundary defects.
Validation
FAST_CHECK_NUM_RUNS=1000 pnpm test:property(full workspace build plus at least 88,000 generated cases from 88 independent properties across 25 packages)pnpm test:governance; governance unit tests: 6/6; all 33 package manifests classifiedpack:checkexact-tarball consumers greenpnpm audit:security: no known vulnerabilitiesa59cdc604b87a367ef170c5c6c4793ffa2f49e30No package versions are changed and nothing is published by this PR.
Program tracker: #324