Skip to content

cfdoctor v0.3.0

Latest
Latest

Choose a tag to compare

View all tags
@adewale adewale released this 12 Jul 22:32
v0.3.0
f2f7f4e

Highlights

  • Add approval-gated, read-only Wrangler snapshots for Worker and Pages deployed state.
  • Default snapshots to metadata-only collection; source/config download requires the separate --include-source-config opt-in.
  • Require an already installed project-pinned Wrangler executable—no package runners, installs, or Cloudflare mutation commands.
  • Capture every traffic-bearing Worker version, bindings/runtime limits, deployment metadata, and secret names/types in private hashed manifests.
  • Add targeted account-read guidance for DNS, rulesets/WAF, Access, R2, Queues, usage, and billing without introducing a universal account collector.
  • Harden scanner 0.3.5 with bounded imported/computed Durable Object keys, per-Queue consumer matching, alarm-condition precision, linked Stream preload checks, indirect self-fetch detection, observability sampling, webhook idempotency, modern Wrangler product inventory, and generated-corpus exclusion.
  • Add current pricing-source bundles, conflict handling, stronger evidence provenance, 29 claim-ledger records, and first-party Cloudflare reliability postmortems.
  • Strengthen semantic/adversarial eval oracles for approval, no-install behavior, Static Assets, package-runner rejection, and identifier minimization.

Evaluation

A matched three-way GPT-5.5 evaluation used the same manifest/oracles and three fresh interleaved runs per visible case: 279 answers and 243 primary judgments.

Metric v0.3.0 skill Previous GitHub main No skill
Objective 89.15% 81.79% 72.97%
Combined 89.69% 83.00% 69.24%
Judge mean 0.9507 0.9333 0.7684

The Wrangler slice scored 93.01% versus 63.96% on previous main and 60.53% without the skill. Legacy behavior remained statistically compatible with main. Pricing guidance improved over main but did not establish lift over no skill and remains an explicit efficiency target.

Validation

  • 60/60 offline unit tests
  • 39/39 trigger cases
  • 25/25 detection fixtures
  • 14 Wrangler subprocess-boundary tests
  • 60-check scanner registry / 66 coverage rows
  • 29 evidence records / 23 scenarios / 25 fixtures
  • Skill Eval Harness v0.6.0: 37 cases / 6 materialized ablations
  • Clean static self-scan and installable-skill boundary
  • npm pack --dry-run: 21 release files; no eval, research, docs, tests, or repository scripts in the package boundary
  • Both GitHub Actions workflows passed on the release commit

Install

pi install https://github.com/adewale/cfdoctor@v0.3.0

See CHANGELOG.md for the complete change list and disclosed limitations.

Assets 2
Loading