Skip to content

v0.11.0 — Remediation Loop

Choose a tag to compare

@dsolisp dsolisp released this 23 Jul 22:22
· 13 commits to main since this release
31281b5

v0.11.0 — Remediation Loop

Closes the detect → suggest → fix → verify loop: the scanner now tells agents how to fix findings, cuts false positives on hardcoded-env and brittle-assert, adds adoption/fixture-utilization scanners and CI-history flakiness scoring, and the orchestrator contract mandates post-refactor review and parallel delegation. Also ships GitHub Copilot native discovery and the v0.10.x ecosystem cleanup.

Added

  • fix: remediation hints in self-check (text/JSON/SARIF), context-aware per wait subCase; SARIF fixes array renders inline in Code Scanning.
  • Adoption scanner (gavel adoption, report-only): unused-helper + unused-fixture.
  • Flakiness scoring (gavel flakiness): Playwright JSON + JUnit/Surefire XML → per-test score; mixed outcome = flaky, fail-every-retry = real failure. CLI-only (not wired into suite-health.js).
  • Orchestrator quality gates: post-refactor review + parallel delegation pattern.
  • GitHub Copilot native discovery via .vscode/settings.json (chat.agentSkillsLocations / chat.agentFilesLocations).

Fixed

  • hardcoded-env env-wrapper recognition (fallback defaults inside os.environ.get / getenv / process.env).
  • brittle-assert structure + argument-position parsing (comparison-only; subject-first shapes).
  • .NET build dirs (bin/obj/packages/.vs) excluded from scanning.

Tier-R remediation hardening (two adversarial cross-review passes)

  • brittle-assert: drop trailing failure-message arg for function-style equality APIs (reverses a #11 FP regression); .And.Be( candidate + scan every matcher call so FluentAssertions chains flag.
  • flakiness: self-closing <testcase/> counted correctly; BOM strip; fail-closed on bad input; skipped excluded; order-derived eventualPass.
  • adoption: comment/string masking (code-only); Playwright waitFor* builtins excluded.

Removed

  • gavel-oms skill (out of generic scope). Core catalog now 29 skills.

Gate

npm run verify → EXIT=0 — corpus 8/8 @ 100% (brittle-assert TP=19, FP=0, FN=0), diff-corpus 100%, docs/versions/manifest clean, 30/30 unit tests.

Full changelog: v0.10.0...v0.11.0