feat: close evidence instruments and add bounded recovery - #11
Merged
Conversation
There was a problem hiding this comment.
Pull request overview
This PR bumps AIWorkHub to 0.8.99 and tightens “evidence-first” behavior by (1) making MCP unknown-tool failures recoverable with bounded, deterministic guidance, and (2) adding stable root-cause fingerprints plus duplicate summaries to static Known Bug Scanner evidence (including SARIF output), alongside roadmap/changelog documentation.
Changes:
- Add
unknown_tool_message()and wire it into both stdio MCP dispatchers so unknown tools return bounded JSON recovery guidance and suggestions (no auto-aliasing/execution). - Extend Known Bug Scanner output with
root_cause_fingerprint,dedupe_summary, and SARIFpartialFingerprints.aiworkhubRootCauseFingerprint. - Version bump and documentation updates (Strix capability review, roadmap and changelog).
Reviewed changes
Copilot reviewed 15 out of 16 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
| vscode-extension/package.json | Bumps VS Code extension version to 0.8.99. |
| vscode-extension/package-lock.json | Aligns lockfile package version to 0.8.99. |
| vscode-extension/extension.js | Updates expected MCP package version constant to 0.8.99. |
| src/aiworkhub/_version.py | Bumps Python package version to 0.8.99. |
| src/aiworkhub/tool_recovery.py | Introduces bounded unknown-tool recovery message generator. |
| src/aiworkhub/stdio_fastmcp.py | Emits bounded recovery JSON for unknown tools in dependency-free stdio server. |
| src/aiworkhub/server.py | Emits bounded recovery JSON for unknown tools in fallback stdio dispatcher. |
| src/aiworkhub/known_bug_scanner.py | Adds stable root-cause fingerprints, dedupe summary, and SARIF partial fingerprint. |
| src/aiworkhub/quality_evidence.py | Includes dedupe summary in known-bug evidence check summary. |
| tests/test_tool_recovery.py | Tests determinism, boundedness, and redaction behavior of unknown-tool guidance. |
| tests/test_stdio_fastmcp_schema.py | Ensures unknown-tool errors don’t terminate subsequent stdio requests. |
| tests/test_known_bug_scanner.py | Validates fingerprint stability across line movement and dedupe summary correctness. |
| tests/test_aiworkhub_embedded_mcp_runtime_b844_v1.py | Validates bounded unknown-tool behavior in embedded stdio protocol dispatch. |
| docs/STRIX_CAPABILITY_REVIEW.md | Documents source-pinned Strix capability review and adopted/non-adopted ideas. |
| docs/PRODUCT_ROADMAP.md | Notes evidence-instrument closure and documents Strix-derived refinements. |
| CHANGELOG.md | Adds 0.8.99 release notes describing the new recovery/fingerprint behavior. |
Files not reviewed (1)
- vscode-extension/package-lock.json: Generated file
Comment on lines
+17
to
+20
| def _bounded_name(value: Any) -> str: | ||
| text = str(value or "")[:MAX_REQUESTED_CHARS] | ||
| match = _SAFE_NAME.fullmatch(text) | ||
| return text if match else "<invalid>" |
Comment on lines
+32
to
+37
| suggestions = difflib.get_close_matches( | ||
| name, | ||
| candidates, | ||
| n=MAX_SUGGESTIONS, | ||
| cutoff=0.45, | ||
| ) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Evidence
Truth boundaries
Workspace hygiene
The two pre-existing B829 eval files remain uncommitted and are excluded from this PR.