Skip to content

feat(certs): Add framework guidance links to certification controls#382

Closed
artemisclaw82 wants to merge 3 commits intosecurity-alliance:developfrom
artemisclaw82:feat/cert-framework-linking
Closed

feat(certs): Add framework guidance links to certification controls#382
artemisclaw82 wants to merge 3 commits intosecurity-alliance:developfrom
artemisclaw82:feat/cert-framework-linking

Conversation

@artemisclaw82
Copy link

@artemisclaw82 artemisclaw82 commented Feb 16, 2026

Summary

Adds "📖 Related Framework Guidance" links to certification control cards, connecting each control to framework pages that substantively address its baselines.

What it does

Each certification control card now shows links to relevant framework pages where users can find actionable guidance for meeting that control's requirements. Only links where the framework content actually meets the baseline standards are included — not just keyword matches.

Coverage (strict, QA-verified)

Controls %
✅ Full coverage (page meets ≥80% baselines) 22 20%
⚠️ Partial coverage 69 62%
❌ No coverage 20 18%

42 framework pages linked across 111 controls.

Quality methodology

Three-stage pipeline to avoid false positives:

  1. Keyword matching — TF-IDF-like scoring narrows 275 pages to 5-8 candidates per control
  2. LLM evaluation — Agents read full page content + baselines, assess substantive coverage
  3. LLM QA — Separate agents verify evaluator accuracy (82% confirmed, 18 corrected)

Gap analysis

docs/gap-analysis.md identifies 247 specific baseline gaps where framework content doesn't yet cover cert requirements — useful for prioritizing future content.

Files

Components:

  • components/cert/ControlCard.tsx — enhanced with framework guidance links
  • components/cert/cert-framework-map.ts — generated control → framework page index
  • components/cert/control.css — styles for guidance links

Scripts (reproducible pipeline):

  • scripts/extract-cert-framework-data.mjs
  • scripts/match-controls-to-pages.mjs
  • scripts/generate-eval-briefs.mjs
  • scripts/build-verified-mapping.mjs

Data:

  • scripts/data/eval-results/*.json — per-cert verified evaluations
  • scripts/data/qa-results/*.json — QA verification results
  • docs/gap-analysis.md — coverage report with specific gaps

Build

Clean build (pnpm run docs:build, ~131s).

@vercel
Copy link

vercel bot commented Feb 16, 2026

@artemisclaw82 is attempting to deploy a commit to the Security Alliance Team on Vercel.

A member of the Team first needs to authorize it.

@artemisclaw82 artemisclaw82 changed the title feat(certs): Bidirectional cert ↔ framework page linking with verified coverage feat(certs): Add framework guidance links to certification controls Feb 16, 2026
@scode2277
Copy link
Collaborator

Hey @DicksonWu654, this PR targets the main branch. All PRs must target the develop one.
Can you please fix it?

@scode2277 scode2277 added the content:add This issue or PR adds content or suggests to label Feb 16, 2026
@artemisclaw82 artemisclaw82 changed the base branch from main to develop February 16, 2026 22:01
@DicksonWu654
Copy link
Collaborator

DicksonWu654 commented Feb 16, 2026 via email

@artemisclaw82
Copy link
Author

Disclosure: This content was written by Artemis, an AI assistant operated by @DicksonWu654. It has not yet been reviewed by a human. Dickson will review and revise before marking as ready for review.

- Extract 111 controls across 6 certs + 275 framework pages into structured JSON
- Keyword-based matching (TF-IDF-like scoring) maps controls to relevant pages
- Forward links: ControlCard shows '📖 Related Framework Guidance' per control
- Reverse links: CertReferences component for framework pages to show cert controls
- Gap analysis report: 58% full coverage, 33% partial, 9% uncovered (10 controls)
- Coverage levels: 'full' (≥80% baseline match) and 'partial' (some coverage)
- Build-tested: bundles + prerender clean

Scripts (regeneratable):
  scripts/extract-cert-framework-data.mjs — parse certs + pages to JSON
  scripts/match-controls-to-pages.mjs — keyword matching engine
  scripts/build-final-mapping.mjs — produce TS data file + gap report
Pipeline: keyword matching → LLM evaluation → LLM QA verification
QA results: 82% confirmed, 18 downgrades, 1 upgrade, 1 false-negative fixed

Post-QA coverage (strict):
- 22 controls (20%) with full framework coverage
- 69 controls (62%) with partial coverage
- 20 controls (18%) with no coverage
- 247 gap baselines identified for future content work
- 42 framework pages linked across 111 controls

Build-tested clean.
@artemisclaw82 artemisclaw82 force-pushed the feat/cert-framework-linking branch from ddf5aa6 to 9d045a7 Compare February 24, 2026 05:54
@github-actions
Copy link

Sidebar Configuration Reminder

Documentation files update:

New in this push:

  • docs/pages/config/index.mdx (added) ← NEW

Please ensure that:

  • The sidebar in vocs.config.tsx has been updated to include these files
  • New content has the dev: true parameter so it's marked as under development
  • Sidebar links match the file paths - use the preview deployment to verify

See Contributing Guide – Sidebar & Navigation for more details.


This is an automated reminder. If this PR doesn't need sidebar changes, you can ignore this message.

@DicksonWu654
Copy link
Collaborator

Clsoing this in favor of: #401

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

content:add This issue or PR adds content or suggests to

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants