Skip to content

Generate a reusable evaluation and safety baseline - #20

Merged
sergeliatko merged 1 commit into
mainfrom
feat/generated-evaluation-baseline
Jul 27, 2026
Merged

Generate a reusable evaluation and safety baseline#20
sergeliatko merged 1 commit into
mainfrom
feat/generated-evaluation-baseline

Conversation

@sergeliatko

Copy link
Copy Markdown
Member

Summary

  • generate activation and handoff fixtures that must be specialized before maintenance mode
  • generate primary workflow, incomplete-input, and verification scenarios
  • generate inert adversarial scenarios for instruction injection, destruction, and public disclosure boundaries
  • add a stable eight-case evaluation registry across four generic coverage segments
  • validate fixture linkage, registry completeness, maintenance AGENTS.md sections, and the canonical runtime map
  • add testing and conditional threat-model guidance that distinguishes deterministic, behavioral, and human evidence

Validation

  • npm.cmd run validate
  • npm.cmd run package -- v0.0.0
  • node --check scripts/validate-evaluations.mjs
  • git diff --check

Closes #15

@sergeliatko
sergeliatko force-pushed the feat/generated-evaluation-baseline branch from 486cc2a to 6895d46 Compare July 27, 2026 14:26
@sergeliatko
sergeliatko merged commit 8c1ea75 into main Jul 27, 2026
1 check passed
@sergeliatko
sergeliatko deleted the feat/generated-evaluation-baseline branch July 27, 2026 14:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Generate a minimal evaluation and safety baseline

1 participant