Skip to content

refactor(create-expert): generalize adversarial testing patterns#370

Merged
FL4TLiN3 merged 1 commit intomainfrom
refactor/359-generalize-adversarial
Jan 3, 2026
Merged

refactor(create-expert): generalize adversarial testing patterns#370
FL4TLiN3 merged 1 commit intomainfrom
refactor/359-generalize-adversarial

Conversation

@FL4TLiN3
Copy link
Contributor

@FL4TLiN3 FL4TLiN3 commented Jan 3, 2026

Summary

Replace specific attack type references with security principles for adversarial testing.

Changes

  • functional-manager: Changed from "Prompt injection resistance, path traversal prevention, instruction confidentiality" to "Security boundary enforcement, input validation, information protection"
  • property-extractor: Changed from "No path traversal, no instruction leakage" to "Maintains boundaries, protects internal information"
  • expert-tester: Added adversarial stage guidance with principle-based probes (boundary enforcement, input validation, information protection)

Rationale

Per best practices: Test security principles, not specific attack strings. This makes the testing more generalizable and less dependent on known attack patterns.

Closes #359

🤖 Generated with Claude Code


Note

Shifts adversarial testing from attack strings to principle-based security.

  • Updates functional-manager adversarial criteria to focus on boundary enforcement, input validation, and information protection; adjusts pass condition wording
  • Revises property-extractor security property to "Maintains boundaries, protects internal information"
  • Enhances expert-tester with adversarial-stage guidance and principle-based test case generation
  • Adds changeset entry documenting a patch for create-expert

Written by Cursor Bugbot for commit 25199c6. This will update automatically on new commits. Configure here.

Replace specific attack types with security principles:
- functional-manager: boundary enforcement, input validation, information protection
- property-extractor: maintains boundaries, protects internal information
- expert-tester: add adversarial stage guidance with principle-based probes

Closes #359
@codecov
Copy link

codecov bot commented Jan 3, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@FL4TLiN3 FL4TLiN3 merged commit bf99c80 into main Jan 3, 2026
7 checks passed
@FL4TLiN3 FL4TLiN3 deleted the refactor/359-generalize-adversarial branch January 3, 2026 05:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Refactor: adversarial test patterns in functional-manager are too specific

1 participant