Pass Agent level guardrails conversation history #48
Conversation
steven10a
commented
Nov 19, 2025
steven10a
commented
- Pass conversation history to guardrails that need them when using Agents
- Further optimized JB system prompt
- Updated tests
There was a problem hiding this comment.
Pull Request Overview
This PR enhances guardrail functionality by passing conversation history to guardrails that require it when using Agents, optimizes the jailbreak detection system prompt with clearer banned content categories, and updates corresponding tests.
- Adds dual access pattern for conversation history (both property and method) for improved compatibility
- Optimizes performance by conditionally loading conversation history only when needed
- Expands jailbreak system prompt with explicit banned content categories
Reviewed Changes
Copilot reviewed 8 out of 8 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| src/types.ts | Adds conversationHistory property to GuardrailLLMContextWithHistory interface for direct access alongside existing method accessor |
| src/evals/core/async-engine.ts | Introduces extractTextFromContent helper, removes prompt injection-specific logic, and adds conversation history extraction for non-conversation-aware guardrails |
| src/checks/jailbreak.ts | Adds comprehensive "BANNED CONTENT CATEGORIES" section to system prompt for clearer detection guidance |
| src/base-client.ts | Updates createContextWithConversation to expose conversation history via both property and method |
| src/agents.ts | Refactors context creation and adds optimization to conditionally load conversation history |
| src/tests/unit/evals/async-engine.test.ts | Adds test coverage for multi-part content extraction in non-conversation-aware guardrails |
| src/tests/unit/base-client.test.ts | Adds test verifying dual access pattern for conversation history |
| src/tests/unit/agents.test.ts | Updates test to mark guardrail as conversation-aware to trigger proper context creation |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
ℹ️ About Codex in GitHub
Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".
|
@codex review |
|
Codex Review: Didn't find any major issues. You're on a roll. ℹ️ About Codex in GitHubCodex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
If Codex has suggestions, it will comment; otherwise it will react with 👍. When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback". |
