Skip to content

updating prompt injection sys prompt and evals #24

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Oct 30, 2025
Merged

updating prompt injection sys prompt and evals #24

merged 1 commit into from
Oct 30, 2025

Conversation

@steven10a
Copy link
Collaborator

@steven10a steven10a commented Oct 30, 2025

  • Updated system prompt of prompt injection guardrail for better performance
  • Small change to llm_base so all LLM based checks use a shared error reporter and updated other LLM checks to use it
  • Update eval tool to properly parse multi-turn input data
  • Updated evals with results of V2

@steven10a steven10a requested review from Copilot and gabor-openai and removed request for Copilot October 30, 2025 16:28
gabor-openai
gabor-openai approved these changes Oct 30, 2025
View reviewed changes
Copy link
Collaborator

@gabor-openai gabor-openai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM TY!

@gabor-openai gabor-openai merged commit 8f30ead into main Oct 30, 2025
7 checks passed
@steven10a steven10a deleted the dev/steven/PI_v2 branch October 30, 2025 21:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gabor-openai gabor-openai gabor-openai approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@steven10a @gabor-openai