Skip to content

Port from safety to redteaming #201

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Jun 2, 2025
Prev Previous commit
Next Next commit
Update docs
  • Loading branch information
pamelafox committed Jun 2, 2025
commit 1a58493f5931dc7da2f50cdf18a5116dbd073fea
8 changes: 4 additions & 4 deletions docs/safety_evaluation.md
Original file line number Diff line number Diff line change
@@ -5,7 +5,7 @@ When deploying a RAG app to production, you should evaluate the safety of the an
* [Deploy an Azure AI project](#deploy-an-azure-ai-project)
* [Setup the evaluation environment](#setup-the-evaluation-environment)
* [Run red teaming agent](#run-red-teaming-agent)
* [Review the red teaming results](#review-the-red-team-results)
* [Review the red teaming results](#review-the-red-teaming-results)

## Deploy an Azure AI project

@@ -90,9 +90,9 @@ In addition to the results in Azure AI Foundry, you can also review the results

Each file in this directory corresponds to a single red teaming scan, and contains the following fields:

* `redteaming_scorecard`: A summary of the scan results, including the attack success rate and the number of questions asked.
* `redteaming_parameters`: The parameters used for the scan, including the risk categories and attack strategies.
* `redteaming_data`: A list of the questions asked during the scan, along with the answers received from your app.
* `scorecard`: A summary of the scan results, including the attack success rate and the number of questions asked.
* `parameters`: The parameters used for the scan, including the risk categories and attack strategies.
* `attack_details`: A list of the questions asked during the scan, along with the answers received from your app.
* `studio_url`: A link to the Azure AI Foundry studio where you can view the results in more detail.

Learn more in the [Red Teaming Agent documentation](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/develop/run-scans-ai-red-teaming-agent#results-from-your-automated-scans).
Loading
Oops, something went wrong.