feat: add trace analysis advisor skill for intelligent AIRT recommendations#4
Merged
rdheekonda merged 3 commits intomainfrom May 4, 2026
Merged
feat: add trace analysis advisor skill for intelligent AIRT recommendations#4rdheekonda merged 3 commits intomainfrom
rdheekonda merged 3 commits intomainfrom
Conversation
|
You are seeing this message because GitHub Code Scanning has recently been set up for this repository, or this pull request contains the workflow file for the Code Scanning tool. What Enabling Code Scanning Means:
For more information about GitHub Code Scanning, check out the documentation. |
83568f9 to
80b5da2
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds skill specification for trace analysis functionality in the AI red teaming agent.
What this adds
API Endpoints
GET /assessments/{id}/analyticsGET /assessments/{id}/traces/attacksGET /assessments/{id}/traces/trialsGET /assessments/{id}/projects/{project}/summaryTool Functions Specified
analyze_attack_effectiveness- Query historical ASR by attack typesuggest_optimal_transforms- Recommend transforms based on historical datapredict_attack_success- Estimate success probability from historical patternsidentify_vulnerability_patterns- Pattern matching from target responsesget_historical_metrics- Trending and coverage analysisImplementation
This is a skill specification only. Actual tool implementation would be separate work.
Testing
No tests required - this is documentation/specification only.