MAINT Breaking: Rename Scenario Strategies to Techniques#2153
Merged
rlundeen2 merged 3 commits intoJul 9, 2026
Merged
Conversation
Renames the scenario-layer 'strategy' vocabulary to 'technique' for 1.0, aligning with the pre-existing AttackTechnique/AttackTechniqueRegistry naming and the CLI (--techniques selects techniques). This is a hard break with no backward-compat aliases. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
The scanner walkthrough referenced a non-existent --scenario-techniques flag (carried forward from the earlier non-existent --scenario-strategies example). The actual CLI flag is --techniques / -t. Fixes the markdown examples in the pyrit_scan scanner guide. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
jsong468
reviewed
Jul 9, 2026
jsong468
approved these changes
Jul 9, 2026
Co-authored-by: jsong468 <songjustin@microsoft.com>
romanlutz
approved these changes
Jul 9, 2026
varunj-msft
pushed a commit
to varunj-msft/PyRIT
that referenced
this pull request
Jul 10, 2026
… collisions Re-migrated onto current main (post technique rename microsoft#2153 / technique organization microsoft#2155). garak.encoding was already seam-migrated on main to EncodingTechnique(ScenarioTechnique); this layers the remaining #8380 standardization on top. Add an EncodingTechnique.DEFAULT aggregate (curated 8-scheme spread across base-N, cipher, and symbolic families) with a get_aggregate_tags() override, make it the default technique, and bump VERSION to 2. Follows the hand-written enum DEFAULT pattern used by scam/web_injection (not the factory default_technique_names path, which applies only to the core catalog). Fix atomic-attack name collisions by naming each converter variant f"{variant_slug}_{config_suffix}" and grouping variants under display_group=encoding_name so per-encoding results aggregate. Trim near-duplicate base64 variants (standard_b64encode is byte-identical to the default; b2a_base64 only appends a newline). Keep the default per-dataset cap at main's max_dataset_size=3 (no timing change).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Renames the scenario-layer
strategy→techniquevocabulary for the 1.0 release. The CLI already selects techniques (the--strategiesflag chose techniques), and the codebase already usesAttackTechnique/AttackTechniqueRegistry—ScenarioStrategywas the lone holdout. This aligns the naming end-to-end.This is a hard break with no backward-compatibility aliases (intended for 1.0).
Key changes
ScenarioStrategy→ScenarioTechnique(base enum + module rename)Foundry/Cyber/Leakage/RapidResponse/Benchmark/Adversarial/TextAdaptive/Psychosocial*Strategy→*Techniquescenario_strategies/strategy_converters→scenario_techniques/technique_converters;_resolve_strategies_and_converters→_resolve_techniques_and_convertersstrategies,strategies_used,default_strategy,aggregate_strategies,all_strategies→techniques,techniques_used,default_technique,aggregate_techniques,all_techniques;ScenarioResult.get_strategies_used()→get_techniques_used()--strategies/-s→--techniques/-tscenarios.instructions.mdupdatedExplicitly NOT touched (deferred)
Executor
AttackStrategy/attack_strategy,WorkflowStrategy,PromptGeneratorStrategy, converter*SelectionStrategy, andStrategyResultare unrelated concepts and are preserved.Verification
rufflint + format clean;ty check pyritclean--helpshows--techniques, -t; repo-wide sweep confirms no dangling old scenario symbolsEnd-to-end / live testing (nothing broken)
Ran the scanner path against a live OpenAI target and exercised the renamed API surface:
doc/scanner/1_pyrit_scan.ipynb— executed end-to-end (start-server →--list-scenarios/--list-initializers→ realfoundry.red_team_agent --techniques base64scan → customScenarioTechniquesubclass → stop-server). 0 cell errors; output shows the renamed vocabulary (scenario_techniques,technique_converters,techniques: N/Nprogress).foundry.red_team_agent --target openai_chat --initializers target --techniques base64— completed cleanly (Total Techniques: 2, per-groupbaseline/base64breakdown).doc/scanner/foundry.ipynb— executed the programmatic scenario +output_scenario_asyncrendering path. 0 cell errors (Scenario: RedTeamAgent,Atomic attacks: 2,Total Techniques: 2).get_all_techniques()/get_aggregate_techniques()work:FoundryTechnique,RapidResponseTechnique,PsychosocialTechnique,CyberTechnique,JailbreakTechnique,LeakageTechnique,ScamTechnique,EncodingTechnique,DoctorTechnique,WebInjectionTechnique.Also fixed a stale scanner-doc flag surfaced during testing:
--scenario-techniques→--techniques(the doc referenced a non-existent flag).