Skip to content

FEAT Refactored QA Benchmark Orchestrator as a Strategy#1066

Merged
rlundeen2 merged 4 commits intomicrosoft:mainfrom
bashirpartovi:dev/bashirpartovi/qa-benchmarking-orch
Aug 13, 2025
Merged

FEAT Refactored QA Benchmark Orchestrator as a Strategy#1066
rlundeen2 merged 4 commits intomicrosoft:mainfrom
bashirpartovi:dev/bashirpartovi/qa-benchmarking-orch

Conversation

@bashirpartovi
Copy link
Copy Markdown
Contributor

Description

  • Refactored QuestionAnsweringBenchmarkOrchestrator as QuestionAnsweringBenchmark using Strategy pattern
  • run_attacks_async hasn't been migrated but should be able to be easily handled by any code that's calling execute_async

Comment thread pyrit/executor/benchmark/question_answering.py Outdated
Comment thread pyrit/executor/benchmark/question_answering.py Outdated
Copy link
Copy Markdown
Contributor

@hannahwestra25 hannahwestra25 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor comments but looks good!

@rlundeen2 rlundeen2 merged commit b23183f into microsoft:main Aug 13, 2025
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants