Skip to content

Add ContentSafetyEvaluator back #11

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 1, 2025
Merged

Add ContentSafetyEvaluator back #11

merged 2 commits into from
May 1, 2025

Conversation

aprilk-ms
Copy link
Collaborator

Add ContentSafetyEvaluator

@Copilot Copilot AI review requested due to automatic review settings May 1, 2025 01:13
Copy link

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR reintroduces the ContentSafetyEvaluator by adding its configuration to the evaluator-scores YAML and updating the README table to document the new evaluator mapping.

  • Added a new evaluator block with ContentSafetyEvaluator configurations in analysis/evaluator-scores.yaml.
  • Updated README.md to include the new evaluator in the evaluator mapping table.

Reviewed Changes

Copilot reviewed 2 out of 4 changed files in this pull request and generated no comments.

File Description
analysis/evaluator-scores.yaml Added configuration block for ContentSafetyEvaluator scores.
README.md Updated evaluator table to reference the new ContentSafetyEvaluator.
Files not reviewed (2)
  • samples/data/dataset-small.json: Language not supported
  • samples/data/dataset.json: Language not supported
Comments suppressed due to low confidence (1)

analysis/evaluator-scores.yaml:187

  • [nitpick] The 'Composite' evaluator name is ambiguous since it only wraps the ContentSafetyEvaluator. Consider renaming it to 'ContentSafety' to improve clarity.
  - name: "Composite"

@aprilk-ms aprilk-ms merged commit 5824f05 into main May 1, 2025
8 checks passed
@aprilk-ms aprilk-ms deleted the aprilk/content-safety branch May 9, 2025 02:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants