Skip to content

Conversation

@guptha23
Copy link
Contributor

Description

Please add an informative description that covers that changes made by the pull request and link all relevant issues.

Update response completeness return schema and adding unit tests for completeness evaluator

  • update the return type to parameters in completeness based on the schema
  • add seed parameter for deterministic results
  • add unit tests for response completeness

please find the schema here: https://github.com/Azure/azureml_run_specification/blob/users/changliu2/sdk_review/specs/ai-sdk/agents_evaluation.md#response-completeness

image

If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.

All SDK Contribution checklist:

  • The pull request does not introduce [breaking changes]
  • CHANGELOG is updated for new features, bug fixes or other significant changes.
  • I have read the contribution guidelines.

General Guidelines and Best Practices

  • Title of the pull request is clear and informative.
  • There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

  • Pull request includes test coverage for the included changes.

@guptha23 guptha23 requested a review from a team as a code owner March 24, 2025 07:46
@github-actions github-actions bot added Community Contribution Community members are working on the issue customer-reported Issues that are reported by GitHub users external to the Azure organization. Evaluation Issues related to the client library for Azure AI Evaluation labels Mar 24, 2025
@github-actions
Copy link

Thank you for your contribution @guptha23! We will review the pull request and get back to you soon.

@kristapratico kristapratico removed customer-reported Issues that are reported by GitHub users external to the Azure organization. Community Contribution Community members are working on the issue labels Mar 26, 2025
@kashifkhan kashifkhan requested a review from singankit March 26, 2025 18:39
@guptha23 guptha23 closed this Apr 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Evaluation Issues related to the client library for Azure AI Evaluation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants