dotnet-test Testing Agent - Improve direct scenario#675
Merged
Conversation
Member
Author
|
/evaluate |
Contributor
There was a problem hiding this comment.
Pull request overview
This PR updates the Direct execution strategy guidance for the code-testing-generator agent to reduce variability in test naming/placement by strengthening instructions around reusing existing test projects/files and following existing conventions.
Changes:
- Expanded the Direct strategy “What to do” guidance to emphasize test structure, naming, and style conventions.
- Added explicit guidance to reuse existing test projects/files and only create new test files when no canonical/discoverable location exists.
Show a summary per file
| File | Description |
|---|---|
| plugins/dotnet-test/agents/code-testing-generator.agent.md | Strengthens the Direct strategy instructions to improve consistency in test naming/placement and reuse existing test locations. |
Copilot's findings
Tip
Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
- Files reviewed: 1/1 changed files
- Comments generated: 0
Contributor
|
⏭️ No skills to evaluate — no changed skills with tests were found in this PR. View workflow run |
Evangelink
approved these changes
May 19, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Context
On SWE Atlas tests, the agent has variable scoring on optional rubrics when it goeas to tests naming and placement (meaning - they meet the rubrics in some cases, and fail in other) - so there is an option for improving the guidance and strengthen the scoring on those