Run ATP from Test Plans - Run with Options to execute custom selected test cases #20887
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
KathanS
changed the title
skmanoj
approved these changes
Mar 3, 2025
adityashahms
reviewed
Mar 4, 2025
This reverts commit d2e7493.
…osoft/azure-pipelines-tasks into users/ksanghavi/atp-testRun
|
/azp run |
|
/azp run |
|
/azp run |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Task name: AzureTestPlanV0
Description: Make ATP task available for run from 'Test Plan - Run with Options' by providing option of 'Test run' as test selector, users can now select test cases from test plan gui and hit the release pipeline containing ATP task to execute tests on build of their choice in all languages supported by ATP
Demo videos:
Classic: https://microsoftapc-my.sharepoint.com/:v:/g/personal/ksanghavi_microsoft_com/EeCHc7Xp9FFInX827chtT6EBeubZX2clttIn4k8pIVpfvw?e=uma9Lo
YAML: https://microsoftapc-my.sharepoint.com/:v:/g/personal/ksanghavi_microsoft_com/EaFsI9KnouRMgCiv73ywhlIBJjJ_FbYNsLoHIkYAmiy_ag?e=agpSFx
Multiple Tests: https://microsoftapc-my.sharepoint.com/:v:/g/personal/ksanghavi_microsoft_com/ERsWqvmrY-BLiPxcW4Ypko4Bi-HlvkdSxFHwRVYiu_UARA?e=AbLKuU
Release pipeline - ATP task
Users can also see the execution history of test point as per below,
Both classic and yaml release pipelines are supported for running tests using ATP task via 'Test Plan - Run with Options' (both old and new UI)
Currently, ATP task by design publishes new test run whenever invoked, and we also need base test run created initially containing selected test cases from UI, so in turn we end up creating two test runs, we do not see any issue on execution history due to this and test result status are also updated correctly on the selected test points. We will take this up iteratively in separate PRs making design changes in agents code to not publish new test run when existing testRunId is passed and instead update the existing test run, and we need to make changes accordingly in ATP task.
Checklist: