-
Notifications
You must be signed in to change notification settings - Fork 473
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support publishing conformance test results to Azure DevOps #1064
Support publishing conformance test results to Azure DevOps #1064
Conversation
- Update conformance test to output junit xml reports that can be consumed by Azure DevOps test analytics. - Add conformance test workflow job to trigger pipeline in Azure DevOps that publishes the test results. - Add Azure pipeline definition for publishing test results from a specified GitHub workflow run to Azure DevOps.
fb15fd4
to
2e3cb45
Compare
@wcs1only @artursouza Putting this up so that any maintainer tasks can happen in parallel to code reviews. |
Codecov Report
@@ Coverage Diff @@
## master #1064 +/- ##
=======================================
Coverage 34.53% 34.54%
=======================================
Files 132 132
Lines 10870 10870
=======================================
+ Hits 3754 3755 +1
+ Misses 6736 6734 -2
- Partials 380 381 +1
Continue to review full report at Codecov.
|
displayName: 'Install Python tools' | ||
|
||
- task: PythonScript@0 | ||
displayName: 'Download test artifacts' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Shot in the dark, but I'd be curious if you could just use the Download Pipeline/Build Artifacts AzDO task: https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/utility/download-pipeline-artifact?view=azure-devops or https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/utility/download-build-artifacts?view=azure-devops
The only reason I suggest that is that both github actions and azure devops artifacts use the same backend, I'd be curious if it just works. Though I don't know what the "pipeline" name would be.
Besides that, I can't think of anything else that would work better. Maybe reaching out to someone who works on Azure DevOps may be the next best step.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the suggestion! I took a look at the task definition for that and it's a wrapper for the TFS HTTP endpoint, so it doesn't look like it's possible to get through that to the underlying shared backend with GitHub. I'll see if I can find anyone on AzDevOps who might be able to help.
Per sync with maintainers, the desire is to switch to a pull-only model from the test dashboard service to remove the need for a GitHub action trigger. Closing this PR. |
Description
Issue reference
POC using components-contrib conformance tests to address test dashboard requirement suggested in dapr/dapr#3316
Checklist
Please make sure you've completed the relevant tasks for this PR, out of the following list: