New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Azure Pipelines] Run pytest tests (and publish results) on macOS #14133
Conversation
Pardon the rename, I hit buttons too fast. Also want to see Azure Pipelines go green for the first commit before I push the next. |
See https://dev.azure.com/web-platform-tests/wpt/_build/results?buildId=848&view=logs for proof that the first commit works. (I intend for this PR to be rebased with separate commits.) |
https://dev.azure.com/web-platform-tests/wpt/_build/results?buildId=850&view=logs shows the intended outcome of this. I missed the important part in the first push, it's all in the fixup :) |
@Hexcles @lukebjerring requesting your review since it's probably a good idea for more of us to understand this setup when I add affected tests to it. |
Can confirm I read through, but any review would merely be a rubber stamp. Is that publish results tool flexible enough for custom results ( WPT reports ) in future? |
12fc45d
to
5641708
Compare
If we could convert our results into the JUnit XML format then we could see something cool for |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM % some minor nits & questions
The decision job running in a Linux VM will decide whether or not jobs running on other OSes start at all. Most templates are now only used once, but most ought to be reused when running affected tests.
cbf9dbb
to
12b87d6
Compare
Two changes in this PR:
The decision job running in a Linux VM will decide whether or not jobs
running on other OSes start at all. Most templates are now only used
once, but most ought to be reused when running affected tests.
And run pytest tests and public results using this nifty task:
https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/test/publish-test-results