Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Automate results collection from Mobile Safari #17856
At WWDC2019, a WebKit maintainer announced, "WebDriver is coming to iOS [version 13]." We'd like to take advantage of this and configure WPT's infrastructure to publish test results for Mobile Safari to wpt.fyi (just as it does for "desktop" Safari today).
I'm not aware of any plans for Azure Pipelines to offer access to iPhones, but we should be able to use the iOS Simulator in Apple's Xcode to run Mobile Safari on the macOS systems that WPT currently uses. Test results collected from an emulated version of a browser will not necessarily match those collected from the genuine article, but it's not clear how much they will differ. We should also run a trial on a physical device so we can gauge the authenticity of the emulation.
The last hurdle (that we anticipate!) will be provisioning an environment in Azure Pipelines. All of this hinges on software that is currently available only on a "preview" basis: macOS 10.15 and Xcode 11. While we can manually opt in to these releases on locally maintained hardware, that's not an option in Azure Pipelines. To automate the process, we'll need to wait for Azure Pipelines to support this software. That's likely to occur after it is released as the current, stable version. There's no official schedule for this, but fans estimate it to occur in mid September, 2019.
Last week, @burg published a post on WebKit's blog with some technical instructions on using WebDriver in iOS 13. I haven't been able to get it working yet, so I'm working with Apple developer relations folks to learn more.