Test runner for media devices

[tidoust]

Early September, Louay presented the work done within the CTA WAVE project on creating a test suite for the Web Media API specification. Relevant links:

• Minutes of the call
• Slides presented by Louay (PDF)
• Github repository for the test suite

The tools and test suite are based on Web Platform Tests (WPT). One idea would be to merge the changes made to the test runner back into WPT. Trying to come up with a list of atomic changes, my understanding is that the following contributions could perhaps be envisioned:

1. Contribute changes to testharness.js to allow sending back test results to a server
2. Contribute a new test runner, suitable for media (and other constrained) devices, based on a backend server. The test runner could perhaps be maintained in a separate repository
3. Consider integrating the tool that extracts the tests that pass across main browser codebases to the WPT dashboard

@louaybassbouss, is that a good starting point?

I note that WPT meets at TPAC next week, on Monday and Tuesday. I also note that the project is looking at adopting a governance model to give more formalism to the decision process.

[mavgit]

I will be at TPAC in Lyon next week and I'd be happy to attend a meeting with the W3C test group to discuss this there.

@louaybassbouss, will anyone from your team be at TPAC?

[louaybassbouss]

Thanks @tidoust yes this is a good starting point :)
@mavgit I will attend TPAC but only Thursday and Friday but @squapp (Stefan Pham) and I will participate on Monday in the M&E Meeting remotely. Is there a plan to arrange a joint meeting with WPT?

[mavgit]

@louaybassbouss Can you please take the lead to arrange for a meeting with WPT folks on Thursday or Friday? I suggest you email to public-test-infra@w3.org, which is where they are planning WPT TPAC meetings (see mail archive). If we can't meet with the whole WPT team, perhaps just a few leads to discuss.

You should also email your slides and the issues to be discussed. In addition to #10 (comment), I'd also add WebDriver as a topic.

I'm available Thursday & Friday before 3PM both days. (I have AC meeting Thursday 3-6, I go to airport Friday @ 3). I could also meet after 6PM Thursday.