What labels does the ARIA WG want to use for WPT search results?

[cookiecrook]

Now that the following issue and PR have landed:

• Task: auto-add a general "accessibility" label to all the accessibility-related WPT PRs for triage/visibility. web-platform-tests/interop-accessibility#43
• add general accessibility labels to existing accessibility-related automated tests web-platform-tests/wpt-metadata#4662

My goal with:

• Figure out how to get a better link URL for all accessibility tests in the WPT dashboard web-platform-tests/interop-accessibility#44

Was to get the following links (and others as needed)

General label:
Accessibility: https://wpt.fyi/results/?label=master&label=experimental&aligned&q=label%3Aaccessibility (or a11y synonym)

Or more specifically by spec:
ARIA: https://wpt.fyi/results/?label=master&label=experimental&aligned&q=label%3Aaria
AccName: https://wpt.fyi/results/?label=master&label=experimental&aligned&q=label%3Aaccname
HTML-AAM: https://wpt.fyi/results/?label=master&label=experimental&aligned&q=label%3Ahtml-aam

We also should be able to get pretty granular about the per-file subsections of spec testing, for example... We could associate a specific label with the invalid roles related tests, or some subsection of the AccName name computation algorithm.

So the ARIA WG should consider what labels they want to sub-filter WPT test results...

@jnurthen had mentioned this could be useful like a "Can-I-Use" live link from the spec to its implementation status in all engines.

[cookiecrook]

Combining directory level and file-specific labels is partially blocked by:
web-platform-tests/wpt-metadata#4665

So we should not add file-specific labels to the accessibility tests until that bug is resolved.

[spectranaut]

Discussed in last weeks meeting: https://www.w3.org/2023/08/31-aria-minutes#t05

[cookiecrook]

FYI, I closed a related action to double-check that you can't label a subtest...

• double-check that a label can't be added to a WPT subtest web-platform-tests/interop-accessibility#58

Outcome: You CANNOT label a subtest individually.

You can only label a directory (including all its files) or you can label a file (including all its subtests). If the ARIA WG wants a higher level of granularity, it could file a new issue to the wpt.fyi repo, or consider splitting up some of the existing test files.