Skip to content

Feature: Weighting metadata preference for WPT dashboard or Interop scoring (file | subtest | other?) #6466

Open
@cookiecrook

Description

@cookiecrook

Feature: Weighting metadata preference for WPT dashboard or Interop scoring (file/subtest/other)

I noticed weighting for this directory was giving 33% weight to 2% of the subtests. In this particular case, the test files were broken up arbitrarily for authoring convenience, so weighting evenly per subtest failure would be a better choice.

However, that's not always the case in other directories... /encoding tests for example would count for ~60% of the WPT score if all subtests were weighted evenly. So that wouldn't be the best solution either.

Perhaps in wpt-metadata, a top-level directory or subdirectory could hint which choice [ file | subtest | other? ] would be a better selection for scoring Inerop and other WPT CI results.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions