Data-driven import maps tests

In this directory, test inputs and expectations are expressed as JSON files. This is in order to share the same JSON files between WPT tests and other implementations that might not run the full WPT suite, e.g. server-side JavaScript runtimes or the JavaScript reference implementation.

Basics

A test object describes a set of parameters (import maps and base URLs) and test expectations. Test expectations consist of the expected resulting URLs for specifiers.

Each JSON file under resources/ directory consists of a test object. A minimum test object would be:

{
  "name": "Main test name",
  "importMapBaseURL": "https://example.com/import-map-base-url/index.html",
  "importMap": {
    "imports": {
      "a": "/mapped-a.mjs"
    }
  },
  "baseURL": "https://example.com/base-url/app.mjs",
  "expectedResults": {
    "a": "https://example.com/mapped-a.mjs",
    "b": null
  }
}

Required fields:

• name: Test name.
  • In WPT tests, this is used for the test name of promise_test() together with specifier to be resolved, like "Main test name: a".
• importMap (object or string): the import map to be attached.
• importMapBaseURL (string): the base URL used for parsing the import map.
• expectedResults (object; string to (string or null)): resolution test cases.
  • The keys are specifiers to be resolved.
  • The values are expected resolved URLs. If null, resolution should fail.
• baseURL (string): the base URL used in resolving a specifier for each specifiers.

Optional fields:

• link and details can be used for e.g. linking to specs or adding more detailed descriptions.
  • Currently they are simply ignored by the WPT test helper.

Nesting and inheritance

We can organize tests by nesting test objects. A test object can contain child test objects (subtests) using tests field. The Keys of the tests value are the names of subtests, and values are test objects.

For example:

{
  "name": "Main test name",
  "importMapBaseURL": "https://example.com/import-map-base-url/index.html",
  "importMap": {
    "imports": {
      "a": "/mapped-a.mjs"
    }
  },
  "tests": {
    "Subtest1": {
      "baseURL": "https://example.com/base-url1/app.mjs",
      "expectedResults": { "a": "https://example.com/mapped-a.mjs" }
    },
    "Subtest2": {
      "baseURL": "https://example.com/base-url2/app.mjs",
      "expectedResults": { "b": null }
    }
  }
}

The top-level test object contains two sub test objects, named as Subtest1 and Subtest2, respectively.

Child test objects inherit fields from their parent test object. In the example above, the child test objects specifies baseURL fields, while they inherits other fields (e.g. importMapBaseURL) from the top-level test object.

TODO

The parsing-*.json files are not currently used by the WPT harness. We should convert them to resolution tests.