Skip to content

wasi:cli runner #3

Description

@lann

The reference runner: a component importing tests and exporting wasi:cli/run, composed with a suite via wac plug (this exists in prototype form in lann/wasi-test runner-cli/). Grow it toward libtest ergonomics:

  • --list (enumeration only — all() + getters, no run), name-substring filtering (--only earns its keep for bisection), fail-fast.
  • Human-readable progress on stderr.
  • Canonical results JSON (see the results-format issue) written via wasi:filesystem when the world provides it; stdout as fallback. Note the fragility lesson from webcrypto's composed driver: results-on-stdout works, but any stray print corrupts it — prefer the file path.
  • Exit status distinguishes harness errors from case failures (adapters exit nonzero on harness errors; case failures are the aggregator's business — but the standalone runner should also support a "gate directly" mode where any fail is nonzero).
  • Consider libtest-mimic-compatible output formats for tool familiarity.

Metadata

Metadata

Assignees

No one assigned

    Labels

    runnerComponents or hosts that execute suites

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions