Skip to content

Evaluate design against an unrelated-lineage test corpus before freezing #23

Description

@lann

Both systems the design has been checked against share one lineage (webcrypto's conformance system forked from webrtc-datachannels' suite), and this contract was synthesized from webcrypto's — so within-family agreement is weak evidence (inheritance, possibly inertia). Independent support so far: external framework precedent (pytest/libtest-mimic/JUnit/NUnit/Go conventions), CM ABI constraints, prototype findings.

Before 0.1.0 freezes the remaining surfaces (L1 is close; L4 schema next), evaluate against at least one corpus with no shared ancestry. Candidates:

  • WPT: harness conventions, testharness.js statuses (incl. its timeout/notrun vocabulary), expectation files at Chromium/Firefox scale — stresses the L4 vocabulary and ratchet design.
  • go test: the test2json protocol as a results-format precedent; subtests (t.Run) stress the flat-case-list assumption; t.Parallel stresses the concurrency declaration model.
  • LLVM lit: substitution/parameterization model stresses ids-encode-parameters; REQUIRES/UNSUPPORTED/XFAIL directives are a mature, unrelated feature-mark precedent (closest external analog to /! marks).

Output: a gap list in the same form as the webrtc evaluation, before the results-schema design starts.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions