Tutorial Spec to Test

Tutorial: Spec to Test

Turn a markdown acceptance-criteria spec into running Playwright tests.

Deep: Tutorial 02 · Test Authoring.

1. Write a spec

Include a ## Acceptance Criteria section (bullets become requirements):

# Products page

## Acceptance Criteria

- Navigate to /products
- Page shows heading "Products"
- Schedule Demo button is visible

Example in-repo: prompts/examples/vm-create.md.

2. Generate only

zyvor-qa generate --spec path/to/feature.md
cat tests/fixtures/requirements.json   # parser output
ls tests/generated/

• No LLM → rule-based / template generation
• With LLM_PROVIDER + key → freer prose + richer TypeScript (quality gate falls back to Jinja if LLM output is bad)

3. Full pipeline

zyvor-qa run --source local --spec path/to/feature.md
open reports/qa-summary.html

Exit code is non-zero on failure (CI-safe).

4. Promote keepers

Move stable specs from tests/generated/ → tests/manual/ so they always run with zyvor-qa test.

Next

Natural Language Tests · GitHub Integration · Notifications and Reports