Skip to content

Add SpecTest extension to community catalog#2159

Merged
mnriem merged 4 commits intogithub:mainfrom
Quratulain-bilal:feat/spectest-extension
Apr 10, 2026
Merged

Add SpecTest extension to community catalog#2159
mnriem merged 4 commits intogithub:mainfrom
Quratulain-bilal:feat/spectest-extension

Conversation

@Quratulain-bilal
Copy link
Copy Markdown
Contributor

Summary

Adds SpecTest — auto-generate test scaffolds from spec acceptance criteria, map requirement-level
coverage, find untested requirements, and produce structured test plans.

Extension repo: https://github.com/Quratulain-bilal/spec-kit-spectest

The Problem

Spec Kit produces detailed acceptance criteria, user scenarios, and success criteria — but testing is
completely manual. Developers write tests from memory instead of tracing back to spec requirements.
There's no way to measure "spec coverage" or find requirements that slipped through without any tests.

What SpecTest Does

4 commands that connect specs to tests:

Command Purpose
/speckit.test.generate Generate framework-native test scaffolds from spec acceptance criteria
/speckit.test.coverage Map spec requirements to test files with requirement-level coverage
/speckit.test.gaps Find untested requirements with severity ratings and suggestions
/speckit.test.plan Generate structured test plan with cases, priorities, and risk assessment

1 hook: after_implement (scan for untested requirements)

Why This Matters

Bridges the spec-to-test gap in the SDD workflow:
specify → plan → tasks → implement → SpecTest → tests ✅

  • Every acceptance criterion becomes a test case with Arrange-Act-Assert structure
  • Requirement-level coverage (not just line coverage) — measures what % of spec is tested
  • Framework-native: supports Jest, Vitest, pytest, Go test, JUnit, and more
  • Severity-rated gaps: Critical (security), Medium (user-facing), Low (internal)
  • Never overwrites existing tests — only creates scaffolds or reports gaps

Checklist

  • Extension repo published with v1.0.0 tag
  • extension.yml follows schema v1.0
  • Description under 100 characters (93)
  • Catalog entry alphabetically ordered (between speckit-utils and staff-review)
  • README row alphabetically ordered (between Spec Sync and Staff Review Extension)
  • updated_at bumped monotonically (2026-04-10T16:00:00Z > previous 2026-04-10T12:34:56Z)
  • JSON validated
  • All 4 command files match extension.yml references
  • README, CHANGELOG, LICENSE included

Adds spec-kit-spectest: auto-generate test scaffolds from spec criteria.

4 commands:
- /speckit.test.generate — generate framework-native test scaffolds
- /speckit.test.coverage — map spec requirements to test coverage
- /speckit.test.gaps — find untested requirements with suggestions
- /speckit.test.plan — generate structured test plan documents

1 hook: after_implement (gap detection)

Bridges the spec-to-test gap in the SDD workflow.
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds the community catalog/README entries for the new SpecTest extension so it can be discovered and installed via Spec Kit’s community extensions catalog.

Changes:

  • Add SpecTest row to the community extensions table in README.md.
  • Add spectest entry to extensions/catalog.community.json and bump the catalog updated_at.
Show a summary per file
File Description
README.md Adds SpecTest to the Community Extensions table.
extensions/catalog.community.json Adds the SpecTest catalog entry and updates top-level updated_at.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 2/2 changed files
  • Comments generated: 1

mnriem and others added 2 commits April 10, 2026 12:05
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…ot review

Set both to 2026-04-10T16:00:00Z instead of midnight.
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds the SpecTest community extension to Spec Kit’s community extension catalog, making it discoverable/installable via the standard catalog flow.

Changes:

  • Added a new spectest entry to extensions/catalog.community.json (including metadata, version, URLs, tags, and timestamps).
  • Added the SpecTest row to the Community Extensions table in the root README.md.
Show a summary per file
File Description
README.md Adds SpecTest to the Community Extensions table so users can find the extension.
extensions/catalog.community.json Registers the spectest extension in the community catalog and bumps top-level updated_at.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 2/2 changed files
  • Comments generated: 0 new

@mnriem mnriem merged commit f43b850 into github:main Apr 10, 2026
12 checks passed
@mnriem
Copy link
Copy Markdown
Collaborator

mnriem commented Apr 10, 2026

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants