Skip to content

v9.1.0 - Comprehensive Validation for Epic Workflows

Choose a tag to compare

View all tags
@marcusgoll marcusgoll released this 21 Nov 00:19
· 137 commits to main since this release
v9.1.0
c749505

✨ Added

Comprehensive Validation for Epic Workflows

  • E2E Test Generation in /tasks phase:

    • Auto-generates ≥3 critical user journey tests from spec.md user stories
    • Creates e2e-tests.md with complete workflows (start → finish)
    • Includes external integration testing (APIs, CLIs, webhooks)
    • Adds E2E test tasks to tasks.md (P1 priority)
    • Production system verification (GitHub commits, DB records, notifications)

  • 10 Parallel Quality Gates in /optimize phase (expanded from 6):

    • Gate 7 - E2E Testing (Epic workflows):

      • Validates complete user workflows end-to-end
      • Tests external integrations (GitHub CLI, APIs)
      • Verifies outcomes in production systems
      • Auto-retry: restart-services, check-ports, re-run-flaky-tests

    • Gate 8 - Contract Validation (Epic workflows):

      • Validates all API contracts (OpenAPI 3.0) are implemented
      • Checks contract compliance (endpoints, request/response schemas)
      • Runs Pact CDC tests if present
      • Detects contract drift and breaking changes
      • Auto-retry: regenerate-schemas, sync-contracts, re-run-contract-tests

    • Gate 9 - Load Testing (Epic workflows, optional):

      • Performance validation under production-like load
      • Default: 100 VUs, 30s duration
      • Checks p95 latency, error rate < 1%, throughput targets
      • Only runs if plan.md mentions "load test" or "concurrent users"
      • Auto-retry: warm-up-services, scale-up-resources, optimize-db-connections

    • Gate 10 - Migration Integrity (Epic workflows):

      • Data integrity validation during migrations (up/down)
      • Checks for data corruption, orphaned records, FK violations
      • Validates rollback safety (data fully restored)
      • Captures checksums before/after migrations
      • Auto-retry: reset-test-db, re-run-migration, fix-seed-data

  • Auto-Retry Intelligence:

    • Failure classification: CRITICAL (block immediately) vs FIXABLE (auto-retry)
    • Progressive delays: 5s, 10s, 15s between retry attempts
    • Max 3 retry attempts per gate
    • 10+ fix strategies across all gates
    • Transparent logging of retry attempts

  • Validation Report Templates:

    • e2e-tests-template.md - User journey structure with Given/When/Then
    • contract-validation-report-template.md - Compliance matrix, drift detection
    • load-test-report-template.md - Performance metrics (p50, p95, p99, bottlenecks)
    • migration-integrity-report-template.md - Data integrity checks, rollback safety

🔧 Changed

  • /optimize expanded from 6 to 10 parallel quality gates (67% increase)
  • Enhanced validation only runs for epic workflows (feature workflows unchanged)
  • Auto-retry logic applies to all 10 gates (not just implementation phase)
  • Documentation updated with new artifacts and gate descriptions

📈 Impact

Quality Improvements (expected):

  • ↑ 90% reduction in integration bugs (E2E catches early)
  • ↑ 100% contract compliance (all APIs validated before deployment)
  • ↑ 80% reduction in performance regressions (load testing catches slowdowns)
  • ↑ 95% reduction in data corruption bugs (migration integrity checks)
  • ↓ 60% reduction in false-positive failures (auto-retry handles transient issues)

Validation Philosophy:

  • Test complete user workflows (not just internal APIs)
  • Validate external integrations (CLIs, APIs, webhooks)
  • Verify outcomes in production systems (DB, commits, notifications)
  • Use Docker for isolated, reproducible testing
  • Auto-retry transient failures, block critical issues

📦 Installation

```bash
npm install -g spec-flow@9.1.0
```

Full Changelog: v9.0.0...v9.1.0

Assets 2
Loading