Skip to content

[Testing] Final Verification Before Cutover #245

@itomek-amd

Description

@itomek-amd

Overview

Comprehensive verification that tests_v2/ has equivalent or better coverage than tests/ before CI cutover.

Scope

  • Compare test counts between old and new test structures
  • Verify all test behaviors are preserved
  • Document any intentionally removed tests
  • Generate coverage comparison report

Verification Steps

1. Test Count Comparison

# Count tests in old structure
pytest tests/ --collect-only -q | tail -1

# Count tests in new structure
pytest tests_v2/ --collect-only -q | tail -1

# Compare counts

2. Coverage Comparison

# Old structure coverage
pytest tests/ --cov=src/gaia --cov-report=term

# New structure coverage
pytest tests_v2/ --cov=src/gaia --cov-report=term

# Compare coverage percentages

3. Test Behavior Verification

  • All critical test behaviors preserved
  • No regressions introduced
  • Anti-patterns successfully removed (13 _TOOL_REGISTRY.clear() calls)
  • Hardcoded ports replaced with dynamic allocation

4. Documentation

Create verification report documenting:

  • Test count comparison (old vs new)
  • Coverage comparison (should be ≥ old coverage)
  • List of intentionally removed tests (if any)
  • Anti-patterns fixed

Acceptance Criteria

  • Test count verification complete: tests_v2/ has ≥ tests as tests/
  • Coverage verification: tests_v2/ coverage ≥ 15% (current target)
  • All anti-patterns documented as fixed
  • Verification report created
  • Both test suites pass: pytest tests/ -v and pytest tests_v2/ -v

Parent Issue

Part of #209 - Test Suite Overhaul Epic

Dependencies

Requires all migration issues (#239-244) to be completed first.

Metadata

Metadata

Labels

enhancementNew feature or requesttestsTest changes

Type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions