Skip to content

v0.7.0 - Relevance Expansion

Choose a tag to compare

@yafitzdev yafitzdev released this 02 Feb 09:14
· 112 commits to main since this release

FITZ-GOV v0.7.0 - Relevance Expansion

Expands relevance category from 5 to 25 test cases.

Changes

  • Relevance: 5 → 25 cases (10 subcategories)
    • feature_dump (3)
    • metric_avoidance (3)
    • status_dump (3)
    • symptom_only (3)
    • instruction_only (2)
    • tangent_drift (3)
    • partial_answer (3)
    • wrong_entity_focus (2)
    • temporal_mismatch (2)
    • scope_mismatch (1)
  • Corpus: 233 → 258 documents (+25)

Progress

Category Status
Abstention 40/40 ✓
Dispute 40/40 ✓
Qualification 40/40 ✓
Grounding 25/25 ✓
Relevance 25/25 ✓
Confidence 10/30
Total 180/200 (90%)