User Story
As Maya, in order to verify the field mapping between the extracted spec and the source PDF's AcroForm fields was done correctly and compare how different models handle mapping, I want field-mapping variants to be selectable from Settings → Variants, with mapping-accuracy evaluation.
Preconditions
Acceptance Criteria
Success Metrics
- LLM-judge vs deterministic scorer deltas captured (demonstrates evaluation methodology affects measured performance)
- Ground-truth mappings committed for at least the three existing fixtures
Notes
- Mapping registry stub exists at
src/services/form-documents/mapping-registry.ts; extend it
- Field-mapping generation already occurs during extraction (see
src/services/form-documents/extraction.ts) — this story is about making the model swappable and evaluating
Definition of Done
User Story
As Maya, in order to verify the field mapping between the extracted spec and the source PDF's AcroForm fields was done correctly and compare how different models handle mapping, I want field-mapping variants to be selectable from Settings → Variants, with mapping-accuracy evaluation.
Preconditions
Acceptance Criteria
field-mappingscores spec-field → PDF-field matches against reviewed ground-truth mappings on the three fixtures (pardon, I-9, W-9)field-mapping/haiku,field-mapping/sonnet,field-mapping/opusforms/default/provenance.jsonunder"field-mapping"key<VariantBadge task="field-mapping" ...>rendered on the edit/review UI where the mapping is visiblecatalog/experiments/field-mapping/with_suite.md+ variant pages containing metrics (recall, precision, confidence)catalog/experiments/_roadmap.mdupdated with shipped status and one-line findingSuccess Metrics
Notes
src/services/form-documents/mapping-registry.ts; extend itsrc/services/form-documents/extraction.ts) — this story is about making the model swappable and evaluatingDefinition of Done