Skip to content

v0.10.0 — Phase 11: evaluation campaign + error attribution

Choose a tag to compare

View all tags
@cattolatte cattolatte released this 17 Jul 01:13
v0.10.0
5324c45

The definitive measured story of the whole system.

  • Error attribution (oracle-substitution): blame each wrong answer on the earliest pipeline stage (retrieval/rerank/generation/verification) an oracle repairs — the attribution pie.
  • PubMedQA headline scorer (yes/no/maybe accuracy).
  • docs/design/error-attribution.md (method + pending real results).

The real test-split campaign is run once, at the end, with all trained artifacts.

Assets 2
Loading