Skip to content

P1: define explicit PoC success / failure criteria in Annex A payment schedule #158

@yohei1126

Description

@yohei1126

Context

Annex A Table A-2 states payment is contingent on delivery of a "working system and trial report — not on achieving a specific Precision@50 outcome." Without pass/fail criteria, disputes can arise at Week 7 about whether the PoC obligations are met.

Current state

"Working system" and "working trial report" are undefined. No sliding scale or remediation process is specified if Precision@50 comes in below target.

Required

Update Table A-2 to include explicit success criteria, for example:

Criterion Definition Consequence if not met
System deployed Pipeline runs at 15-min re-score cadence for 7 consecutive days without critical errors Extension agreed at no additional cost
Trial report delivered ≥10 pages: methodology, Precision@50, causal samples, unknown-unknown list, SAR demo Payment held until delivered
Precision@50 ≥ 0.55 At least 27 of top-50 ranked candidates are OFAC-listed Below 0.55: joint review; no payment adjustment for PoC
Deployment package Containerised docker-compose, deployment docs, API examples, sample watchlist Payment held until delivered

Acceptance criteria

  • Annex A Table A-2 defines "working system" with measurable criteria
  • Pass/fail threshold for each deliverable is explicit

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    Status

    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions