Skip to content

PrimeAIExplorer v2.0 Phase D3

Choose a tag to compare

@jinhualiaoGH jinhualiaoGH released this 01 Aug 11:59

PrimeAIExplorer v2.0 Phase D3

Phase D3 adds deterministic multi-provider benchmark campaigns.

Capabilities

  • Content-derived campaign identifiers
  • Deterministic campaign expansion
  • Dataset/provider/model/prompt/seed/window cross-products
  • Deterministic repeat dimensions
  • Provider and model parameter merging
  • Immutable work-item identifiers
  • SQLite campaign persistence
  • Idempotent campaign creation
  • Atomic next-item claiming
  • Resumable execution state
  • Attempt counting
  • Failure and retry handling
  • Experiment ID integration
  • D2 catalog-record integration
  • Progress summaries
  • Deterministic JSONL execution-plan exports

Validation

  • 6 Phase D3 tests passed
  • 262 total regression tests passed
  • Deterministic expansion verified
  • Idempotent creation verified
  • Resume and retry behavior verified
  • Deterministic export hashes verified