Skip to content

Releases: AhaSignals/pit-backtest-validation-benchmark

AhaSignals Financial AI Point-in-Time Integrity Benchmark — v1.1.0

Choose a tag to compare

@AhaSignals AhaSignals released this 04 Sep 00:44

What changed

Version 1.1 preserves the five frozen v1.0 compatibility cases and adds three BigBear.ai cases covering the complete knowledge-state transition: previously reported, withdrawn from reliance, and restated.

  • 8 accession-aware PIT cases
  • 2 evaluation tracks: evidence-restricted retrieval and knowledge-contamination control
  • 16 machine-readable prompts and reference responses
  • required abstention during the BigBear.ai non-reliance interval
  • deterministic scorer with a temporal-integrity hard-failure rule
  • byte-identity checks for every frozen v1.0 artifact

The bundled reference fixture passes 16/16 responses. The deliberate future-value leak in the adversarial fixture is rejected. These results validate the fixtures and scorer; they are not a result for any third-party model or investment strategy.

Permanent citation and audit paths

Exact archive

ahasignals-pit-backtest-validation-benchmark-v1.1.0.zip

SHA-256: a7c755dee3b7b800505274f6c680075dd856196d6c02775462a4ac874187bc85

Interpretation boundary

This benchmark evaluates data-time integrity. It does not establish factor alpha, information coefficient, portfolio return, Sharpe ratio, drawdown or general model intelligence. Research and education only; not investment, trading, legal, accounting or tax advice.

AhaSignals Point-in-Time Backtest Validation Benchmark — v1.0.0

Choose a tag to compare

@AhaSignals AhaSignals released this 03 Sep 00:34

Version 1.0.0 freezes five source-dated reference cases for detecting common point-in-time failures in SEC-filing backtests.

Included cases

  • AS-PIT-001 — blocks a later comparative value from overwriting the first-reported CoreWeave value.
  • AS-PIT-002 — prevents a later sign change from leaking into an earlier information set.
  • AS-PIT-003 — preserves Super Micro preliminary evidence as ineligible for the completed-filing matrix.
  • AS-PIT-004 — records an evidence and comparability upgrade even when the derived value is unchanged.
  • AS-PIT-005 — rejects a synchronized-quarter rank when NVIDIA and AMD fiscal period ends differ.

Reference result

  • 5 of 5 cases passed
  • 28 CoreWeave source vintages across 14 matched fact identities
  • Benchmark payload SHA-256: b22aa620b67838f3fb21cdaf4a947c69d93b7e7ad71e5b653e18855625a5e5a4
  • Release ZIP SHA-256: dc90b937e9ae0460518e52c772e5ca0b1f06fac05b47bbeb81da794070881b80

Run the dependency-free verifier with:

npm test

Research objects

This release tests data integrity. It does not establish factor alpha, information coefficient, portfolio return, Sharpe ratio or drawdown.
ahasignals-pit-backtest-validation-benchmark-v1.0.0.zip
ahasignals-pit-backtest-validation-benchmark-v1.0.0.zip.sha256.txt