Repository navigation
Releases: AhaSignals/pit-backtest-validation-benchmark
Release list
AhaSignals Financial AI Point-in-Time Integrity Benchmark — v1.1.0
What changed
Version 1.1 preserves the five frozen v1.0 compatibility cases and adds three BigBear.ai cases covering the complete knowledge-state transition: previously reported, withdrawn from reliance, and restated.
- 8 accession-aware PIT cases
- 2 evaluation tracks: evidence-restricted retrieval and knowledge-contamination control
- 16 machine-readable prompts and reference responses
- required abstention during the BigBear.ai non-reliance interval
- deterministic scorer with a temporal-integrity hard-failure rule
- byte-identity checks for every frozen v1.0 artifact
The bundled reference fixture passes 16/16 responses. The deliberate future-value leak in the adversarial fixture is rejected. These results validate the fixtures and scorer; they are not a result for any third-party model or investment strategy.
Permanent citation and audit paths
- Frozen version DOI: https://doi.org/10.5281/zenodo.22289017
- All-versions concept DOI: https://doi.org/10.5281/zenodo.22279743
- Human-readable research explanation: https://ahasignals.com/research/point-in-time-backtest-validation-benchmark/
- GitHub is the public code, version and verification entry point.
- Zenodo is the permanent archive and canonical citation object.
Exact archive
ahasignals-pit-backtest-validation-benchmark-v1.1.0.zip
SHA-256: a7c755dee3b7b800505274f6c680075dd856196d6c02775462a4ac874187bc85
Interpretation boundary
This benchmark evaluates data-time integrity. It does not establish factor alpha, information coefficient, portfolio return, Sharpe ratio, drawdown or general model intelligence. Research and education only; not investment, trading, legal, accounting or tax advice.
AhaSignals Point-in-Time Backtest Validation Benchmark — v1.0.0
Version 1.0.0 freezes five source-dated reference cases for detecting common point-in-time failures in SEC-filing backtests.
Included cases
AS-PIT-001— blocks a later comparative value from overwriting the first-reported CoreWeave value.AS-PIT-002— prevents a later sign change from leaking into an earlier information set.AS-PIT-003— preserves Super Micro preliminary evidence as ineligible for the completed-filing matrix.AS-PIT-004— records an evidence and comparability upgrade even when the derived value is unchanged.AS-PIT-005— rejects a synchronized-quarter rank when NVIDIA and AMD fiscal period ends differ.
Reference result
- 5 of 5 cases passed
- 28 CoreWeave source vintages across 14 matched fact identities
- Benchmark payload SHA-256:
b22aa620b67838f3fb21cdaf4a947c69d93b7e7ad71e5b653e18855625a5e5a4 - Release ZIP SHA-256:
dc90b937e9ae0460518e52c772e5ca0b1f06fac05b47bbeb81da794070881b80
Run the dependency-free verifier with:
npm testResearch objects
This release tests data integrity. It does not establish factor alpha, information coefficient, portfolio return, Sharpe ratio or drawdown.
ahasignals-pit-backtest-validation-benchmark-v1.0.0.zip
ahasignals-pit-backtest-validation-benchmark-v1.0.0.zip.sha256.txt