Measures whether LLM agents remain internally consistent when temporal context is manipulated.
Standalone extraction of genesis-mssc's
(P49) mssc.tip module — TIP is the only external instrument that can
falsify Ρ_sem from scope-resilience (P41).
TIP perturbs the temporal structure of an agent's context in three ways (all deterministic given a seed):
- shuffle: chronological order randomised, timestamps left intact
- gap: a contiguous block of history silently removed, no gap announced
- contradict: specific facts replaced with contradictory variants
It then measures whether the agent's outputs remain structurally coherent despite the perturbation — self-reference inconsistencies, contradiction rate, recovery rate, and orientation latency. No claims about internal states — observable text behaviour only. See epistemic_status.md and docs/epistemic_boundaries.md for the full methodology and governance policy.
Not yet on PyPI — install from source:
git clone https://github.com/GenesisAeon/genesis-tip.git
cd genesis-tip
pip install -e ".[dev]"from genesis_tip import TemporalIntegrityProbe
tip = TemporalIntegrityProbe(perturbation_mode="shuffle")
result = tip.run_cycle()
print(f"Consistency score: {result['consistency_score']:.3f}")
print(f"Gate status: {result['gate_status']}")consistency_score is a derived composite for Diamond Interface
compatibility, not itself a pre-registered metric — the pre-registered
test is the Spearman Ρ_sem correlation in falsification.py, run
separately once real scope-resilience Ρ_sem values exist alongside real
TIP scores (see run_rho_sem_correlation_test).
To evaluate a real agent, pass a real agent_fn — by default,
TemporalIntegrityProbe uses a deterministic dummy stand-in so
run_cycle() is exercisable offline/in CI without network access:
def my_agent(messages: list[dict[str, str]]) -> str:
# wrap a real LLM call here
...
tip = TemporalIntegrityProbe(agent_fn=my_agent)See epistemic_status.md for the full statement. Summary:
| Constant | Value | Meaning |
|---|---|---|
| RHO_SEM_FALSIFICATION_THRESHOLD | 0.3 | Minimum Spearman ρ |
| RHO_SEM_MIN_SAMPLE_SIZE | 30 | Minimum path-perturbation pairs |
Falsified if: Spearman ρ < 0.3 at n ≥ 30 pairs.
Supported if: Spearman ρ ≥ 0.3 at n ≥ 30 pairs.
Both outcomes are valid scientific results. This package does not adjust
thresholds to make a hypothesis pass.
Pre-registration anchor: commit 1cf1730 (multi-scale-somatic-coherence, 2026-07-15).
genesis_tip/
├── harness/session_runner.py # dense/sparse/fragmented session builder
├── manipulations/ # temporal_shuffle, gap_injection, contradiction_injection
├── metrics/consistency_scorer.py # self-reference/contradiction/recovery/orientation-latency scoring
├── report/tip_report_template.py # Markdown comparison report
├── crep_gate.py # P50's own gate (blocked/pending_review/passed)
├── falsification.py # the pre-registered Spearman ρ_sem test
├── system.py # TemporalIntegrityProbe — Diamond Interface
└── docs/epistemic_boundaries.md # governance: what TIP does/doesn't claim
- P50 in the GenesisAeon ecosystem registry — LLM-evaluation domain.
- Sibling to genesis-mssc (P49), which shares TIP's underlying formalism (coherence under perturbation) but measures an entirely different system (biological EEG/ECG, not LLM text output) — results are not comparable between the two.
- Implements the standard 5-method Diamond Interface plus the optional
6th method
get_resilience_state()— currently returning{"rho": None, "implemented": False}untilCREPGateStatusreachespending_review(seecrep_gate.py). - Diamond Interface milestone: once TIP produces Γ_somatic, it becomes a full Diamond Interface candidate.
MIT — see LICENSE.
See CITATION.cff / .zenodo.json.