v1.0.0 — experiment lab

Release v1.0.0 — experiment lab

Date: 2026-08-14
Hosted: https://pax-agentic-rag.vercel.app · Vercel project pax-agentic-rag only
Baseline season doc: docs/SEASON.md

Summary

P2 graduates from a bounded research demo to a free-path experiment lab: experiment
records, n≥40 control goldens with difficulty predicates, three tools with per-tool budgets,
payload experiment packs, honest load numbers, and a CASESTUDY that states what is still
PLANNED.

Added

• ExperimentRecord (id, seed, budget, note ids, stop reason, pack hash, tool calls)
• Golden control set 48 cases (was 18), including tool_budget and more unanswerable /
  thin / budget slices; critic-notes-exist-not-success still refuses
• Third tool: fixture lexicon lookup; per-tool max_calls in state; stop reason
  tool_budget_spent (ADR-0006)
• Experiment pack: policy + two run payloads + compare + experiments + pack_hash
  (POST /v1/experiments/pack, /pack UI, directory/zip round-trip tests)
• Load artifact: docs/assets/load.json (n=50 free-path researches, p50/p95, cold start)
• Optional max_tool_calls on research request (OpenAPI)

Still PLANNED (honest)

• Durable multi-instance run storage (DB / object store)
• Live web tools or default paid LLM planner/critic
• Hosted HTTP-P1 without captain-configured PRODUCTION_RAG_URL
• Tier-2 quality judges in CI
• Production capacity claims from single-process load.json
• Agent plugin marketplace / unrestricted tool registry
• Second Vercel project

Hosted contract

• Project: pax-agentic-rag · URL: https://pax-agentic-rag.vercel.app
• Never production-rag.vercel.app (Ipsura)
• Fixture retriever default; HTTP P1 opt-in; CI offline
• Smoke: pwsh scripts/hosted_smoke.ps1

Verify

pytest -q
python -m agentic_rag.evals.run
python scripts/load_fake_research.py --n 50
pwsh scripts/hosted_smoke.ps1