Skip to content

v1.0.0 — free-path evaluation program + identity + failure injection

Latest

Choose a tag to compare

@pabloalvarez99 pabloalvarez99 released this 14 Aug 20:54
3b54d85

production-rag v1.0.0

Clone-only free-path flagship. Still $0. Still no Vercel. Never cite production-rag.vercel.app (Ipsura).

What shipped

  • Free-path eval program n=52 (golden-free-path.jsonl) with slices answerable / unanswerable / filter / hybrid-vs-dense
  • Difficulty predicates: CI fails if a ranking slice is all trivial rank-1
  • Scorecard HTML+JSON ablation dense/sparse/hybrid/hybrid_rerank labeled plumbing, billed=false
  • HTTP transcripts: grounded, refuse, title=Filtering, stream; failure path with CACHE_ENABLED=false
  • /v1/ready collection identity: embedder_id, chunker_version, doc_count, corpus_hash
  • Cache key includes corpus identity (no cross-hit); typed wrong_collection
  • Provider/store failures → 503 with refused: false (never soft refuse)
  • Local load harness: docs/assets/load.json (n=100, honest single-process note)
  • ADR-0014 corpus hash in cache key; CASESTUDY ≥1500 words

Still PLANNED

  • Auth / rate limit (P5)
  • Hosted Qdrant / multi-worker Redis cache
  • Hosted-provider quality baseline (billed run with named providers)
  • Public P1 host (will not ship; clone-only is intentional)

Verify

pip install -e ".[dev]"
pytest -q
python scripts/write_compose_transcripts.py
python scripts/run_load_local.py