rag-ops-console v0.1.0

Online RAG Ops console with Chroma VectorDB and LangGraph 5 nodes — monitor retrieval quality with RAGAS and Sheets feedback loop in production.

Disclaimer: Not an official product. Not affiliated with RAG vendors.

Links

• Repository: https://github.com/ianlyoo/rag-ops-console
• Pages (docs): https://ianlyoo.github.io/rag-ops-console/
• SDK: Python graph + rag + monitor (rag/vector_store.py, graph/nodes.py, eval/ragas_eval.py)
• API: python -m eval.ragas_eval / python -m graph.run

What is this

TypeScript + Python package rag-ops-console@0.1.0 (MIT) — online RAG ops console with Chroma VectorDB, LangGraph 5 nodes (retrieve→grade→rewrite→generate→human review), RAGAS deterministic proxy, and Sheets feedback loop. Consumes llm-eval-pipeline synthetic contract without copying offline code.

Qualified benchmark — provider-reported deterministic proxy only

Qualified evidence only. No cost, invoice, or savings claim is made.

Measured Deterministic metrics (token overlap, 50 samples, no answer_relevancy):

• context precision 0.42
• context recall 0.627
• faithfulness 0.9953

Source: out/ragas_result.json via python -m eval.ragas_eval. LLM-backed ragas.evaluate() comparison requires credentials and is not part of committed aggregate.

Limitations — read with results

• Synthetic corpus, synthetic seed 42 deterministic; token-overlap proxy not LLM evaluator; one run per condition; 50 samples; answer relevancy not implemented.
• Optional LLM-backed ragas requires credentials; retrieval faithfulness can be 1.0 on wrong document — pipeline tracks relevance separately.
• No invoice, no dollar cost, no savings claim; policy may change — measure your own workload.

Install from GitHub Release tarball (no npm registry)

rag-ops-console is not published to npm. npm view rag-ops-console remains E404. Install from the attached tarball.

Via gh (recommended):

gh release download v0.1.0 --pattern "*.tgz" --repo ianlyoo/rag-ops-console
npm install ./rag-ops-console-0.1.0.tgz

Verify checksum:

# SHA256SUMS is attached to the release (Windows: use node)
# node -e "const c=require('crypto'),f=require('fs');const h=c.createHash('sha256').update(f.readFileSync('rag-ops-console-0.1.0.tgz')).digest('hex');const e=f.readFileSync('SHA256SUMS','utf8').split(' ')[0];console.log(h===e?'OK':'FAIL',h)"

Verification

• git tag -a v0.1.0 annotated tag on verified main commit
• GH Release v0.1.0 with 2 assets (rag-ops-console-0.1.0.tgz + SHA256SUMS)
• npm view rag-ops-console remains E404
• Pages: https://ianlyoo.github.io/rag-ops-console/ (built, canonical/OG/JSON-LD verified)

License

MIT — see LICENSE.

---

Evidence produced offline on 2026-08-26; re-verify with python -m eval.ragas_eval. Tag v0.1.0 is an annotated tag pointing to the verified main commit.