Skip to content

Groundwork v0.1.0 — first public release

Choose a tag to compare

View all tags
@nickjlamb nickjlamb released this 03 Aug 16:31
· 14 commits to main since this release
v0.1.0
bafd977

The first public release of Groundwork — a deployment-readiness harness for document-QA AI systems, built for small teams with a working prototype and no ML engineer.

What's in 0.1.0

The harness. npx @pharmatools/groundwork init scaffolds ten files into your repo: a one-file adapter boundary to your system, a deterministic redaction pre-step (Redacta), a gold-set template with a labelling guide, a GitHub Action, and a playbook (GROUNDWORK.md) that walks a non-ML team from prototype to gated CI in an afternoon.

The checks. groundwork check runs a redaction self-test, then a grounding eval (OpenGATE): required facts present, every number traced to your documents, abstention on unanswerable questions. Deterministic — no LLM judge, no API key, same inputs same result. --baseline freezes a floor; --ci fails any run below it.

The costs. groundwork cost reads measured token usage from your eval runs and recommends savings in leverage order — prompt caching, batching, context trimming, and model routing last, re-verified through the gate.

Proof it works, offline. npm run demo runs the whole loop with no key; npm run demo:break flips the demo system into real failure modes — invented figures, missed abstentions — and the gate catches every one by name. CI asserts both behaviours on every push.

A real example. examples/claude-doc-qa wires the harness to a live Claude-backed system: answer-from-document-only prompting, prompt caching, key-gated evals, a mock API so the full loop runs in CI, and real usage feeding groundwork cost.

Install

npm install -D @pharmatools/groundwork
npx groundwork init

Docs: Getting started · Website: pharmatools.ai/groundwork

The honest paragraph

Groundwork is a strong floor, not a guarantee. It automates the checks that can be automated; it cannot certify an AI system safe, and it does not replace human review for answers that affect someone's health, money, legal standing, or safety. Keep a person in that loop.

Everything init scaffolds into your repo is MIT-0 — yours, no attribution needed. Groundwork itself is MIT.

Assets 2
Loading