evalharness

Test your prompts, agents, and RAG pipelines — red teaming, regression testing, and CI/CD for AI

Install

npm install

Quick Start

import { Evalharness } from "./evalharness";
const instance = new Evalharness()
const r = await instance.runtest({ input: 'test' })

CLI

npx tsx src/cli.ts status
npx tsx src/cli.ts run --input "data"

API

Method	Description
runtest()	Runtest
assertcontains()	Assertcontains
assertsemantic()	Assertsemantic
redteam()	Redteam
generatereport()	Generatereport
comparemodels()	Comparemodels

Test

npx vitest

License

(c) 2026 Officethree Technologies. All Rights Reserved.