Repository navigation
Sentient-SDK v0.3.0
This major update introduces production-grade features for RAG evaluation, including parallel processing, streaming support, and observability.
New Features
- BatchRunner: Parallel evaluation of large datasets with summary reporting.
- StreamEvaluator: Incremental guard checks for streaming LLM responses.
- MetricsReporter: Aggregated metrics (latency, scores, pass rates) for monitoring.
- RegexGuard: Custom pattern matching for domain-specific safety rules.
- ToxicityGuard: Content safety integration via OpenAI Moderation API.
Improvements
- Expanded test suite to 109 passing tests.
- Improved TypeScript strict mode compatibility.
- Refactored internal orchestrator for better performance.
Installation
npm install sentient-sdk@0.3.0