Skip to content

v1.1.0

Choose a tag to compare

View all tags
@anulum anulum released this 26 Feb 22:33
· 3061 commits to main since this release
v1.1.0
5808eba

What's New

Pluggable NLI Backends

  • NLIScorer(backend="minicheck") — MiniCheck-DeBERTa-L as alternative to default DeBERTa
  • Graceful fallback to heuristic when backend package not installed

Native LLM Providers

  • CoherenceAgent(provider="openai") — reads OPENAI_API_KEY from env
  • CoherenceAgent(provider="anthropic") — reads ANTHROPIC_API_KEY from env
  • Backward-compatible: llm_api_url= and default mock still work

CLI Benchmark Runner

  • director-ai eval --dataset aggrefact --max-samples 100 --output results.json
  • Delegates to benchmark suite with comparison table output

Streaming Halt Callbacks

  • StreamingKernel(on_halt=callback) — fires with StreamSession on halt
  • SafetyKernel(on_halt=callback) — fires with score on halt

SQLite Usage Dashboard

  • GET /v1/stats — summary statistics
  • GET /v1/stats/hourly — hourly breakdown
  • GET /v1/dashboard — inline HTML dashboard
  • Auto-records all reviews via the API server

Fixes

  • CI type check now excludes benchmarks directory from mypy
  • Docs workflow no longer requires deleted [research] extra

Full Changelog: v1.0.0...v1.1.0

Assets 2
Loading