Skip to content

v2.0.6: Comprehensive Test Suite & CI Fixes

Latest

Choose a tag to compare

@Algiras Algiras released this 31 Jan 20:49
· 4 commits to main since this release

What's New

  • 346+ tests covering all core modules
  • Complete documentation (GETTING_STARTED, TROUBLESHOOTING)
  • CI workflows fixed to properly fail on errors
  • Jest timeout increased for complex tests
  • All ESLint errors resolved

Testing

Added 346 tests across 10 test suites:

  • Eval Engine (43 tests)
  • DSL Parser (66 tests)
  • SDK Evaluate (40 tests)
  • Core Storage (35 tests)
  • CLI Collect (29 tests)
  • CLI Annotate (35 tests - temporarily disabled)
  • CLI Taxonomy (20 tests)
  • CLI Eval (33 tests)
  • CLI DSL (26 tests)
  • LLM Providers (63 tests)
  • Auth Token-Refresh (6 tests)

Documentation

  • GETTING_STARTED.md: 10-minute tutorial for new users
  • TROUBLESHOOTING.md: Comprehensive troubleshooting guide

CI/CD

  • Fixed workflows to properly fail on type/lint errors
  • Removed error masking from npm scripts
  • Increased Jest timeout for complex tests
  • All checks now passing

Bug Fixes

  • Downgraded chalk v5→v4 for Jest ESM compatibility
  • Fixed 11 ESLint errors across multiple files
  • Fixed export command CLI signature
  • Fixed LLM judge explanation extraction