Skip to content

v0.5.0
Compare
Choose a tag to compare
@yosukehigashi yosukehigashi released this 11 Mar 08:59
· 174 commits to main since this release
v0.5.0
f12ca5f
This commit was created on GitHub.com and signed with GitHub鈥檚 verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Breaking Changes

None

New Features

  • Launched LangCheck metrics for Chinese (langcheck.metrics.zh) 馃嚚馃嚦 - thanks @Vela-zz!
  • New Model Manager architecture to unify the management of local evaluation models - thanks @Vela-zz!
  • Update the default OpenAI embedding model to text-embedding-3-small - thanks @bioerrorlog!
  • New tutorial for LangCheckChat, a self-evaluating RAG application on LangCheck documentation

Bug Fixes and Improvements

  • Improvements to support for German (README, factual consistency benchmarking, OpenAI prompts in German) 馃嚛馃嚜 - thanks @ischender!
  • Improvements to the OpenAI-based metrics for Japanese
  • We now have pip install tests for different Python versions
  • nltk download will now only run when needed (as opposed to always running on import langcheck)
  • Add the tqdm progress bar to more metrics

Full Changelog: v0.4.0...v0.5.0

Contributors

ischender, bioerrorlog, and Vela-zz
Assets 2