Skip to content

v0.0.19

Choose a tag to compare

View all tags
@github-actions github-actions released this 20 May 17:47
· 120 commits to main since this release
v0.0.19
192a51f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • [docs] Small typo in qdrant example .md by @nerdai in #324
  • [Feature] Add base.evals module and BaseBenchmark BaseBenchmarker classes by @nerdai in #326
  • [Feature] Add ExactMatchEvaluationMetric by @nerdai in #333
  • Bump datasets from 3.1.0 to 3.6.0 in the all-python-packages group by @dependabot in #335
  • [Feature] Add HuggingFaceBenchmarkMixin and first HuggingFaceMMLU benchmark by @nerdai in #334
  • [Feature] Enable streaming for BaseBenchmark with .as_stream() and implement with HF mixin by @nerdai in #337
  • Add EvalsError and docs update by @nerdai in #339
  • [Fix] Fix codification of response in HuggingFaceMMLU benchmark. by @nerdai in #340
  • [fix] fix num_total_examples in Benchmarker by @nerdai in #342
  • [fix] Add num_examples abstract property to BaseBenchmark by @nerdai in #344
  • [docs] Notebook and quick start guide for running benchmarks by @nerdai in #343
  • [chore] Add example benchmarking nb to docs by @nerdai in #347
  • [docs] Add Qdrant example notebook by @nerdai in #349
  • [Feature] Add support for in-memory instances of Qdrant for QdrantKnowledgeStore by @nerdai in #350
  • [chore] Set WITH_DOCKER to True in qdrant cookbook by @nerdai in #351
  • [version] bump version to v0.0.19 by @nerdai in #352

Full Changelog: v0.0.18...v0.0.19

Contributors

dependabot and nerdai
Assets 2
Loading