What's New
New Features
- Direct Semantic Entropy estimation (#418)
- BoostedProb uncertainty method (#417)
- APIWithUncertainty wrapper for OpenAI-compatible APIs (#439)
- VLLMWithUncertainty wrapper and logprobs calculator (#438)
- Raw input column support for custom datasets (#390)
- Multimodal model support for attention-based estimators (#435)
Bug Fixes
- Fix bfloat16 model loading (#410)
- Fix Focus IDF dataset (switched to RedPajama-V2, configurable text column) (#447)
- Fix vLLM sampling params mutation (#450)
- Fix vLLM logits orientation for P(True) (#449)
- Fix Kernel Language Entropy: Laplacian and semantic weight scaling (#451)
- Fix Semantic Entropy and KLE stability (#426)
- Fix hydra.run.dir model path (#427)
Dependencies
- Relaxed transformers and datasets version bounds (#440)
- transformers 5.x compatibility (#446)
- unbabel-comet moved to optional extra (#446)
- Bumped minimum Python to 3.12 (#415)
Docs
- Added architecture design page to documentation (#348)
New Contributors
Full Changelog: v0.5.0...v0.6.0
Contributors
vndee, AyseAsude, and 2 other contributors