Skip to content

Length penalty in FActScore, abstain detection customization, bug fixes
Compare
Choose a tag to compare
@martiansideofthemoon martiansideofthemoon released this 27 Jun 14:39
· 10 commits to main since this release
v0.1.7
dc5fee4

This update adds a few new important features to our PIP package (thanks again to our beta users!):

  • (#21) To penalize very short generations, we have added a length penalty similar to the BLEU scores. This is enabled by default and can be customized using the --gamma flag. See here for more details.
  • (#20) Users can now customize their abstain detection workflow using the --abstain_detection flag. We have added two abstain detection functions (generic, perplexity_ai), but disabled them by default. See here for more details.
  • (d768d81) bug fixes in custom corpus retrieval
Assets 2
Loading