v0.8.1

This release adds initial support for human reviews. There are two metrics by default, is_readable and is_confabulation which can be annotated when a user reviews a response. During the analysis step, a threshold is selected which defines agreement for annotators. For example, if the is_readable threshold is 0.5 then at least half the annotators who have reviewed a particular response have to agree that the response is readable before marking it as readable on the aggregated metrics chart.

What's Changed

• get allowed hosts from environment by @pdeziel in #23
• parse list variables from environment by @pdeziel in #24
• add evaluation card by @pdeziel in #25
• add boolean agreement by @pdeziel in #26

Full Changelog: v0.7.0...v0.8.1