v0.12.0

Hotfix version bump of dependencies.

Full Changelog: v0.11.0...v0.12.0

v0.11.0

What's Changed

• Implement Kubernetes Probes by @bbengfort in #36

Full Changelog: v0.10.0...v0.11.0

v0.10.0

This version adds some qualitative metrics such as helpfuiness which is on a likert scale and adds some UI updates to the user review workflow and the evaluation bar charts.

What's Changed

• add qualitative metrics by @pdeziel in #32
• fix attribute references by @pdeziel in #33
• fix evaluation charts for unprocessed metrics by @pdeziel in #34

Full Changelog: v0.9.0...v0.10.0

v0.9.0

This release adds initial functionality for managing evaluations with the UI.

What's Changed

• evaluation management by @pdeziel in #29
• handle evaluation form errors by @pdeziel in #30

Full Changelog: v0.8.0...v0.9.0

v0.8.1

This release adds initial support for human reviews. There are two metrics by default, is_readable and is_confabulation which can be annotated when a user reviews a response. During the analysis step, a threshold is selected which defines agreement for annotators. For example, if the is_readable threshold is 0.5 then at least half the annotators who have reviewed a particular response have to agree that the response is readable before marking it as readable on the aggregated metrics chart.

What's Changed

• get allowed hosts from environment by @pdeziel in #23
• parse list variables from environment by @pdeziel in #24
• add evaluation card by @pdeziel in #25
• add boolean agreement by @pdeziel in #26

Full Changelog: v0.7.0...v0.8.1

v0.7.0

What's Changed

• Download Model Labels by @bbengfort in #22

Full Changelog: v0.6.0...v0.7.0

v0.6.0

What's Changed

• Bar Charts by @bbengfort in #21

Full Changelog: v0.5.0...v0.6.0

v0.5.0

What's Changed

• Minor Fixes by @bbengfort in #18
• Evaluate Model Responses by @bbengfort in #19
• Reset Migrations by @bbengfort in #20

Full Changelog: v0.4.0...v0.5.0

v0.4.0

What's Changed

• Prompt Detail by @bbengfort in #10
• Parley Model Refactor by @bbengfort in #11
• Evaluation Managment Signals by @bbengfort in #12
• Evaluations List and Prompts Download by @bbengfort in #13
• Fix Evaluation List by @bbengfort in #14
• Create Review Tasks by @bbengfort in #15
• Review Task Views by @bbengfort in #16
• Response Review Page by @bbengfort in #17

Full Changelog: v0.3.0...v0.4.0

v0.3.0

What's Changed

• Dashboard Info by @bbengfort in #8
• Profile Stubs by @bbengfort in #9

Full Changelog: v0.2.1...v0.3.0