Search results

LLMBasedFaithfulness fails when response cannot be split into score and reasoning

Status: Open.

#71 In relari-ai/continuous-eval;

· kelvinchanwh opened on Jun 11, 2024

LLMBasedFaithfulness does not work when using LLMs other than OpenAI

Status: Open.

#69 In relari-ai/continuous-eval;

· kelvinchanwh opened on Jun 11, 2024

Integration with DSPy

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

Status: Open.

#64 In relari-ai/continuous-eval;

· pantonante opened on May 21, 2024

Metadata comparison for retrieval metrics

enhancementNew feature or requestNew feature or request

Status: Open.

#54 In relari-ai/continuous-eval;

· yisz opened on Apr 1, 2024

Enhancement: Integration with LiteLLM

enhancementNew feature or requestNew feature or request

Status: Open.

#53 In relari-ai/continuous-eval;

· rachittshah opened on Mar 28, 2024

Highlight LLM Based Custom Metric in ReadMe and Docs

Status: Open.

#51 In relari-ai/continuous-eval;

· yisz opened on Mar 18, 2024

Handling context limit

Status: Open.

#50 In relari-ai/continuous-eval;

· yisz opened on Mar 18, 2024

Error handling for generation LLM metrics

bugSomething isn't workingSomething isn't working

Status: Open.

#19 In relari-ai/continuous-eval;

· yisz opened on Jan 31, 2024

Add BERT variations for faithfulness

enhancementNew feature or requestNew feature or request

Status: Open.

#5 In relari-ai/continuous-eval;

· yisz opened on Jan 3, 2024