leaf-eval-tools

Introduction

A project that provides eval tools that can be used by leaf-playground based projects.

Tools Introduction

• leaf_eval_tools.oai_eval_worker.OaiEvalWorker: using openai client to evaluate
• leaf_eval_tools.ragas_eval_worker.RagasEvalWorker: a wrapper to ragas.evaluate
• leaf_eval_tools.regex_answer_extractor.RegexAnswerExtractor: a helper to extract answers that match the specified patterns from text

Installation

pip install leaf-eval-toos

Usage

TBD;

Maintainers

@PanQiWei; @Pandazki.

Roadmap

TBD;