UFO: a Unified and Flexible Framework for Evaluating Factuality of Large Language Models

Introduction

Official implementation of our proposed unified and flexible factuality evaluation pipeline.

For demonstration, we show 20 samples for each dataset and source LLMs in the directory generation/.

Getting Started

You can set up all libraries and dependencies by:

pip install -r requirements.txt

Run

You can adjust the parameters and run:

bash run.sh