InspectorRAGet, an introspection platform for RAG evaluation. InspectorRAGet allows the user to analyze aggregate and instance-level performance of RAG systems, using both human and algorithmic metrics as well as annotator quality.
InspectorRAGet is a a React web application built with NextJS 14 framework. We extensively use the Carbon Design System, an open-source design system with a wide range of assets including react and web components, styling guidelines, custom icons, and others
We use yarn as a default package manager.
yarn install20.12.0 or higher.
To start InspectorRAGet in development mode, please run the following command.
yarn devTo build a static production bundle, please run the following command.
yarn devTo start InspectorRAGet in production mode, please run the following command.
yarn startIf you use InspectorRAGet in your research, please cite our paper:
@misc{fadnis2024inspectorraget,
title={InspectorRAGet: An Introspection Platform for RAG Evaluation},
author={Kshitij Fadnis and Siva Sankalp Patel and Odellia Boni and Yannis Katsis and Sara Rosenthal and Benjamin Sznajder and Marina Danilevsky},
year={2024},
eprint={2404.17347},
archivePrefix={arXiv},
primaryClass={cs.SE}
}