rag-evaluation

Here are 27 public repositories matching this topic...

Giskard-AI / giskard-oss

🐢 Open-Source Evaluation & Testing library for LLM Agents

ai-security mlops fairness-ai responsible-ai ml-validation red-team-tools trustworthy-ai ml-testing llm ai-red-team ai-testing llmops llm-security llm-eval llm-evaluation rag-evaluation agent-evaluation

Updated Sep 2, 2025
Python

Marker-Inc-Korea / AutoRAG

Star

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

python open-source qa benchmarking ops pipeline analysis optimization evaluation embeddings automl document-parser rag llm retrieval-augmented-generation llm-ops llm-evaluation rag-evaluation

Updated Sep 1, 2025
Python

Agenta-AI / agenta

Star

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

prompt-engineering prompt-management llm-tools llm-framework llm-playground llm-platform llm-evaluation rag-evaluation llm-monitoring llm-as-a-judge llm-observability llmops-platform

Updated Sep 2, 2025
Python

frutik / Awesome-RAG

Star

rag rag-implementation rag-evaluation

Updated Sep 9, 2024

vectara / open-rag-eval

Star

Open source RAG evaluation package

metrics evaluation-metrics rag vectara retrieval-augmented-generation rag-evaluation

Updated Aug 19, 2025
Python

LLAMATOR-Core / llamator

Star

Framework for testing vulnerabilities of large language models (LLM).

Updated Aug 20, 2025
Python

mts-ai / rurage

Star

information-retrieval question-answering rag llm-evaluation rag-evaluation

Updated Apr 14, 2025
Python

oztrkoguz / RAG-Framework-Evaluation

Star

This project aims to compare different Retrieval-Augmented Generation (RAG) frameworks in terms of speed and performance.

swarms autogen rag langchain llamaindex rag-evaluation crewai langchain-rag autogen-rag crewai-rag llamaindex-rag swarms-rag

Updated Jul 28, 2024
Python

ioannis-papadimitriou / rag-playground

Star

A framework for systematic evaluation of retrieval strategies and prompt engineering in RAG systems, featuring an interactive chat interface for document analysis.

chatbot qa-generation llm-inference retrieval-augmented-generation rag-evaluation

Updated Dec 18, 2024
Python

rostyslavshovak / RAG-Retrieval-Augmented-Generation

Star

RAG Chatbot for Financial Analysis

open-source pdf rag gradio-interface langchain qdrant-vector-database retrieval-augmented-generation rag-evaluation

Updated Mar 9, 2025
Python

simranjeet97 / Learn_RAG_from_Scratch_LLM

Star

Learn Retrieval-Augmented Generation (RAG) from Scratch using LLMs from Hugging Face and Langchain or Python

artificial-intelligence rag datascience-machinelearning generative-ai llm-training retrieval-augmented-generation rag-model llm-framework llm-apps llm-evaluation genai-usecase rag-implementation rag-evaluation rag-embeddings rag-pipeline rag-llm rag-chatbot rag-application genai-domain

Updated Jan 20, 2025
Jupyter Notebook

shaadclt / EvalRAG

Sponsor

Star

A comprehensive evaluation toolkit for assessing Retrieval-Augmented Generation (RAG) outputs using linguistic, semantic, and fairness metrics

rag rag-evaluation

Updated Apr 19, 2025
Python

fkapsahili / EntRAG

Star

EntRAG - Enterprise RAG Benchmark

benchmark evaluations retrieval evaluation dataset knowledge-graph rag llm generative-ai retrieval-augmented-generation llm-evaluation rag-evaluation

Updated Jun 10, 2025
Python

BetterRAG: Powerful RAG evaluation toolkit for LLMs. Measure, analyze, and optimize how your AI processes text chunks with precision metrics. Perfect for RAG systems, document processing, and embedding quality assessment.

optimization evaluation embeddings evaluation-framework rag embeddings-extraction rag-evaluation rag-application rag-optimization chunking-optimization embeddings-optimization

Updated Mar 26, 2025
Python

sprakash21 / aws-genai-rageval-bot

Star

RAG Pipeline Evaluation and monitoring on AWS using RAGAS

monitoring rag-evaluation genai-chatbot ragas

Updated Oct 16, 2024
Python

AnasAber / MLflow_with_RAG

Star

Using MLflow to deploy your RAG pipeline, using LLamaIndex, Langchain and Ollama/HuggingfaceLLMs/Groq

deployment cicd evaluation-metrics rag mlops mlflow mlflow-tracking-server mlflow-tracking mlflow-projects mlflow-ui mlops-template mlops-project llamaindex rag-evaluation rag-pipeline llamaindex-rag mlflow-deployement

Updated Jan 20, 2025
Python

264Gaurav / medical-RAG-chatbot

Star

A LangChain-based Retrieval-Augmented Generation (RAG) chatbot for medical data. Integrates with Gemini/Grok AI to deliver accurate, context-aware answers in healthcare and biomedical domains.

debugging data-visualization nomic evaluation-metrics dvc rag mlflow experiment-tracking vector-database langchain llmops dagshub ollama langsmith pineconedb rag-evaluation ragas rag-chatbot ragas-evaluation

Updated Sep 2, 2025
Jupyter Notebook

TajaKuzman / pandachat-rag-benchmark

Star

PandaChat-RAG benchmark for evaluation of RAG systems on a non-synthetic Slovenian test dataset.

retrieval embedding-models slovenian rag slovenian-language test-dataset llm retrieval-augmented-generation rag-evaluation slovenian-language-dataset

Updated Dec 15, 2024
Python

OranDanon / Gen-AI-Assignment

Star

Home assignment featuring two AI projects: a Medical Q&A Bot for Israeli HMOs and a National Insurance Form Extractor. Built with Azure OpenAI to demonstrate practical GenAI implementation skills.

azure-ai generative-ai rag-evaluation rag-chatbot azure-document-intelligence-ocr

Updated Apr 8, 2025
Python

igorsuhinin / rag-pdf-qa

Star

RAG-powered PDF QA system with self-reflection and multiple retrieval strategies (Stuff/Map Reduce/Refine). Includes monitoring via Langfuse & LangSmith and containerization with Docker

python ai rag openai-api ai-agent langchain chromadb langfuse rag-evaluation rag-application tavily-search

Updated Jul 7, 2025
Python

Improve this page

Add a description, image, and links to the rag-evaluation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the rag-evaluation topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

rag-evaluation

Here are 27 public repositories matching this topic...

Giskard-AI / giskard-oss

Marker-Inc-Korea / AutoRAG

Agenta-AI / agenta

frutik / Awesome-RAG

vectara / open-rag-eval

LLAMATOR-Core / llamator

mts-ai / rurage

oztrkoguz / RAG-Framework-Evaluation

ioannis-papadimitriou / rag-playground

rostyslavshovak / RAG-Retrieval-Augmented-Generation

simranjeet97 / Learn_RAG_from_Scratch_LLM

shaadclt / EvalRAG

fkapsahili / EntRAG

Kaos599 / BetterRAG

sprakash21 / aws-genai-rageval-bot

AnasAber / MLflow_with_RAG

264Gaurav / medical-RAG-chatbot

TajaKuzman / pandachat-rag-benchmark

OranDanon / Gen-AI-Assignment

igorsuhinin / rag-pdf-qa

Improve this page

Add this topic to your repo