The LLM Evaluation Framework
evaluation-metrics evaluation-framework llm-evaluation llm-evaluation-framework llm-evaluation-metrics
-
Updated
Jul 11, 2025 - Python
#
llm-evaluation-metrics
Here are 10 public repositories matching this topic...
The one-stop repository for large language model (LLM) unlearning. Supports TOFU, MUSE, WMDP, and many unlearning methods. All features: benchmarks, methods, evaluations, models etc. are easily extensible.
open-source benchmarks right-to-be-forgotten privacy-protection unlearning membership-inference-attacks membership-inference llms llm-privacy llm-unlearning llm-evaluation-metrics
-
Updated
Jun 30, 2025 - Python
LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
python ai artificial-intelligence bias fairness ai-safety fairness-testing bias-detection fairness-ai fairness-ml responsible-ai ethical-ai large-language-models llm llm-evaluation llm-evaluation-framework llm-evaluation-metrics
-
Updated
Jul 11, 2025 - Python
[ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
machine-learning explainable-ai llm llm-evaluation llm-evaluation-toolkit llm-evaluation-framework llm-evaluation-metrics acl2024
-
Updated
Jul 19, 2024 - Python
Multirun - Run a prompt against all, or some, of your models running on Ollama. Creates web pages with the output, performance statistics and model info. All in a single Bash shell script.
static-site-generator ai bash-script llm-eval ollama llm-evaluation ollama-interface ollama-app llm-evaluation-metrics ai-evaluation-tools
-
Updated
Jul 11, 2025 - Shell
Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.
workshop llm llms llmops llm-eval llm-test llm-evaluation-framework llm-evaluation-metrics llm-monitoring llm-testing llm-evals
-
Updated
May 6, 2025 - Jupyter Notebook
A set of auxiliary systems designed to provide a measure of estimated confidence for the outputs generated by Large Language Models.
dataset datasets llm llms llm-training llm-evaluation llms-reasoning llm-evaluation-toolkit llms-benchmarking llm-evaluation-framework llm-evaluation-metrics llms-efficency llms-evalution
-
Updated
May 25, 2025 - Python
In this we evaluate the LLM responses and find accuracy
-
Updated
Jul 8, 2025 - Python
This repo is for an streamlit application that provides a user-friendly interface for evaluating large language models (LLMs) using the beyondllm package.
-
Updated
Aug 29, 2024 - Python
Tools for systematic large language model evaluations
evaluation-metrics evaluation-framework llm llms llm-evaluation llm-evaluation-toolkit llm-evaluation-framework llm-evaluation-metrics llm-benchmarking
-
Updated
Jul 4, 2025 - Python
Improve this page
Add a description, image, and links to the llm-evaluation-metrics topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-evaluation-metrics topic, visit your repo's landing page and select "manage topics."