🐢 Open-Source Evaluation & Testing for LLMs and ML models
-
Updated
May 17, 2024 - Python
🐢 Open-Source Evaluation & Testing for LLMs and ML models
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
A Python package to assess and improve fairness of machine learning models.
WEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!
Toolkit for Auditing and Mitigating Bias and Fairness of Machine Learning Systems 🔎🤖🧰
Fairness Aware Machine Learning. Bias detection and mitigation for datasets and models.
PyTorch package to train and audit ML models for Individual Fairness
[ACL 2020] Towards Debiasing Sentence Representations
👋 Influenciae is a Tensorflow Toolbox for Influence Functions
[ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models
Credo AI Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central gateway to assessments created in the open source community.
[ICMLA 2021] Jurity: Fairness & Evaluation Library
Counterfactual Local Explanations of AI systems
A tool for gender bias identification in text. Part of Microsoft's Responsible AI toolbox.
SIREN: A Simulation Framework for Understanding the Effects of Recommender Systems in Online News Environments
Package for evaluating the performance of methods which aim to increase fairness, accountability and/or transparency
Open-source toolkit to help companies implement responsible AI workflows.
A fairness library in PyTorch.
FairBatch: Batch Selection for Model Fairness (ICLR 2021)
Add a description, image, and links to the fairness-ai topic page so that developers can more easily learn about it.
To associate your repository with the fairness-ai topic, visit your repo's landing page and select "manage topics."