A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

Curated list of open source tooling for data-centric AI on unstructured data.

Programming assignments and quizzes from all courses within the GANs specialization offered by deeplearning.ai

WEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!

To help public defenders better serve their clients, Open Sentencing shows racial bias in data such as demographics providing insights for each case

Solutions on Practical Data Science Specialization on Coursera (offered by deeplearning.ai)

Learning to Split for Automatic Bias Detection

Multi-Calibration & Multi-Accuracy Boosting for R

👚 Speedy Word Embedding Association Test & Extras using R

HonestyMeter: An NLP-powered framework for evaluating objectivity and bias in media content, detecting manipulative techniques, and providing actionable feedback.

Detection of propaganda or partisan allegiance in natural text.

Official code of "Discover and Mitigate Unknown Biases with Debiasing Alternate Networks" (ECCV 2022)

Tools for diagnostics and assessment of (machine learning) models

"Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color" (ICCV 2023)

Official code of "Discover the Unknown Biased Attribute of an Image Classifier" (ICCV 2021)

Examples of unfairness detection for a classification-based credit model

Code & Data for the paper "RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Models"

Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Models. Paper presented at MICCAI 2023 conference.

A curated list of Robust Machine Learning papers/articles and recent advancements.

Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.