Skip to content
Code and data for the paper, "Automatically Neutralizing Subjective Bias in Text"
Python Jupyter Notebook Shell
Branch: master
Clone or download

Latest commit

Fetching latest commit…
Cannot retrieve the latest commit at this time.

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
baselines organizing for camera ready Nov 11, 2019
deprecated
harvest
src
.gitignore
README.md update link to paper to Arxiv URL from TODO Feb 10, 2020
__init__.py
firstpage.png
related_work.md Update related_work.md Jan 12, 2019
requirements.txt Update requirements.txt Nov 14, 2019

README.md

Neutralizing Biased Text

This repo contains code for the paper, "Automatically Neutralizing Subjective Bias in Text".

Concretely this means algorithms for

  • Identifying biased words in sentences.
  • Neutralizing bias in sentences.

firstpage

Installation

$ pip install -r requirements.txt
$ python
>> import nltk; nltk.download("punkt")

Data

Click this link to download (100MB, expands to 500MB).

Overview

harvest/: Code for making the dataset. It works by crawling and filtering Wikipedia for bias-driven edits.

src/: Code for training models and using trained models to run inference. The models implemented here are referred to as MODULAR and CONCURRENT in the paper.

Usage

Please see src/README.md for bias neutralization directions.

See harvest/README.md for making a new dataset (as opposed to downloading the one available above).

You can’t perform that action at this time.