Skip to content


Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?


Failed to load latest commit information.
Latest commit message
Commit time

Real Toxicity Prompts

[Paper link] [Demo link] [Data link]

Work in progress, please revisit this page soon for more in-depth instructions.


Run the commands provided in order to set up your environment:

  1. git clone
  2. cd real-toxicity-prompts
  3. Install Anaconda, then run conda env create -f environment.yml to create a new Anaconda environment named rtp with all necessary dependencies.
  4. Run conda activate rtp before running any further scripts or notebooks.

Getting Started

Getting the data

Data processing steps are forthcoming.

Getting API access

We used the following two APIs to run our experiments:

  1. Perspective API to score text for toxicity
  2. OpenAI API to generate text with the GPT-3 model

Reproducing the experiments

The prompts experiments can be run from scripts/

Type python -m scripts.run_prompts_experiments --help to get a list of the available models and arguments that can be used.