Leaderboard-Customization-For-Equitable-Evaluation

A prototype to demonstrate leaderboard customization for equitable evaluation

This repository contains the code for the paper How Robust are Model Rankings : A Leaderboard Customization Approach for Equitable Evaluation, AAAI 2021.

Compilation Instructions

1. Download the AAAI IF folder
2. Set up a virtual python environment with the configuration file requirements.txt
3. Set up a Flask server with the following parameters:

   FLASK_APP=flask_base.py
   FLASK_DEBUG=1
   

4. Open the interface using the Flask URL (Firefox preferred)