Skip to content
Experiments on mean Average Precision and embeddings
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.


This repository allows reproducabillity of the paper Non-deterministic Behavior of Ranking-based Metrics when Evaluating Embeddings which is available in ./docs

Reproducing Experiments

Experiments require an ubuntu 16.04 system although all Unix including OsX should work.

Install requirements for the experiments:

sudo apt-get update && sudo apt-get upgrade
sudo apt-get install python-pip
pip install --user --upgrade seaborn matplotlib numpy scipy 

To run experiments and produce all plots as pdfs:

git clone
cd embedding_map
PYTHONPATH="./src/" python ./src/ ./data/phocnet.npz 

The pdfs are saved in embedding_map and producing them should take less than a minute on a contemporary machine.

Using the mAP code

File ./src/ is a python module that contains a fast implementation for computing mAP including the improovements discussed in the paper. Code in ./src/ is a good demonstration of how to use the code.

This code contains all experiments and quantitative analysis of the paper in ./docs/maps-stability-evaluation.pdf.

You can’t perform that action at this time.